Jul 07 17:27:50.114298 ip-10-0-136-242 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 17:27:50.548747 ip-10-0-136-242 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:27:50.548747 ip-10-0-136-242 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 17:27:50.548747 ip-10-0-136-242 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:27:50.548747 ip-10-0-136-242 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 17:27:50.548747 ip-10-0-136-242 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:27:50.550422 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.550328    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 17:27:50.555881 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555863    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:27:50.555881 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555880    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555885    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555888    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555891    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555896    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555900    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555903    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555906    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555909    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555913    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555915    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555919    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555921    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555924    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555934    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555937    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555940    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555943    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555945    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555948    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:27:50.555948 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555950    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555953    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555956    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555959    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555962    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555978    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555981    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555983    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555985    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555988    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555991    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555993    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555996    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.555998    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556001    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556004    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556006    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556009    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556011    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:27:50.556435 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556014    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556017    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556019    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556022    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556025    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556028    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556030    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556033    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556036    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556038    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556040    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556043    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556045    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556048    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556051    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556054    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556058    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556060    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556063    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556065    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:27:50.556926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556068    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556070    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556073    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556076    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556079    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556083    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556086    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556089    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556092    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556094    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556097    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556099    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556103    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556107    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556110    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556113    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556115    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556118    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556121    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:27:50.557449 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556124    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556126    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556129    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556131    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556134    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556137    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556140    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556142    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556146    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556149    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556151    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556154    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556157    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556159    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556162    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556164    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556167    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556169    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556171    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556174    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:27:50.557906 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.556999    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557014    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557018    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557021    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557024    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557028    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557031    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557034    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557038    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557041    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557043    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557046    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557050    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557055    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557058    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557061    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557064    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557067    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557070    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:27:50.558436 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557073    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557078    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557082    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557085    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557087    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557090    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557092    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557096    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557098    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557101    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557104    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557106    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557109    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557111    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557116    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557119    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557121    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557124    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557126    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:27:50.558953 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557129    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557132    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557135    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557137    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557139    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557142    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557144    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557147    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557149    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557152    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557154    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557157    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557160    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557162    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557165    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557169    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557172    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557175    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557177    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557180    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:27:50.559483 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557183    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557186    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557190    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557193    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557196    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557198    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557201    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557205    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557208    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557211    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557213    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557215    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557218    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557220    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557223    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557225    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557228    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557230    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557232    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557235    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:27:50.559987 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557237    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557240    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557242    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557245    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557248    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557250    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557253    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557255    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557258    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557260    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557263    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557265    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557268    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557270    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557273    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557275    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557278    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557280    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557283    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557286    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:27:50.560472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557288    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557669    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557674    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557677    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557680    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557682    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557685    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557688    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557690    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557693    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557695    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557698    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557701    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557703    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557706    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557712    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557714    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557717    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557720    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557722    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:27:50.560975 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557725    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557727    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557730    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557732    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557735    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557737    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557740    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557743    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557745    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557748    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557751    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557754    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557756    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557759    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557762    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557764    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557767    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557769    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557772    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:27:50.561464 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557775    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557777    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557780    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557783    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557786    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557789    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557791    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557794    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557798    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557801    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557804    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557806    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557808    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557811    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557813    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557816    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557818    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557821    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557823    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557826    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:27:50.561921 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557828    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557831    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557833    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557836    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557839    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557841    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557844    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557847    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557850    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557852    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557855    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557857    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557860    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557862    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557865    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557867    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557870    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557872    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557875    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557877    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:27:50.562462 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557881    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557884    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557886    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557889    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557892    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557897    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557900    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557903    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557906    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557909    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557913    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557917    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557920    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557925    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557928    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557930    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557934    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557937    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557941    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:27:50.562952 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557944    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.557947    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558041    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558054    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558061    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558066    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558070    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558073    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558078    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558082    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558085    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558088    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558092    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558096    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558099    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558103    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558105    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558109    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558112    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558115    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558119    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558122    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558125    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558129    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 17:27:50.563440 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558133    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558137    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558142    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558145    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558149    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558152    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558155    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558158    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558161    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558164    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558169    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558172    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558175    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558178    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558181    2561 flags.go:64] FLAG: --enable-server="true"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558184    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558189    2561 flags.go:64] FLAG: --event-burst="100"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558192    2561 flags.go:64] FLAG: --event-qps="50"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558195    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558198    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558201    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558205    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558208    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558211    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558214    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 07 17:27:50.564032 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558217    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558220    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558223    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558226    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558229    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558232    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558235    2561 flags.go:64] FLAG: --feature-gates=""
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558239    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558242    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558246    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558250    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558253    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558256    2561 flags.go:64] FLAG: --help="false"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558258    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-136-242.ec2.internal"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558261    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558264    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558268    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558271    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558275    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558278    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558280    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558283    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558286    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 17:27:50.564647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558289    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558292    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558295    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558298    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558301    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558304    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558307    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558310    2561 flags.go:64] FLAG: --lock-file=""
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558312    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558315    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558318    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558328    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558331    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558334    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558337    2561 flags.go:64] FLAG: --logging-format="text"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558340    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558343    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558346    2561 flags.go:64] FLAG: --manifest-url=""
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558350    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558355    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558358    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558363    2561 flags.go:64] FLAG: --max-pods="110"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558366    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558369    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558372    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 17:27:50.565275 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558375    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558378    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558381    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558384    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558392    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558395    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558398    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558400    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558403    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558408    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558411    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558414    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558417    2561 flags.go:64] FLAG: --port="10250"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558420    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558423    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00c3b03b62e64b252"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558427    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558430    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558433    2561 flags.go:64] FLAG: --register-node="true"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558436    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558440    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558443    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558446    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558448    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558452    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558455    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 17:27:50.565883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558458    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558464    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558467    2561 flags.go:64] FLAG: --runonce="false"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558470    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558473    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558476    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558479    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558482    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558485    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558488    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558491    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558494    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558497    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558500    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558503    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558506    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558509    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558511    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558517    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558521    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558524    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558528    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558531    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558534    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558537    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 17:27:50.566593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558539    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558543    2561 flags.go:64] FLAG: --v="2"
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558546    2561 flags.go:64] FLAG: --version="false"
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558551    2561 flags.go:64] FLAG: --vmodule=""
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558554    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558558    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558687    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558693    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558697    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558700    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558703    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558706    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558708    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558711    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558714    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558717    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558719    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558722    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558724    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558727    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:27:50.567238 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558730    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558733    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558735    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558738    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558740    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558743    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558747    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558749    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558752    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558754    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558757    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558760    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558762    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558765    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558767    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558770    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558773    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558775    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558778    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:27:50.567717 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558781    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558784    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558787    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558789    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558792    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558795    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558797    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558799    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558802    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558805    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558807    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558809    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558812    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558815    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558817    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558820    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558822    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558825    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558827    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558831    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:27:50.568206 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558834    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558837    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558839    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558841    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558844    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558846    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558858    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558861    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558864    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558867    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558870    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558872    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558875    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558879    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558882    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558884    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558887    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558889    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558892    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558894    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:27:50.568793 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558897    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558899    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558902    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558904    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558907    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558909    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558913    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558915    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558918    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558920    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558924    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558929    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558934    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558937    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558940    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558942    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558945    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558948    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558950    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:27:50.569310 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558953    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558956    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558959    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558962    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558978    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558981    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.558985    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.558990    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.566012    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.566031    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.566051    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.566056    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566112    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566117    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566121    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:27:50.569951 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566124    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566126    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566129    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566131    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566135    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566137    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566140    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566142    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566145    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566148    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566151    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566154    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566156    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566159    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566161    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566164    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566166    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566169    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566172    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566174    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:27:50.570525 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566177    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566180    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566182    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566185    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566188    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566191    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566194    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566196    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566199    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566201    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566204    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566206    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566209    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566212    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566215    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566218    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566220    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566223    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566226    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:27:50.571053 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566229    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566231    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566234    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566236    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566239    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566242    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566244    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566247    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566249    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566251    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566254    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566257    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566259    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566262    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566264    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566268    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566273    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566276    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566280    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:27:50.571563 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566284    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566286    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566289    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566292    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566295    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566297    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566300    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566303    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566305    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566308    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566310    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566312    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566315    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566318    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566320    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566323    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566325    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566328    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566330    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566332    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:27:50.572219 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566335    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566337    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566340    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566342    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566345    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566347    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566350    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566352    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566355    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566359    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566362    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566365    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566368    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566371    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566374    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566377    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566379    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:27:50.572735 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566381    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.566386    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566502    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566506    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566509    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566512    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566514    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566517    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566520    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566522    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566525    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566528    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566531    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566533    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566536    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:27:50.573173 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566538    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566541    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566544    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566546    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566549    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566551    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566553    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566557    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566559    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566562    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566564    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566568    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566572    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566574    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566577    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566580    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566582    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566585    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566589    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:27:50.573566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566592    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566595    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566597    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566600    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566603    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566605    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566608    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566611    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566613    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566616    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566618    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566620    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566623    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566625    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566628    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566630    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566632    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566635    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566637    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566639    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:27:50.574048 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566642    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566645    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566647    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566650    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566655    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566657    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566660    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566662    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566665    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566667    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566670    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566672    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566674    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566677    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566679    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566681    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566684    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566687    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566689    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566691    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:27:50.574549 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566694    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566697    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566699    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566702    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566704    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566706    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566709    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566711    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566714    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566716    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566718    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566721    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566724    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566726    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566729    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566731    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566735    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566737    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566740    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566742    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:27:50.575068 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566745    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:27:50.575566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566747    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:27:50.575566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566749    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:27:50.575566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566752    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:27:50.575566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566756    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:27:50.575566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566759    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:27:50.575566 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:50.566762    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:27:50.575566 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.566767    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:27:50.575566 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.566902    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 17:27:50.575566 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.571088    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 17:27:50.575566 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.573498    2561 server.go:1019] "Starting client certificate rotation"
Jul 07 17:27:50.575566 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.573604    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 17:27:50.575566 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.573638    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 17:27:50.576357 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.576342    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 17:27:50.577604 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.577580    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 17:27:50.586259 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.586239    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 07 17:27:50.588613 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.588598    2561 log.go:25] "Validated CRI v1 image API"
Jul 07 17:27:50.590049 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.590033    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 17:27:50.592605 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.592581    2561 fs.go:135] Filesystem UUIDs: map[41b267fb-65b7-4be5-8d23-d9c7bb9c8a8f:/dev/nvme0n1p3 60e0a6f3-7511-4047-9c12-6ee9579609d7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 07 17:27:50.592686 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.592603    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 17:27:50.598933 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.598804    2561 manager.go:216] Machine: {Timestamp:2026-07-07 17:27:50.597437767 +0000 UTC m=+0.360897604 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100118 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a280978d7b88bb5bf5b593cb8d92f SystemUUID:ec2a2809-78d7-b88b-b5bf-5b593cb8d92f BootID:d31739aa-1fc1-4637-8d07-847cc5028d49 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c5:00:23:c0:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c5:00:23:c0:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:36:dd:f1:c6:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 17:27:50.598933 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.598927    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 17:27:50.599056 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.599033    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 17:27:50.601811 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.601785    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 17:27:50.601952 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.601815    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-242.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 17:27:50.603028 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.603016    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 17:27:50.603067 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.603031    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 17:27:50.603067 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.603039    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 17:27:50.603583 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.603573    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 17:27:50.604907 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.604894    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 17:27:50.608004 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.607988    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 17:27:50.608361 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.608349    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 17:27:50.608404 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.608383    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 17:27:50.608404 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.608394    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 17:27:50.608457 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.608406    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 17:27:50.608457 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.608416    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 07 17:27:50.608457 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.608425    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 17:27:50.608457 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.608424    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 17:27:50.608919 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.608900    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 17:27:50.608993 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.608939    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 17:27:50.612492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.612470    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 17:27:50.614414 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.614401    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 17:27:50.614473 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.614432    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 17:27:50.615577 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.615565    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 17:27:50.615612 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.615582    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 17:27:50.615612 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.615589    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 17:27:50.615612 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.615594    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 17:27:50.615612 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.615603    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 17:27:50.615612 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.615608    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 17:27:50.615744 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.615616    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 17:27:50.615744 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.615622    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 17:27:50.615744 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.615629    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 17:27:50.615744 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.615634    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 17:27:50.615744 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.615643    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 17:27:50.615744 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.615648    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 17:27:50.615744 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.615669    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 17:27:50.615744 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.615675    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 17:27:50.618955 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.618944    2561 server.go:1268] "Started kubelet"
Jul 07 17:27:50.619099 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.619072    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 17:27:50.619099 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.619063    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 17:27:50.619199 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.619132    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 17:27:50.620025 ip-10-0-136-242 systemd[1]: Started Kubernetes Kubelet.
Jul 07 17:27:50.621389 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.621365    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 17:27:50.621389 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.621379    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-242.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 17:27:50.621505 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.621443    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 17:27:50.622763 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.622745    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 17:27:50.623352 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.623331    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 17:27:50.623871 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.623853    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 17:27:50.629284 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.629265    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 17:27:50.629284 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.629284    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 17:27:50.629451 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.629346    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:50.629830 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.629813    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 17:27:50.629929 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.628823    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-242.ec2.internal.18c0120647974608  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-242.ec2.internal,UID:ip-10-0-136-242.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-242.ec2.internal,},FirstTimestamp:2026-07-07 17:27:50.61891636 +0000 UTC m=+0.382376197,LastTimestamp:2026-07-07 17:27:50.61891636 +0000 UTC m=+0.382376197,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-242.ec2.internal,}"
Jul 07 17:27:50.630020 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.629928    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 17:27:50.630020 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.629948    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 17:27:50.630131 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.630117    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 17:27:50.630131 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.630126    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 17:27:50.630833 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.630815    2561 factory.go:153] Registering CRI-O factory
Jul 07 17:27:50.630833 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.630834    2561 factory.go:223] Registration of the crio container factory successfully
Jul 07 17:27:50.630952 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.630889    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 17:27:50.630952 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.630896    2561 factory.go:55] Registering systemd factory
Jul 07 17:27:50.630952 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.630902    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 07 17:27:50.630952 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.630919    2561 factory.go:103] Registering Raw factory
Jul 07 17:27:50.630952 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.630928    2561 manager.go:1196] Started watching for new ooms in manager
Jul 07 17:27:50.631886 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.631859    2561 manager.go:349] Starting recovery of all containers
Jul 07 17:27:50.642511 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.642210    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 17:27:50.643164 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.643068    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 17:27:50.643498 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.643479    2561 manager.go:354] Recovery completed
Jul 07 17:27:50.643829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.643807    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5s7ch"
Jul 07 17:27:50.648147 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.648134    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:27:50.650254 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.650237    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:27:50.650297 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.650274    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:27:50.650297 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.650286    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:27:50.650865 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.650844    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 17:27:50.650909 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.650866    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 17:27:50.650909 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.650887    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 17:27:50.650909 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.650902    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:27:50.651811 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.651795    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:27:50.651856 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.651822    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:27:50.651856 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.651833    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:27:50.652349 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.652336    2561 policy_none.go:49] "None policy: Start"
Jul 07 17:27:50.652472 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.652456    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5s7ch"
Jul 07 17:27:50.653009 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.652996    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 17:27:50.653068 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.653018    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 17:27:50.654252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.654238    2561 policy_none.go:47] "Start"
Jul 07 17:27:50.683572 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.683552    2561 manager.go:337] "Starting Device Plugin manager"
Jul 07 17:27:50.683692 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.683588    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 17:27:50.683692 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.683598    2561 server.go:87] "Starting device plugin registration server"
Jul 07 17:27:50.683907 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.683894    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 17:27:50.683955 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.683910    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 17:27:50.684022 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.684002    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 17:27:50.684102 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.684090    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 17:27:50.684148 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.684104    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 17:27:50.684643 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.684622    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 17:27:50.684730 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.684666    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:50.784376 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.784339    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:27:50.785720 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.785636    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:27:50.785720 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.785667    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:27:50.785720 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.785678    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:27:50.785720 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.785721    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-242.ec2.internal"
Jul 07 17:27:50.795103 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.795078    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-242.ec2.internal"
Jul 07 17:27:50.795103 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.795102    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-242.ec2.internal\": node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:50.801625 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.801561    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 17:27:50.803035 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.803010    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 17:27:50.803148 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.803056    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 17:27:50.803148 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.803075    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 17:27:50.803148 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.803106    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 17:27:50.805733 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.805710    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:27:50.811559 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.811537    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:50.904088 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.904032    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal"]
Jul 07 17:27:50.904202 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.904127    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:27:50.905473 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.905456    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:27:50.905566 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.905486    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:27:50.905566 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.905498    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:27:50.907026 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.907013    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:27:50.907073 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.907054    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:50.907106 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.907083    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:27:50.908333 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.908316    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:27:50.908406 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.908338    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:27:50.908406 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.908371    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:27:50.908406 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.908380    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:27:50.908502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.908344    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:27:50.908502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.908430    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:27:50.909675 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.909659    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:50.909726 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.909694    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:27:50.910489 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.910472    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:27:50.910570 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.910500    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:27:50.910570 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.910510    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:27:50.911656 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.911640    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:50.932086 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.932046    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cdc427ffea6b5205d3b6353cb32287af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal\" (UID: \"cdc427ffea6b5205d3b6353cb32287af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:50.932086 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.932090    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdc427ffea6b5205d3b6353cb32287af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal\" (UID: \"cdc427ffea6b5205d3b6353cb32287af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:50.932245 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:50.932145    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0fd611b44a23458fa0755b93d5b2fcb1-config\") pod \"kube-apiserver-proxy-ip-10-0-136-242.ec2.internal\" (UID: \"0fd611b44a23458fa0755b93d5b2fcb1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:50.937638 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.937621    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-242.ec2.internal\" not found" node="ip-10-0-136-242.ec2.internal"
Jul 07 17:27:50.941406 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:50.941390    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-242.ec2.internal\" not found" node="ip-10-0-136-242.ec2.internal"
Jul 07 17:27:51.012060 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:51.012014    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:51.033087 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.033057    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cdc427ffea6b5205d3b6353cb32287af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal\" (UID: \"cdc427ffea6b5205d3b6353cb32287af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:51.033217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.033089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdc427ffea6b5205d3b6353cb32287af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal\" (UID: \"cdc427ffea6b5205d3b6353cb32287af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:51.033217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.033138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0fd611b44a23458fa0755b93d5b2fcb1-config\") pod \"kube-apiserver-proxy-ip-10-0-136-242.ec2.internal\" (UID: \"0fd611b44a23458fa0755b93d5b2fcb1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:51.033217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.033160    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cdc427ffea6b5205d3b6353cb32287af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal\" (UID: \"cdc427ffea6b5205d3b6353cb32287af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:51.033217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.033168    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0fd611b44a23458fa0755b93d5b2fcb1-config\") pod \"kube-apiserver-proxy-ip-10-0-136-242.ec2.internal\" (UID: \"0fd611b44a23458fa0755b93d5b2fcb1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:51.033341 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.033233    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdc427ffea6b5205d3b6353cb32287af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal\" (UID: \"cdc427ffea6b5205d3b6353cb32287af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:51.112671 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:51.112635    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:51.218988 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:51.218925    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:51.241046 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.241019    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:51.245557 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.245162    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:51.319395 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:51.319347    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:51.420362 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:51.420266    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:51.523096 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:51.523052    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:51.573935 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.573894    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 17:27:51.574602 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.574120    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 17:27:51.623403 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:51.623367    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:51.654417 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.654370    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 17:22:51 +0000 UTC" deadline="2028-02-06 04:19:37.872951177 +0000 UTC"
Jul 07 17:27:51.654417 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.654412    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13882h51m46.218543092s"
Jul 07 17:27:51.670722 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.670656    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:27:51.723702 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:51.723660    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:51.724179 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.724161    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:27:51.821614 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:51.821575    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd611b44a23458fa0755b93d5b2fcb1.slice/crio-ebcde978d0a8ed0b8e5eb38958fb59098f87c1b36d5779650841cc69301d721f WatchSource:0}: Error finding container ebcde978d0a8ed0b8e5eb38958fb59098f87c1b36d5779650841cc69301d721f: Status 404 returned error can't find the container with id ebcde978d0a8ed0b8e5eb38958fb59098f87c1b36d5779650841cc69301d721f
Jul 07 17:27:51.821833 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:51.821812    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc427ffea6b5205d3b6353cb32287af.slice/crio-24a027ad8caf56e4cfce14c0ec5eb4fe50ef130e1089f01cf2b2ac8d2df259d0 WatchSource:0}: Error finding container 24a027ad8caf56e4cfce14c0ec5eb4fe50ef130e1089f01cf2b2ac8d2df259d0: Status 404 returned error can't find the container with id 24a027ad8caf56e4cfce14c0ec5eb4fe50ef130e1089f01cf2b2ac8d2df259d0
Jul 07 17:27:51.824224 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:51.824093    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:51.826509 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:51.826492    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:27:51.925464 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:51.925358    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:52.029072 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:52.029021    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 07 17:27:52.066820 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.066794    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:27:52.129851 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.129816    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:52.144934 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.144904    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 17:27:52.146090 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.146074    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal"
Jul 07 17:27:52.155764 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.155742    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 17:27:52.538538 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.538500    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:27:52.609649 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.609613    2561 apiserver.go:52] "Watching apiserver"
Jul 07 17:27:52.620600 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.619508    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 17:27:52.620600 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.620103    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-bgwx5","openshift-image-registry/node-ca-mp4x5","openshift-multus/multus-bzlkc","openshift-multus/network-metrics-daemon-r9xqr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal","openshift-multus/multus-additional-cni-plugins-8kwgf","openshift-network-diagnostics/network-check-target-g4svv","openshift-network-operator/iptables-alerter-sxf65","openshift-ovn-kubernetes/ovnkube-node-bpk9k","kube-system/global-pull-secret-syncer-k74rl","kube-system/konnectivity-agent-fkjch","kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal","openshift-cluster-node-tuning-operator/tuned-x8j4q"]
Jul 07 17:27:52.622584 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.622552    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.623532 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.623515    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:52.623891 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:52.623721    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:27:52.625236 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.625196    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.625802 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.625643    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 17:27:52.625802 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.625673    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 17:27:52.626798 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.626278    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 17:27:52.626798 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.626472    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 17:27:52.626798 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.626517    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 17:27:52.626798 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.626695    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:27:52.626798 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:52.626756    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:27:52.626798 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.626789    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-77b67\""
Jul 07 17:27:52.629418 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.627449    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 17:27:52.629418 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.627657    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wpxqm\""
Jul 07 17:27:52.629418 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.628535    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.631352 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.630821    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.631593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.631567    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 17:27:52.632589 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.631891    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 17:27:52.632589 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.632189    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 17:27:52.632589 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.632399    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cpgqs\""
Jul 07 17:27:52.632589 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.632512    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 17:27:52.633686 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.633242    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:27:52.633686 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.633516    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c5sft\""
Jul 07 17:27:52.634147 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.634130    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 17:27:52.634485 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.634464    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sxf65"
Jul 07 17:27:52.635718 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.635695    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:27:52.635855 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:52.635822    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:27:52.637008 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.636976    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 17:27:52.637126 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.637099    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 17:27:52.639743 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.637270    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:27:52.639743 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.637520    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4x22v\""
Jul 07 17:27:52.639743 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.637628    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mp4x5"
Jul 07 17:27:52.640557 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.640074    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jc4b7\""
Jul 07 17:27:52.640557 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.640206    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 17:27:52.640557 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.640216    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.640557 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.640259    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 17:27:52.640557 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.640301    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 17:27:52.643641 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.641527    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bgwx5"
Jul 07 17:27:52.643641 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.642832    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 17:27:52.643641 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.643242    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fkjch"
Jul 07 17:27:52.643641 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.643385    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 17:27:52.643641 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.643621    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644332    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65bfec28-49d4-436c-b19e-c3f9effdbb30-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-system-cni-dir\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-cnibin\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644399    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-var-lib-cni-multus\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644429    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqzng\" (UniqueName: \"kubernetes.io/projected/de6f83aa-7801-4df3-8b0d-52bcb6991553-kube-api-access-kqzng\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs\") pod \"network-metrics-daemon-r9xqr\" (UID: \"ab98c971-33fc-4c6a-a980-758f8f9f41fd\") " pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644488    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-socket-dir\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644515    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-var-lib-cni-bin\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-registration-dir\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-lib-modules\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644600    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-host\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644638    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65bfec28-49d4-436c-b19e-c3f9effdbb30-cnibin\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644685    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65bfec28-49d4-436c-b19e-c3f9effdbb30-os-release\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwnml\" (UniqueName: \"kubernetes.io/projected/65bfec28-49d4-436c-b19e-c3f9effdbb30-kube-api-access-zwnml\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644736    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-kubelet-config\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:52.645403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644761    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-etc-selinux\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-sys-fs\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644837    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-run\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644856    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65bfec28-49d4-436c-b19e-c3f9effdbb30-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644879    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-os-release\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644903    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de6f83aa-7801-4df3-8b0d-52bcb6991553-cni-binary-copy\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644930    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-hostroot\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644960    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-run-multus-certs\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.644978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-etc-kubernetes\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645059    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-var-lib-kubelet\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645083    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65bfec28-49d4-436c-b19e-c3f9effdbb30-system-cni-dir\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645110    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-multus-socket-dir-parent\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645146    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-run-k8s-cni-cncf-io\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645170    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-device-dir\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-sysctl-conf\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-sys\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.646206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-var-lib-kubelet\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645284    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645286    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65bfec28-49d4-436c-b19e-c3f9effdbb30-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645376    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-multus-cni-dir\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645402    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-run-netns\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645429    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66pkq\" (UniqueName: \"kubernetes.io/projected/ab98c971-33fc-4c6a-a980-758f8f9f41fd-kube-api-access-66pkq\") pod \"network-metrics-daemon-r9xqr\" (UID: \"ab98c971-33fc-4c6a-a980-758f8f9f41fd\") " pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-kubernetes\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645477    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-tuned\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz5w4\" (UniqueName: \"kubernetes.io/projected/bd0818b2-d4f6-46d5-9067-fd40e69e553f-kube-api-access-tz5w4\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-dbus\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645545    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65bfec28-49d4-436c-b19e-c3f9effdbb30-cni-binary-copy\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645567    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-sysctl-d\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-systemd\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645629    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd0818b2-d4f6-46d5-9067-fd40e69e553f-tmp\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645652    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645677    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-multus-conf-dir\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645702    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/de6f83aa-7801-4df3-8b0d-52bcb6991553-multus-daemon-config\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.647065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645729    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrw5m\" (UniqueName: \"kubernetes.io/projected/90a48037-b1f7-4a00-9e15-ecd37ebfe061-kube-api-access-wrw5m\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.648028 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645745    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 17:27:52.648028 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645753    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-modprobe-d\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.648028 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645775    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-sysconfig\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.648028 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.645681    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g7tx6\""
Jul 07 17:27:52.648028 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.646016    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 17:27:52.648028 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.646690    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 17:27:52.648028 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.646735    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 17:27:52.648028 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.646763    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jrrv4\""
Jul 07 17:27:52.649493 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.648676    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 17:27:52.649493 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.649099    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 17:27:52.649493 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.649290    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lvv4d\""
Jul 07 17:27:52.654268 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.654117    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 17:27:52.732743 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.731708    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 17:27:52.747043 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65bfec28-49d4-436c-b19e-c3f9effdbb30-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.747217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747052    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de6f83aa-7801-4df3-8b0d-52bcb6991553-cni-binary-copy\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.747217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747083    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-run-multus-certs\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.747217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747109    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-sysctl-conf\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.747217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747134    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-sys\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.747217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747165    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-run-systemd\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.747217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.747217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747209    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-run-multus-certs\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.747555 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65bfec28-49d4-436c-b19e-c3f9effdbb30-system-cni-dir\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.747555 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-multus-socket-dir-parent\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.747555 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747251    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65bfec28-49d4-436c-b19e-c3f9effdbb30-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.747555 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747295    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-tuned\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.747555 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747323    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-sys\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.747555 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747346    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-sysctl-conf\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.747555 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747372    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65bfec28-49d4-436c-b19e-c3f9effdbb30-system-cni-dir\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.747555 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747413    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-multus-socket-dir-parent\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.747555 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz5w4\" (UniqueName: \"kubernetes.io/projected/bd0818b2-d4f6-46d5-9067-fd40e69e553f-kube-api-access-tz5w4\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.747555 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747552    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ab9d796-f2d4-4e10-83a1-3bae4980a8b6-host\") pod \"node-ca-mp4x5\" (UID: \"9ab9d796-f2d4-4e10-83a1-3bae4980a8b6\") " pod="openshift-image-registry/node-ca-mp4x5"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747591    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8724ad7b-7212-4961-97e2-2c0dbf727064-ovn-node-metrics-cert\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747593    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747627    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65bfec28-49d4-436c-b19e-c3f9effdbb30-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747655    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lq6j\" (UniqueName: \"kubernetes.io/projected/c82757ce-a55f-4356-a6b0-e4939ddd7789-kube-api-access-8lq6j\") pod \"node-resolver-bgwx5\" (UID: \"c82757ce-a55f-4356-a6b0-e4939ddd7789\") " pod="openshift-dns/node-resolver-bgwx5"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747684    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-etc-openvswitch\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747710    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-run-ovn\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-dbus\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747736    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de6f83aa-7801-4df3-8b0d-52bcb6991553-cni-binary-copy\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747763    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65bfec28-49d4-436c-b19e-c3f9effdbb30-cni-binary-copy\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-sysctl-d\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-systemd\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd0818b2-d4f6-46d5-9067-fd40e69e553f-tmp\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747920    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-dbus\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747936    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-systemd\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747966    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-sysctl-d\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:52.747976    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:27:52.748153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.747985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/de6f83aa-7801-4df3-8b0d-52bcb6991553-multus-daemon-config\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-run-ovn-kubernetes\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748069    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-registration-dir\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65bfec28-49d4-436c-b19e-c3f9effdbb30-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-system-cni-dir\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-var-lib-cni-multus\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748163    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqzng\" (UniqueName: \"kubernetes.io/projected/de6f83aa-7801-4df3-8b0d-52bcb6991553-kube-api-access-kqzng\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-socket-dir\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748203    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65bfec28-49d4-436c-b19e-c3f9effdbb30-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748233    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ab9d796-f2d4-4e10-83a1-3bae4980a8b6-serviceca\") pod \"node-ca-mp4x5\" (UID: \"9ab9d796-f2d4-4e10-83a1-3bae4980a8b6\") " pod="openshift-image-registry/node-ca-mp4x5"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-run-openvswitch\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748327    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-system-cni-dir\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748363    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-var-lib-cni-multus\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748401    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65bfec28-49d4-436c-b19e-c3f9effdbb30-cni-binary-copy\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748523    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-socket-dir\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748561    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-registration-dir\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.749018 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:52.748600    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret podName:ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974 nodeName:}" failed. No retries permitted until 2026-07-07 17:27:53.248581514 +0000 UTC m=+3.012041338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret") pod "global-pull-secret-syncer-k74rl" (UID: "ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748631    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-var-lib-cni-bin\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748649    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8724ad7b-7212-4961-97e2-2c0dbf727064-env-overrides\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8724ad7b-7212-4961-97e2-2c0dbf727064-ovnkube-script-lib\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748682    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65bfec28-49d4-436c-b19e-c3f9effdbb30-cnibin\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwnml\" (UniqueName: \"kubernetes.io/projected/65bfec28-49d4-436c-b19e-c3f9effdbb30-kube-api-access-zwnml\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-sys-fs\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/831f5e82-5f34-49a0-a838-a6f572b45115-iptables-alerter-script\") pod \"iptables-alerter-sxf65\" (UID: \"831f5e82-5f34-49a0-a838-a6f572b45115\") " pod="openshift-network-operator/iptables-alerter-sxf65"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/831f5e82-5f34-49a0-a838-a6f572b45115-host-slash\") pod \"iptables-alerter-sxf65\" (UID: \"831f5e82-5f34-49a0-a838-a6f572b45115\") " pod="openshift-network-operator/iptables-alerter-sxf65"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748772    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/de6f83aa-7801-4df3-8b0d-52bcb6991553-multus-daemon-config\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748788    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-log-socket\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748804    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8724ad7b-7212-4961-97e2-2c0dbf727064-ovnkube-config\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748827    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-var-lib-cni-bin\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748837    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65bfec28-49d4-436c-b19e-c3f9effdbb30-cnibin\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-os-release\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748866    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65bfec28-49d4-436c-b19e-c3f9effdbb30-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748886    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-sys-fs\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.749829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748930    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-hostroot\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748951    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-hostroot\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748954    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-etc-kubernetes\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.748981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749004    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-device-dir\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c82757ce-a55f-4356-a6b0-e4939ddd7789-hosts-file\") pod \"node-resolver-bgwx5\" (UID: \"c82757ce-a55f-4356-a6b0-e4939ddd7789\") " pod="openshift-dns/node-resolver-bgwx5"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749070    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749032    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-os-release\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749034    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-etc-kubernetes\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749072    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc7ff047-99c6-469c-94c3-b2c5d82ba26e-konnectivity-ca\") pod \"konnectivity-agent-fkjch\" (UID: \"bc7ff047-99c6-469c-94c3-b2c5d82ba26e\") " pod="kube-system/konnectivity-agent-fkjch"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749128    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-var-lib-kubelet\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749076    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-device-dir\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-run-k8s-cni-cncf-io\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-var-lib-kubelet\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749207    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-run-k8s-cni-cncf-io\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-multus-cni-dir\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749218    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-var-lib-kubelet\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749249    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-run-netns\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.750640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749259    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-var-lib-kubelet\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749279    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66pkq\" (UniqueName: \"kubernetes.io/projected/ab98c971-33fc-4c6a-a980-758f8f9f41fd-kube-api-access-66pkq\") pod \"network-metrics-daemon-r9xqr\" (UID: \"ab98c971-33fc-4c6a-a980-758f8f9f41fd\") " pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-kubernetes\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749307    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-multus-cni-dir\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749307    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-host-run-netns\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749368    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-kubernetes\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdh4j\" (UniqueName: \"kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j\") pod \"network-check-target-g4svv\" (UID: \"1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76\") " pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749468    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-run-netns\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749514    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-node-log\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qhmc\" (UniqueName: \"kubernetes.io/projected/9ab9d796-f2d4-4e10-83a1-3bae4980a8b6-kube-api-access-9qhmc\") pod \"node-ca-mp4x5\" (UID: \"9ab9d796-f2d4-4e10-83a1-3bae4980a8b6\") " pod="openshift-image-registry/node-ca-mp4x5"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749569    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-multus-conf-dir\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrw5m\" (UniqueName: \"kubernetes.io/projected/90a48037-b1f7-4a00-9e15-ecd37ebfe061-kube-api-access-wrw5m\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749622    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-modprobe-d\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-sysconfig\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749665    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-multus-conf-dir\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749683    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-lib-modules\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749717    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-host\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.751502 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749749    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c82757ce-a55f-4356-a6b0-e4939ddd7789-tmp-dir\") pod \"node-resolver-bgwx5\" (UID: \"c82757ce-a55f-4356-a6b0-e4939ddd7789\") " pod="openshift-dns/node-resolver-bgwx5"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-cnibin\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749788    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-lib-modules\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs\") pod \"network-metrics-daemon-r9xqr\" (UID: \"ab98c971-33fc-4c6a-a980-758f8f9f41fd\") " pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzwzn\" (UniqueName: \"kubernetes.io/projected/831f5e82-5f34-49a0-a838-a6f572b45115-kube-api-access-kzwzn\") pod \"iptables-alerter-sxf65\" (UID: \"831f5e82-5f34-49a0-a838-a6f572b45115\") " pod="openshift-network-operator/iptables-alerter-sxf65"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749880    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-cni-bin\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749908    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-systemd-units\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-slash\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749959    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc7ff047-99c6-469c-94c3-b2c5d82ba26e-agent-certs\") pod \"konnectivity-agent-fkjch\" (UID: \"bc7ff047-99c6-469c-94c3-b2c5d82ba26e\") " pod="kube-system/konnectivity-agent-fkjch"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.749986    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65bfec28-49d4-436c-b19e-c3f9effdbb30-os-release\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750031    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-kubelet-config\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-etc-selinux\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-run\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750110    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-kubelet\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750130    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-modprobe-d\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-var-lib-openvswitch\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-cni-netd\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.752252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750181    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f2rs\" (UniqueName: \"kubernetes.io/projected/8724ad7b-7212-4961-97e2-2c0dbf727064-kube-api-access-4f2rs\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.752978 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750291    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de6f83aa-7801-4df3-8b0d-52bcb6991553-cnibin\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.752978 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750297    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-run\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.752978 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750299    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65bfec28-49d4-436c-b19e-c3f9effdbb30-os-release\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.752978 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750182    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-sysconfig\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.752978 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750350    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-kubelet-config\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:52.752978 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:52.750377    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:27:52.752978 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750386    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd0818b2-d4f6-46d5-9067-fd40e69e553f-host\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.752978 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.750429    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/90a48037-b1f7-4a00-9e15-ecd37ebfe061-etc-selinux\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.752978 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:52.750460    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs podName:ab98c971-33fc-4c6a-a980-758f8f9f41fd nodeName:}" failed. No retries permitted until 2026-07-07 17:27:53.250443351 +0000 UTC m=+3.013903179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs") pod "network-metrics-daemon-r9xqr" (UID: "ab98c971-33fc-4c6a-a980-758f8f9f41fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:27:52.752978 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.751451    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd0818b2-d4f6-46d5-9067-fd40e69e553f-etc-tuned\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.752978 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.751503    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd0818b2-d4f6-46d5-9067-fd40e69e553f-tmp\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.776350 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.776293    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz5w4\" (UniqueName: \"kubernetes.io/projected/bd0818b2-d4f6-46d5-9067-fd40e69e553f-kube-api-access-tz5w4\") pod \"tuned-x8j4q\" (UID: \"bd0818b2-d4f6-46d5-9067-fd40e69e553f\") " pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.778304 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.778272    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n9n26"
Jul 07 17:27:52.778813 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.778788    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrw5m\" (UniqueName: \"kubernetes.io/projected/90a48037-b1f7-4a00-9e15-ecd37ebfe061-kube-api-access-wrw5m\") pod \"aws-ebs-csi-driver-node-zhrb9\" (UID: \"90a48037-b1f7-4a00-9e15-ecd37ebfe061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.778993 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.778963    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqzng\" (UniqueName: \"kubernetes.io/projected/de6f83aa-7801-4df3-8b0d-52bcb6991553-kube-api-access-kqzng\") pod \"multus-bzlkc\" (UID: \"de6f83aa-7801-4df3-8b0d-52bcb6991553\") " pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.779442 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.779413    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwnml\" (UniqueName: \"kubernetes.io/projected/65bfec28-49d4-436c-b19e-c3f9effdbb30-kube-api-access-zwnml\") pod \"multus-additional-cni-plugins-8kwgf\" (UID: \"65bfec28-49d4-436c-b19e-c3f9effdbb30\") " pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.779509 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.779469    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66pkq\" (UniqueName: \"kubernetes.io/projected/ab98c971-33fc-4c6a-a980-758f8f9f41fd-kube-api-access-66pkq\") pod \"network-metrics-daemon-r9xqr\" (UID: \"ab98c971-33fc-4c6a-a980-758f8f9f41fd\") " pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:27:52.792447 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.792373    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n9n26"
Jul 07 17:27:52.809142 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.809046    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal" event={"ID":"cdc427ffea6b5205d3b6353cb32287af","Type":"ContainerStarted","Data":"24a027ad8caf56e4cfce14c0ec5eb4fe50ef130e1089f01cf2b2ac8d2df259d0"}
Jul 07 17:27:52.810439 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.810406    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal" event={"ID":"0fd611b44a23458fa0755b93d5b2fcb1","Type":"ContainerStarted","Data":"ebcde978d0a8ed0b8e5eb38958fb59098f87c1b36d5779650841cc69301d721f"}
Jul 07 17:27:52.851428 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851389    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ab9d796-f2d4-4e10-83a1-3bae4980a8b6-serviceca\") pod \"node-ca-mp4x5\" (UID: \"9ab9d796-f2d4-4e10-83a1-3bae4980a8b6\") " pod="openshift-image-registry/node-ca-mp4x5"
Jul 07 17:27:52.851607 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-run-openvswitch\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.851607 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851513    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-run-openvswitch\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.851607 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8724ad7b-7212-4961-97e2-2c0dbf727064-env-overrides\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.851607 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851581    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8724ad7b-7212-4961-97e2-2c0dbf727064-ovnkube-script-lib\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.851875 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851609    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/831f5e82-5f34-49a0-a838-a6f572b45115-iptables-alerter-script\") pod \"iptables-alerter-sxf65\" (UID: \"831f5e82-5f34-49a0-a838-a6f572b45115\") " pod="openshift-network-operator/iptables-alerter-sxf65"
Jul 07 17:27:52.851875 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851635    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/831f5e82-5f34-49a0-a838-a6f572b45115-host-slash\") pod \"iptables-alerter-sxf65\" (UID: \"831f5e82-5f34-49a0-a838-a6f572b45115\") " pod="openshift-network-operator/iptables-alerter-sxf65"
Jul 07 17:27:52.851875 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851660    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-log-socket\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.851875 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851708    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8724ad7b-7212-4961-97e2-2c0dbf727064-ovnkube-config\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.851875 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851738    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c82757ce-a55f-4356-a6b0-e4939ddd7789-hosts-file\") pod \"node-resolver-bgwx5\" (UID: \"c82757ce-a55f-4356-a6b0-e4939ddd7789\") " pod="openshift-dns/node-resolver-bgwx5"
Jul 07 17:27:52.851875 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851763    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc7ff047-99c6-469c-94c3-b2c5d82ba26e-konnectivity-ca\") pod \"konnectivity-agent-fkjch\" (UID: \"bc7ff047-99c6-469c-94c3-b2c5d82ba26e\") " pod="kube-system/konnectivity-agent-fkjch"
Jul 07 17:27:52.851875 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdh4j\" (UniqueName: \"kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j\") pod \"network-check-target-g4svv\" (UID: \"1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76\") " pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-run-netns\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851897    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ab9d796-f2d4-4e10-83a1-3bae4980a8b6-serviceca\") pod \"node-ca-mp4x5\" (UID: \"9ab9d796-f2d4-4e10-83a1-3bae4980a8b6\") " pod="openshift-image-registry/node-ca-mp4x5"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851907    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-node-log\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851935    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qhmc\" (UniqueName: \"kubernetes.io/projected/9ab9d796-f2d4-4e10-83a1-3bae4980a8b6-kube-api-access-9qhmc\") pod \"node-ca-mp4x5\" (UID: \"9ab9d796-f2d4-4e10-83a1-3bae4980a8b6\") " pod="openshift-image-registry/node-ca-mp4x5"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851962    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c82757ce-a55f-4356-a6b0-e4939ddd7789-tmp-dir\") pod \"node-resolver-bgwx5\" (UID: \"c82757ce-a55f-4356-a6b0-e4939ddd7789\") " pod="openshift-dns/node-resolver-bgwx5"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.851991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwzn\" (UniqueName: \"kubernetes.io/projected/831f5e82-5f34-49a0-a838-a6f572b45115-kube-api-access-kzwzn\") pod \"iptables-alerter-sxf65\" (UID: \"831f5e82-5f34-49a0-a838-a6f572b45115\") " pod="openshift-network-operator/iptables-alerter-sxf65"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-cni-bin\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852023    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-systemd-units\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852059    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-slash\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852100    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8724ad7b-7212-4961-97e2-2c0dbf727064-env-overrides\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852101    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc7ff047-99c6-469c-94c3-b2c5d82ba26e-agent-certs\") pod \"konnectivity-agent-fkjch\" (UID: \"bc7ff047-99c6-469c-94c3-b2c5d82ba26e\") " pod="kube-system/konnectivity-agent-fkjch"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-kubelet\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-var-lib-openvswitch\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852194    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-cni-netd\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f2rs\" (UniqueName: \"kubernetes.io/projected/8724ad7b-7212-4961-97e2-2c0dbf727064-kube-api-access-4f2rs\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852250    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-run-systemd\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852278    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852295    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8724ad7b-7212-4961-97e2-2c0dbf727064-ovnkube-config\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852308    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ab9d796-f2d4-4e10-83a1-3bae4980a8b6-host\") pod \"node-ca-mp4x5\" (UID: \"9ab9d796-f2d4-4e10-83a1-3bae4980a8b6\") " pod="openshift-image-registry/node-ca-mp4x5"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852333    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8724ad7b-7212-4961-97e2-2c0dbf727064-ovn-node-metrics-cert\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852362    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lq6j\" (UniqueName: \"kubernetes.io/projected/c82757ce-a55f-4356-a6b0-e4939ddd7789-kube-api-access-8lq6j\") pod \"node-resolver-bgwx5\" (UID: \"c82757ce-a55f-4356-a6b0-e4939ddd7789\") " pod="openshift-dns/node-resolver-bgwx5"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852388    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-etc-openvswitch\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852413    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-run-ovn\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852448    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c82757ce-a55f-4356-a6b0-e4939ddd7789-hosts-file\") pod \"node-resolver-bgwx5\" (UID: \"c82757ce-a55f-4356-a6b0-e4939ddd7789\") " pod="openshift-dns/node-resolver-bgwx5"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-run-ovn-kubernetes\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852511    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-run-ovn-kubernetes\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852710    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8724ad7b-7212-4961-97e2-2c0dbf727064-ovnkube-script-lib\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852802    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-cni-bin\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852814    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c82757ce-a55f-4356-a6b0-e4939ddd7789-tmp-dir\") pod \"node-resolver-bgwx5\" (UID: \"c82757ce-a55f-4356-a6b0-e4939ddd7789\") " pod="openshift-dns/node-resolver-bgwx5"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852860    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-systemd-units\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.852981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.852923    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-slash\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.853679 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.853115    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-run-netns\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.853679 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.853139    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/831f5e82-5f34-49a0-a838-a6f572b45115-iptables-alerter-script\") pod \"iptables-alerter-sxf65\" (UID: \"831f5e82-5f34-49a0-a838-a6f572b45115\") " pod="openshift-network-operator/iptables-alerter-sxf65"
Jul 07 17:27:52.853679 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.853171    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-node-log\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.853679 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.853187    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/831f5e82-5f34-49a0-a838-a6f572b45115-host-slash\") pod \"iptables-alerter-sxf65\" (UID: \"831f5e82-5f34-49a0-a838-a6f572b45115\") " pod="openshift-network-operator/iptables-alerter-sxf65"
Jul 07 17:27:52.853679 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.853229    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-log-socket\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.853679 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.853230    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.853679 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.853275    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-kubelet\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.853679 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.853337    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-var-lib-openvswitch\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.853679 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.853380    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-host-cni-netd\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.853679 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.853406    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ab9d796-f2d4-4e10-83a1-3bae4980a8b6-host\") pod \"node-ca-mp4x5\" (UID: \"9ab9d796-f2d4-4e10-83a1-3bae4980a8b6\") " pod="openshift-image-registry/node-ca-mp4x5"
Jul 07 17:27:52.853679 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.853469    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-run-systemd\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.853679 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.853531    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-run-ovn\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.853679 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.853578    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8724ad7b-7212-4961-97e2-2c0dbf727064-etc-openvswitch\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.854363 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.854115    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc7ff047-99c6-469c-94c3-b2c5d82ba26e-konnectivity-ca\") pod \"konnectivity-agent-fkjch\" (UID: \"bc7ff047-99c6-469c-94c3-b2c5d82ba26e\") " pod="kube-system/konnectivity-agent-fkjch"
Jul 07 17:27:52.856139 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.856112    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc7ff047-99c6-469c-94c3-b2c5d82ba26e-agent-certs\") pod \"konnectivity-agent-fkjch\" (UID: \"bc7ff047-99c6-469c-94c3-b2c5d82ba26e\") " pod="kube-system/konnectivity-agent-fkjch"
Jul 07 17:27:52.856250 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.856237    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8724ad7b-7212-4961-97e2-2c0dbf727064-ovn-node-metrics-cert\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.865249 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:52.865222    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:27:52.865249 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:52.865253    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:27:52.865476 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:52.865268    2561 projected.go:196] Error preparing data for projected volume kube-api-access-wdh4j for pod openshift-network-diagnostics/network-check-target-g4svv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:27:52.865476 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:52.865350    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j podName:1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76 nodeName:}" failed. No retries permitted until 2026-07-07 17:27:53.365330468 +0000 UTC m=+3.128790308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wdh4j" (UniqueName: "kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j") pod "network-check-target-g4svv" (UID: "1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:27:52.869111 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.869029    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lq6j\" (UniqueName: \"kubernetes.io/projected/c82757ce-a55f-4356-a6b0-e4939ddd7789-kube-api-access-8lq6j\") pod \"node-resolver-bgwx5\" (UID: \"c82757ce-a55f-4356-a6b0-e4939ddd7789\") " pod="openshift-dns/node-resolver-bgwx5"
Jul 07 17:27:52.870041 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.870015    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f2rs\" (UniqueName: \"kubernetes.io/projected/8724ad7b-7212-4961-97e2-2c0dbf727064-kube-api-access-4f2rs\") pod \"ovnkube-node-bpk9k\" (UID: \"8724ad7b-7212-4961-97e2-2c0dbf727064\") " pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:52.870168 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.870141    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qhmc\" (UniqueName: \"kubernetes.io/projected/9ab9d796-f2d4-4e10-83a1-3bae4980a8b6-kube-api-access-9qhmc\") pod \"node-ca-mp4x5\" (UID: \"9ab9d796-f2d4-4e10-83a1-3bae4980a8b6\") " pod="openshift-image-registry/node-ca-mp4x5"
Jul 07 17:27:52.870352 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.870331    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzwzn\" (UniqueName: \"kubernetes.io/projected/831f5e82-5f34-49a0-a838-a6f572b45115-kube-api-access-kzwzn\") pod \"iptables-alerter-sxf65\" (UID: \"831f5e82-5f34-49a0-a838-a6f572b45115\") " pod="openshift-network-operator/iptables-alerter-sxf65"
Jul 07 17:27:52.938287 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.938009    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8kwgf"
Jul 07 17:27:52.948516 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.948483    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bzlkc"
Jul 07 17:27:52.950194 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:52.950152    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65bfec28_49d4_436c_b19e_c3f9effdbb30.slice/crio-ebd32ab69227466d385781e67b5d27fe5d6c173c55c2e89436818e7fd459757b WatchSource:0}: Error finding container ebd32ab69227466d385781e67b5d27fe5d6c173c55c2e89436818e7fd459757b: Status 404 returned error can't find the container with id ebd32ab69227466d385781e67b5d27fe5d6c173c55c2e89436818e7fd459757b
Jul 07 17:27:52.959129 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:52.959097    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde6f83aa_7801_4df3_8b0d_52bcb6991553.slice/crio-496d4ecb5e52de5451a7c8c047c0056a36f95014b755ec888b6d5598d8071bd6 WatchSource:0}: Error finding container 496d4ecb5e52de5451a7c8c047c0056a36f95014b755ec888b6d5598d8071bd6: Status 404 returned error can't find the container with id 496d4ecb5e52de5451a7c8c047c0056a36f95014b755ec888b6d5598d8071bd6
Jul 07 17:27:52.965915 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.965886    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9"
Jul 07 17:27:52.977926 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:52.977892    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a48037_b1f7_4a00_9e15_ecd37ebfe061.slice/crio-9817a15c64fef9f4c6cb574c0e18a3f1236374e7e1ef5654108abdff3322c7e6 WatchSource:0}: Error finding container 9817a15c64fef9f4c6cb574c0e18a3f1236374e7e1ef5654108abdff3322c7e6: Status 404 returned error can't find the container with id 9817a15c64fef9f4c6cb574c0e18a3f1236374e7e1ef5654108abdff3322c7e6
Jul 07 17:27:52.980822 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.980612    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x8j4q"
Jul 07 17:27:52.990273 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:52.990243    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0818b2_d4f6_46d5_9067_fd40e69e553f.slice/crio-92565e0d359cbbad87e105021afd8555b856d0d07ca5519782efdecf239daea1 WatchSource:0}: Error finding container 92565e0d359cbbad87e105021afd8555b856d0d07ca5519782efdecf239daea1: Status 404 returned error can't find the container with id 92565e0d359cbbad87e105021afd8555b856d0d07ca5519782efdecf239daea1
Jul 07 17:27:52.996847 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:52.996820    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sxf65"
Jul 07 17:27:53.004296 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.004261    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mp4x5"
Jul 07 17:27:53.013611 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.013585    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:27:53.013862 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:53.013835    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab9d796_f2d4_4e10_83a1_3bae4980a8b6.slice/crio-0b8e38154be62bed7bfdd1069d22349278a742d795dc2af823f32b8dcbb713e3 WatchSource:0}: Error finding container 0b8e38154be62bed7bfdd1069d22349278a742d795dc2af823f32b8dcbb713e3: Status 404 returned error can't find the container with id 0b8e38154be62bed7bfdd1069d22349278a742d795dc2af823f32b8dcbb713e3
Jul 07 17:27:53.022293 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.022272    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bgwx5"
Jul 07 17:27:53.024800 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:53.024775    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8724ad7b_7212_4961_97e2_2c0dbf727064.slice/crio-ad0c315e12126a2cb020c6af8bf692418d96749afde21659f3f8b9052349f0b1 WatchSource:0}: Error finding container ad0c315e12126a2cb020c6af8bf692418d96749afde21659f3f8b9052349f0b1: Status 404 returned error can't find the container with id ad0c315e12126a2cb020c6af8bf692418d96749afde21659f3f8b9052349f0b1
Jul 07 17:27:53.028040 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.028020    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fkjch"
Jul 07 17:27:53.032872 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:53.032839    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82757ce_a55f_4356_a6b0_e4939ddd7789.slice/crio-dc646d9b0565b23a078e62e6b2c7f82d8faa5bb00191643a49734b5311633a8e WatchSource:0}: Error finding container dc646d9b0565b23a078e62e6b2c7f82d8faa5bb00191643a49734b5311633a8e: Status 404 returned error can't find the container with id dc646d9b0565b23a078e62e6b2c7f82d8faa5bb00191643a49734b5311633a8e
Jul 07 17:27:53.040372 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:27:53.040344    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7ff047_99c6_469c_94c3_b2c5d82ba26e.slice/crio-1e8e33b374e83f8dce114833bc84976f49d75514037f2a8a4c261b9caf710ca2 WatchSource:0}: Error finding container 1e8e33b374e83f8dce114833bc84976f49d75514037f2a8a4c261b9caf710ca2: Status 404 returned error can't find the container with id 1e8e33b374e83f8dce114833bc84976f49d75514037f2a8a4c261b9caf710ca2
Jul 07 17:27:53.256111 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.256075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:53.256304 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.256149    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs\") pod \"network-metrics-daemon-r9xqr\" (UID: \"ab98c971-33fc-4c6a-a980-758f8f9f41fd\") " pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:27:53.256304 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:53.256224    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:27:53.256304 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:53.256287    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:27:53.256470 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:53.256312    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret podName:ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974 nodeName:}" failed. No retries permitted until 2026-07-07 17:27:54.256288353 +0000 UTC m=+4.019748178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret") pod "global-pull-secret-syncer-k74rl" (UID: "ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:27:53.256470 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:53.256334    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs podName:ab98c971-33fc-4c6a-a980-758f8f9f41fd nodeName:}" failed. No retries permitted until 2026-07-07 17:27:54.256320948 +0000 UTC m=+4.019780791 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs") pod "network-metrics-daemon-r9xqr" (UID: "ab98c971-33fc-4c6a-a980-758f8f9f41fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:27:53.458132 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.457900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdh4j\" (UniqueName: \"kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j\") pod \"network-check-target-g4svv\" (UID: \"1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76\") " pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:27:53.458322 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:53.458107    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:27:53.458322 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:53.458177    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:27:53.458322 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:53.458190    2561 projected.go:196] Error preparing data for projected volume kube-api-access-wdh4j for pod openshift-network-diagnostics/network-check-target-g4svv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:27:53.458322 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:53.458256    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j podName:1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76 nodeName:}" failed. No retries permitted until 2026-07-07 17:27:54.458236556 +0000 UTC m=+4.221696397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdh4j" (UniqueName: "kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j") pod "network-check-target-g4svv" (UID: "1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:27:53.795235 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.795120    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:22:53 +0000 UTC" deadline="2028-04-07 22:43:51.237243696 +0000 UTC"
Jul 07 17:27:53.795235 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.795167    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15365h15m57.442081386s"
Jul 07 17:27:53.803818 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.803783    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:27:53.804071 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:53.804041    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:27:53.804240 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.804223    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:27:53.804427 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:53.804389    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:27:53.815299 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.815258    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bgwx5" event={"ID":"c82757ce-a55f-4356-a6b0-e4939ddd7789","Type":"ContainerStarted","Data":"dc646d9b0565b23a078e62e6b2c7f82d8faa5bb00191643a49734b5311633a8e"}
Jul 07 17:27:53.819445 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.819408    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k" event={"ID":"8724ad7b-7212-4961-97e2-2c0dbf727064","Type":"ContainerStarted","Data":"ad0c315e12126a2cb020c6af8bf692418d96749afde21659f3f8b9052349f0b1"}
Jul 07 17:27:53.821709 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.821610    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sxf65" event={"ID":"831f5e82-5f34-49a0-a838-a6f572b45115","Type":"ContainerStarted","Data":"5dd7361b71ce91ffbd1956ae1cf29d7a6292d9891747d74916378d36ca758631"}
Jul 07 17:27:53.824183 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.824150    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x8j4q" event={"ID":"bd0818b2-d4f6-46d5-9067-fd40e69e553f","Type":"ContainerStarted","Data":"92565e0d359cbbad87e105021afd8555b856d0d07ca5519782efdecf239daea1"}
Jul 07 17:27:53.825919 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.825892    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9" event={"ID":"90a48037-b1f7-4a00-9e15-ecd37ebfe061","Type":"ContainerStarted","Data":"9817a15c64fef9f4c6cb574c0e18a3f1236374e7e1ef5654108abdff3322c7e6"}
Jul 07 17:27:53.830366 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.830336    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fkjch" event={"ID":"bc7ff047-99c6-469c-94c3-b2c5d82ba26e","Type":"ContainerStarted","Data":"1e8e33b374e83f8dce114833bc84976f49d75514037f2a8a4c261b9caf710ca2"}
Jul 07 17:27:53.838854 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.838818    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mp4x5" event={"ID":"9ab9d796-f2d4-4e10-83a1-3bae4980a8b6","Type":"ContainerStarted","Data":"0b8e38154be62bed7bfdd1069d22349278a742d795dc2af823f32b8dcbb713e3"}
Jul 07 17:27:53.840850 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.840807    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bzlkc" event={"ID":"de6f83aa-7801-4df3-8b0d-52bcb6991553","Type":"ContainerStarted","Data":"496d4ecb5e52de5451a7c8c047c0056a36f95014b755ec888b6d5598d8071bd6"}
Jul 07 17:27:53.842459 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:53.842434    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8kwgf" event={"ID":"65bfec28-49d4-436c-b19e-c3f9effdbb30","Type":"ContainerStarted","Data":"ebd32ab69227466d385781e67b5d27fe5d6c173c55c2e89436818e7fd459757b"}
Jul 07 17:27:54.266145 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:54.266027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs\") pod \"network-metrics-daemon-r9xqr\" (UID: \"ab98c971-33fc-4c6a-a980-758f8f9f41fd\") " pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:27:54.266145 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:54.266106    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:54.266375 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:54.266282    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:27:54.266375 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:54.266352    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret podName:ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974 nodeName:}" failed. No retries permitted until 2026-07-07 17:27:56.266332354 +0000 UTC m=+6.029792198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret") pod "global-pull-secret-syncer-k74rl" (UID: "ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:27:54.266794 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:54.266774    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:27:54.266880 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:54.266832    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs podName:ab98c971-33fc-4c6a-a980-758f8f9f41fd nodeName:}" failed. No retries permitted until 2026-07-07 17:27:56.26681317 +0000 UTC m=+6.030273013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs") pod "network-metrics-daemon-r9xqr" (UID: "ab98c971-33fc-4c6a-a980-758f8f9f41fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:27:54.468428 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:54.468384    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdh4j\" (UniqueName: \"kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j\") pod \"network-check-target-g4svv\" (UID: \"1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76\") " pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:27:54.468693 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:54.468647    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:27:54.468693 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:54.468677    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:27:54.468693 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:54.468691    2561 projected.go:196] Error preparing data for projected volume kube-api-access-wdh4j for pod openshift-network-diagnostics/network-check-target-g4svv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:27:54.468900 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:54.468752    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j podName:1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76 nodeName:}" failed. No retries permitted until 2026-07-07 17:27:56.468733654 +0000 UTC m=+6.232193499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdh4j" (UniqueName: "kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j") pod "network-check-target-g4svv" (UID: "1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:27:54.795866 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:54.795787    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:22:53 +0000 UTC" deadline="2027-12-23 16:22:02.741888772 +0000 UTC"
Jul 07 17:27:54.795866 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:54.795824    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12814h54m7.946069151s"
Jul 07 17:27:54.806886 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:54.806404    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:54.806886 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:54.806534    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:27:55.803671 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:55.803634    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:27:55.804160 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:55.803794    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:27:55.804307 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:55.804266    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:27:55.804425 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:55.804383    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:27:55.856981 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:55.856894    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal" event={"ID":"0fd611b44a23458fa0755b93d5b2fcb1","Type":"ContainerStarted","Data":"7eedf7bd4b7401bd0de43ecae640b1dff761e316cfce3150fee13c4f18dc0adb"}
Jul 07 17:27:55.864933 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:55.864891    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal" event={"ID":"cdc427ffea6b5205d3b6353cb32287af","Type":"ContainerStarted","Data":"ae79844edbffc2184a4e92004a895ceece233e8b9ecd6a9fa97b86b7014787f2"}
Jul 07 17:27:55.894168 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:55.894090    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal" podStartSLOduration=3.894063403 podStartE2EDuration="3.894063403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:27:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:27:55.876679734 +0000 UTC m=+5.640139584" watchObservedRunningTime="2026-07-07 17:27:55.894063403 +0000 UTC m=+5.657523254"
Jul 07 17:27:56.286307 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:56.285387    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:56.286307 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:56.285489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs\") pod \"network-metrics-daemon-r9xqr\" (UID: \"ab98c971-33fc-4c6a-a980-758f8f9f41fd\") " pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:27:56.286307 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:56.285622    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:27:56.286307 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:56.285693    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs podName:ab98c971-33fc-4c6a-a980-758f8f9f41fd nodeName:}" failed. No retries permitted until 2026-07-07 17:28:00.285671448 +0000 UTC m=+10.049131281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs") pod "network-metrics-daemon-r9xqr" (UID: "ab98c971-33fc-4c6a-a980-758f8f9f41fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:27:56.286307 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:56.286163    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:27:56.286307 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:56.286222    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret podName:ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974 nodeName:}" failed. No retries permitted until 2026-07-07 17:28:00.286204416 +0000 UTC m=+10.049664245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret") pod "global-pull-secret-syncer-k74rl" (UID: "ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:27:56.487655 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:56.486985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdh4j\" (UniqueName: \"kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j\") pod \"network-check-target-g4svv\" (UID: \"1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76\") " pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:27:56.487655 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:56.487162    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:27:56.487655 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:56.487189    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:27:56.487655 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:56.487201    2561 projected.go:196] Error preparing data for projected volume kube-api-access-wdh4j for pod openshift-network-diagnostics/network-check-target-g4svv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:27:56.487655 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:56.487257    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j podName:1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76 nodeName:}" failed. No retries permitted until 2026-07-07 17:28:00.487237202 +0000 UTC m=+10.250697027 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdh4j" (UniqueName: "kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j") pod "network-check-target-g4svv" (UID: "1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:27:56.806550 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:56.805984    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:56.806550 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:56.806147    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:27:57.803819 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:57.803778    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:27:57.804050 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:57.803831    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:27:57.804050 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:57.803918    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:27:57.804147 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:57.804071    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:27:58.804348 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:58.804308    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:27:58.804798 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:58.804462    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:27:59.803801 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:59.803758    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:27:59.804049 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:59.803783    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:27:59.804049 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:59.803923    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:27:59.804185 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:27:59.804100    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:27:59.888815 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:59.888713    2561 generic.go:356] "Generic (PLEG): container finished" podID="cdc427ffea6b5205d3b6353cb32287af" containerID="ae79844edbffc2184a4e92004a895ceece233e8b9ecd6a9fa97b86b7014787f2" exitCode=0
Jul 07 17:27:59.888815 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:27:59.888775    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal" event={"ID":"cdc427ffea6b5205d3b6353cb32287af","Type":"ContainerDied","Data":"ae79844edbffc2184a4e92004a895ceece233e8b9ecd6a9fa97b86b7014787f2"}
Jul 07 17:28:00.319507 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:00.319414    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:00.319672 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:00.319517    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs\") pod \"network-metrics-daemon-r9xqr\" (UID: \"ab98c971-33fc-4c6a-a980-758f8f9f41fd\") " pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:00.319672 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:00.319608    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:28:00.319672 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:00.319644    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:28:00.319816 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:00.319698    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret podName:ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974 nodeName:}" failed. No retries permitted until 2026-07-07 17:28:08.319673883 +0000 UTC m=+18.083133709 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret") pod "global-pull-secret-syncer-k74rl" (UID: "ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:28:00.319816 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:00.319722    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs podName:ab98c971-33fc-4c6a-a980-758f8f9f41fd nodeName:}" failed. No retries permitted until 2026-07-07 17:28:08.319709769 +0000 UTC m=+18.083169605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs") pod "network-metrics-daemon-r9xqr" (UID: "ab98c971-33fc-4c6a-a980-758f8f9f41fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:28:00.521235 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:00.521188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdh4j\" (UniqueName: \"kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j\") pod \"network-check-target-g4svv\" (UID: \"1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76\") " pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:00.521473 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:00.521447    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:28:00.521473 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:00.521477    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:28:00.521663 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:00.521494    2561 projected.go:196] Error preparing data for projected volume kube-api-access-wdh4j for pod openshift-network-diagnostics/network-check-target-g4svv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:28:00.521663 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:00.521562    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j podName:1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76 nodeName:}" failed. No retries permitted until 2026-07-07 17:28:08.521541646 +0000 UTC m=+18.285001495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdh4j" (UniqueName: "kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j") pod "network-check-target-g4svv" (UID: "1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:28:00.804804 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:00.804717    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:00.804974 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:00.804853    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:01.803285 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:01.803245    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:01.803700 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:01.803384    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:01.803799 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:01.803768    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:01.803924 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:01.803863    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:02.803358 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:02.803332    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:02.803836 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:02.803457    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:03.803673 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:03.803623    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:03.804097 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:03.803756    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:03.804168 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:03.804146    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:03.804275 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:03.804253    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:04.804733 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:04.804112    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:04.804733 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:04.804411    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:04.900854 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:04.900775    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9" event={"ID":"90a48037-b1f7-4a00-9e15-ecd37ebfe061","Type":"ContainerStarted","Data":"bc3708d45a88f51dbc28275e2d64269cab0d8b6779dbc7203983f1ceaf3233b9"}
Jul 07 17:28:04.902792 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:04.902759    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal" event={"ID":"cdc427ffea6b5205d3b6353cb32287af","Type":"ContainerStarted","Data":"b8b332d898a0654318dee28631ad6836040a17e0fedf0228c875a43cc306a7d2"}
Jul 07 17:28:04.904369 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:04.904332    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fkjch" event={"ID":"bc7ff047-99c6-469c-94c3-b2c5d82ba26e","Type":"ContainerStarted","Data":"8d710d2ec0b3108116ad70f768a643a18d3601b66917e80b5166f045bccbd521"}
Jul 07 17:28:04.905942 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:04.905913    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mp4x5" event={"ID":"9ab9d796-f2d4-4e10-83a1-3bae4980a8b6","Type":"ContainerStarted","Data":"0d7d183c9f89d7634d46ff045554e10f8e2b820f2e088ca19ffe3f39c8ef31a7"}
Jul 07 17:28:04.907999 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:04.907599    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8kwgf" event={"ID":"65bfec28-49d4-436c-b19e-c3f9effdbb30","Type":"ContainerStarted","Data":"0378396aee648af06061f0d641d8bdf62877a6c1ebbaa4e3e861050354553376"}
Jul 07 17:28:04.909564 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:04.909535    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bgwx5" event={"ID":"c82757ce-a55f-4356-a6b0-e4939ddd7789","Type":"ContainerStarted","Data":"debaf6d25ec488602d680a27419f49a491d9404e162cf1fed05e1a2c3efe2016"}
Jul 07 17:28:04.911096 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:04.911071    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x8j4q" event={"ID":"bd0818b2-d4f6-46d5-9067-fd40e69e553f","Type":"ContainerStarted","Data":"9bfdf25a53f9c113d9ce5e5435955e63627e839d3c98dd30b86fd796a463fb22"}
Jul 07 17:28:04.942143 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:04.942042    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal" podStartSLOduration=12.942024875 podStartE2EDuration="12.942024875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:27:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:04.922223886 +0000 UTC m=+14.685683733" watchObservedRunningTime="2026-07-07 17:28:04.942024875 +0000 UTC m=+14.705484718"
Jul 07 17:28:04.942459 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:04.942431    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fkjch" podStartSLOduration=2.740614736 podStartE2EDuration="13.942423023s" totalImagesPullingTime="11.201808287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:04.942017449 +0000 UTC m=+14.705477289" watchObservedRunningTime="2026-07-07 17:28:04.942423023 +0000 UTC m=+14.705883317"
Jul 07 17:28:04.984887 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:04.984831    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x8j4q" podStartSLOduration=2.439582633 podStartE2EDuration="13.984810057s" totalImagesPullingTime="11.545227424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:04.984711585 +0000 UTC m=+14.748171434" watchObservedRunningTime="2026-07-07 17:28:04.984810057 +0000 UTC m=+14.748269905"
Jul 07 17:28:05.019161 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:05.019099    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bgwx5" podStartSLOduration=2.836221723 podStartE2EDuration="14.019080911s" totalImagesPullingTime="11.182859188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:05.018399927 +0000 UTC m=+14.781859775" watchObservedRunningTime="2026-07-07 17:28:05.019080911 +0000 UTC m=+14.782540757"
Jul 07 17:28:05.019352 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:05.019180    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mp4x5" podStartSLOduration=2.791432915 podStartE2EDuration="14.01917422s" totalImagesPullingTime="11.227741305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:05.001320078 +0000 UTC m=+14.764779918" watchObservedRunningTime="2026-07-07 17:28:05.01917422 +0000 UTC m=+14.782634066"
Jul 07 17:28:05.804030 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:05.803960    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:05.804030 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:05.804037    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:05.804281 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:05.804141    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:05.804281 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:05.804266    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:05.915190 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:05.915151    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sxf65" event={"ID":"831f5e82-5f34-49a0-a838-a6f572b45115","Type":"ContainerStarted","Data":"21285f6765df52aa08e38e2d03549417b188440b9c11c31ecdd15eb26c534156"}
Jul 07 17:28:06.588491 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:06.588442    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fkjch"
Jul 07 17:28:06.589231 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:06.589204    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fkjch"
Jul 07 17:28:06.803708 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:06.803514    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:06.803708 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:06.803664    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:06.936159 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:06.936054    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sxf65" podStartSLOduration=4.727292946 podStartE2EDuration="15.936033175s" totalImagesPullingTime="11.208740229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:06.935478758 +0000 UTC m=+16.698938618" watchObservedRunningTime="2026-07-07 17:28:06.936033175 +0000 UTC m=+16.699493043"
Jul 07 17:28:07.803771 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:07.803737    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:07.804022 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:07.803873    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:07.804022 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:07.803928    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:07.804157 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:07.804078    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:07.919393 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:07.919359    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 17:28:08.389775 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:08.389737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs\") pod \"network-metrics-daemon-r9xqr\" (UID: \"ab98c971-33fc-4c6a-a980-758f8f9f41fd\") " pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:08.390351 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:08.389802    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:08.390351 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:08.389861    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:28:08.390351 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:08.389913    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:28:08.390351 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:08.389940    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs podName:ab98c971-33fc-4c6a-a980-758f8f9f41fd nodeName:}" failed. No retries permitted until 2026-07-07 17:28:24.389921607 +0000 UTC m=+34.153381447 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs") pod "network-metrics-daemon-r9xqr" (UID: "ab98c971-33fc-4c6a-a980-758f8f9f41fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:28:08.390351 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:08.389980    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret podName:ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974 nodeName:}" failed. No retries permitted until 2026-07-07 17:28:24.389953274 +0000 UTC m=+34.153413097 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret") pod "global-pull-secret-syncer-k74rl" (UID: "ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:28:08.591362 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:08.591329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdh4j\" (UniqueName: \"kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j\") pod \"network-check-target-g4svv\" (UID: \"1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76\") " pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:08.591530 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:08.591510    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:28:08.591568 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:08.591537    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:28:08.591568 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:08.591552    2561 projected.go:196] Error preparing data for projected volume kube-api-access-wdh4j for pod openshift-network-diagnostics/network-check-target-g4svv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:28:08.591623 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:08.591611    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j podName:1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76 nodeName:}" failed. No retries permitted until 2026-07-07 17:28:24.591597449 +0000 UTC m=+34.355057273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdh4j" (UniqueName: "kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j") pod "network-check-target-g4svv" (UID: "1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:28:08.803619 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:08.803545    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:08.803795 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:08.803673    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:08.923003 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:08.922931    2561 generic.go:356] "Generic (PLEG): container finished" podID="65bfec28-49d4-436c-b19e-c3f9effdbb30" containerID="0378396aee648af06061f0d641d8bdf62877a6c1ebbaa4e3e861050354553376" exitCode=0
Jul 07 17:28:08.923182 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:08.923009    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8kwgf" event={"ID":"65bfec28-49d4-436c-b19e-c3f9effdbb30","Type":"ContainerDied","Data":"0378396aee648af06061f0d641d8bdf62877a6c1ebbaa4e3e861050354553376"}
Jul 07 17:28:09.777326 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:09.777277    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fkjch"
Jul 07 17:28:09.777778 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:09.777451    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 17:28:09.778420 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:09.778395    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fkjch"
Jul 07 17:28:09.804170 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:09.804136    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:09.804345 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:09.804276    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:09.804345 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:09.804325    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:09.804481 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:09.804439    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:10.804977 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:10.804731    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:10.805396 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:10.805076    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:11.577604 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:11.577572    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bgwx5_c82757ce-a55f-4356-a6b0-e4939ddd7789/dns-node-resolver/0.log"
Jul 07 17:28:11.804310 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:11.804266    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:11.804471 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:11.804286    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:11.804471 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:11.804394    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:11.804565 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:11.804473    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:12.546703 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:12.546667    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mp4x5_9ab9d796-f2d4-4e10-83a1-3bae4980a8b6/node-ca/0.log"
Jul 07 17:28:12.803649 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:12.803564    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:12.803836 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:12.803698    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:13.798811 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:13.798786    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 17:28:13.803395 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:13.803364    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:13.803499 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:13.803371    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:13.803594 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:13.803518    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:13.803655 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:13.803591    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:13.935984 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:13.935730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k" event={"ID":"8724ad7b-7212-4961-97e2-2c0dbf727064","Type":"ContainerStarted","Data":"460297f7b33caa67926ebd833243817da593f5ff9b03f6aaaa172ff811091f55"}
Jul 07 17:28:13.936163 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:13.936058    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k" event={"ID":"8724ad7b-7212-4961-97e2-2c0dbf727064","Type":"ContainerStarted","Data":"b1be5544460a2ca6e60b71a38ef3b97b044bc989b594cebba937827fca2f9ec0"}
Jul 07 17:28:13.937841 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:13.937812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9" event={"ID":"90a48037-b1f7-4a00-9e15-ecd37ebfe061","Type":"ContainerStarted","Data":"0e22750d078b610843b6daa0ab5f5b846321105d40d73a18f2498ec18de63ec8"}
Jul 07 17:28:13.939649 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:13.939620    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bzlkc" event={"ID":"de6f83aa-7801-4df3-8b0d-52bcb6991553","Type":"ContainerStarted","Data":"fe303c9ae5229d5e1d42bef29f23cf8b81b5d40b305da0379e9d794987f53d7c"}
Jul 07 17:28:13.964462 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:13.964405    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bzlkc" podStartSLOduration=2.264804051 podStartE2EDuration="22.964383414s" totalImagesPullingTime="20.699579363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:13.962346064 +0000 UTC m=+23.725805911" watchObservedRunningTime="2026-07-07 17:28:13.964383414 +0000 UTC m=+23.727843262"
Jul 07 17:28:14.698535 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:14.698408    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T17:28:13.798810393Z","UUID":"0287f2e3-8cc8-4e90-9c0a-c2be5aef0dde","Handler":null,"Name":"","Endpoint":""}
Jul 07 17:28:14.700106 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:14.700083    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 17:28:14.700226 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:14.700122    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 17:28:14.804415 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:14.804384    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:14.805071 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:14.804502    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:14.946430 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:14.946397    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k" event={"ID":"8724ad7b-7212-4961-97e2-2c0dbf727064","Type":"ContainerStarted","Data":"79043c9975087d96b5c9103611459e8b0eabdfccf66c4d5ece58c46f1d04ac1f"}
Jul 07 17:28:14.946667 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:14.946488    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k" event={"ID":"8724ad7b-7212-4961-97e2-2c0dbf727064","Type":"ContainerStarted","Data":"8a3b6c726815e880bba10917f221737687a18a1c58c3337e58b9ce7cafe6e957"}
Jul 07 17:28:14.946667 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:14.946543    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k" event={"ID":"8724ad7b-7212-4961-97e2-2c0dbf727064","Type":"ContainerStarted","Data":"389b0822a0d82b1ae6847698fd543e7382f64986c4d4d2738353fced6b77c21d"}
Jul 07 17:28:14.946667 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:14.946591    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k" event={"ID":"8724ad7b-7212-4961-97e2-2c0dbf727064","Type":"ContainerStarted","Data":"3f67bdf2b78098f930af0864076efee18dcdc67833fdd18f6f09e109df33e228"}
Jul 07 17:28:15.803985 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:15.803943    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:15.804279 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:15.804007    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:15.804279 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:15.804101    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:15.804279 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:15.804207    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:15.951705 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:15.951667    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9" event={"ID":"90a48037-b1f7-4a00-9e15-ecd37ebfe061","Type":"ContainerStarted","Data":"6413cc50fbb4a6068a3378956e6214235316cf9f99e84ecc60125f1b32f6563d"}
Jul 07 17:28:15.983645 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:15.983594    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhrb9" podStartSLOduration=3.555239739 podStartE2EDuration="24.983579091s" totalImagesPullingTime="21.428339352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:27:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:15.983394424 +0000 UTC m=+25.746854269" watchObservedRunningTime="2026-07-07 17:28:15.983579091 +0000 UTC m=+25.747038936"
Jul 07 17:28:16.804288 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:16.804204    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:16.804434 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:16.804317    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:16.957399 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:16.957354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k" event={"ID":"8724ad7b-7212-4961-97e2-2c0dbf727064","Type":"ContainerStarted","Data":"839fed5b31870888cadbf9eaaf55b44c50207518610d56404e7379095b317292"}
Jul 07 17:28:17.804168 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:17.804129    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:17.804366 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:17.804129    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:17.804366 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:17.804260    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:17.804481 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:17.804364    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:18.803457 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:18.803364    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:18.804075 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:18.803504    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:19.803793 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:19.803531    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:19.804198 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:19.803572    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:19.804198 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:19.803839    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:19.804198 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:19.803892    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:19.968728 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:19.968690    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k" event={"ID":"8724ad7b-7212-4961-97e2-2c0dbf727064","Type":"ContainerStarted","Data":"b5de566ccec23bac257a5c1207829813b410e987e81a9a9ce3437bec5aecb6fc"}
Jul 07 17:28:19.969097 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:19.968993    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:28:19.969097 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:19.969054    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:28:19.970695 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:19.970673    2561 generic.go:356] "Generic (PLEG): container finished" podID="65bfec28-49d4-436c-b19e-c3f9effdbb30" containerID="7b54cadb69e245d8453b2a9bb9eb3bfe5a9548c758b4f0918ab289fb2add5e20" exitCode=0
Jul 07 17:28:19.970793 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:19.970703    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8kwgf" event={"ID":"65bfec28-49d4-436c-b19e-c3f9effdbb30","Type":"ContainerDied","Data":"7b54cadb69e245d8453b2a9bb9eb3bfe5a9548c758b4f0918ab289fb2add5e20"}
Jul 07 17:28:19.985720 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:19.985689    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:28:19.999578 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:19.999529    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k" podStartSLOduration=8.313770397 podStartE2EDuration="28.999513389s" totalImagesPullingTime="20.685742992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:19.997935335 +0000 UTC m=+29.761395181" watchObservedRunningTime="2026-07-07 17:28:19.999513389 +0000 UTC m=+29.762973269"
Jul 07 17:28:20.807216 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:20.807186    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:20.807731 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:20.807304    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:20.973363 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:20.973335    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:28:20.989646 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:20.989619    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:28:21.803368 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:21.803326    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:21.803520 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:21.803327    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:21.803520 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:21.803492    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:21.803592 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:21.803569    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:21.977870 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:21.977836    2561 generic.go:356] "Generic (PLEG): container finished" podID="65bfec28-49d4-436c-b19e-c3f9effdbb30" containerID="7541b20b496d5f6266319ada703eee85c2f511e7a25397b9d19c3b6f7a75dda6" exitCode=0
Jul 07 17:28:21.978325 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:21.977909    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8kwgf" event={"ID":"65bfec28-49d4-436c-b19e-c3f9effdbb30","Type":"ContainerDied","Data":"7541b20b496d5f6266319ada703eee85c2f511e7a25397b9d19c3b6f7a75dda6"}
Jul 07 17:28:22.806626 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:22.806598    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:22.806791 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:22.806692    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:23.803330 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:23.803291    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:23.803691 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:23.803291    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:23.803691 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:23.803431    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:23.803691 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:23.803461    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:23.985138 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:23.985102    2561 generic.go:356] "Generic (PLEG): container finished" podID="65bfec28-49d4-436c-b19e-c3f9effdbb30" containerID="39729afb5800487e2bc9a124ed296067c7d47de68f377595d0840f468183f156" exitCode=0
Jul 07 17:28:23.985287 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:23.985169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8kwgf" event={"ID":"65bfec28-49d4-436c-b19e-c3f9effdbb30","Type":"ContainerDied","Data":"39729afb5800487e2bc9a124ed296067c7d47de68f377595d0840f468183f156"}
Jul 07 17:28:24.414392 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:24.414352    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:24.414546 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:24.414425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs\") pod \"network-metrics-daemon-r9xqr\" (UID: \"ab98c971-33fc-4c6a-a980-758f8f9f41fd\") " pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:24.414546 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:24.414508    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:28:24.414546 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:24.414514    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:28:24.414658 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:24.414578    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret podName:ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974 nodeName:}" failed. No retries permitted until 2026-07-07 17:28:56.414558656 +0000 UTC m=+66.178018481 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret") pod "global-pull-secret-syncer-k74rl" (UID: "ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:28:24.414658 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:24.414597    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs podName:ab98c971-33fc-4c6a-a980-758f8f9f41fd nodeName:}" failed. No retries permitted until 2026-07-07 17:28:56.414588099 +0000 UTC m=+66.178047930 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs") pod "network-metrics-daemon-r9xqr" (UID: "ab98c971-33fc-4c6a-a980-758f8f9f41fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:28:24.616233 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:24.616180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdh4j\" (UniqueName: \"kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j\") pod \"network-check-target-g4svv\" (UID: \"1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76\") " pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:24.616418 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:24.616283    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:28:24.616418 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:24.616311    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:28:24.616418 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:24.616326    2561 projected.go:196] Error preparing data for projected volume kube-api-access-wdh4j for pod openshift-network-diagnostics/network-check-target-g4svv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:28:24.616418 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:24.616400    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j podName:1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76 nodeName:}" failed. No retries permitted until 2026-07-07 17:28:56.616375606 +0000 UTC m=+66.379835448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdh4j" (UniqueName: "kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j") pod "network-check-target-g4svv" (UID: "1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:28:24.803926 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:24.803833    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:24.804380 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:24.804000    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:25.803902 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:25.803865    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:25.804087 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:25.803986    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:25.804087 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:25.804034    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:25.804411 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:25.804157    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:26.803494 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:26.803446    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:26.803775 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:26.803581    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:27.803288 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:27.803247    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:27.803288 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:27.803290    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:27.803724 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:27.803383    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:27.803724 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:27.803500    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:28.804380 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:28.804339    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:28.804808 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:28.804490    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:29.804248 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:29.804214    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:29.804378 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:29.804215    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:29.804378 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:29.804330    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:29.804663 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:29.804405    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:30.002112 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:30.002028    2561 generic.go:356] "Generic (PLEG): container finished" podID="65bfec28-49d4-436c-b19e-c3f9effdbb30" containerID="bd35854a22909300bd120d0ad831f1bbdd1af8622d831f6af0b5169f5d301ccd" exitCode=0
Jul 07 17:28:30.002112 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:30.002066    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8kwgf" event={"ID":"65bfec28-49d4-436c-b19e-c3f9effdbb30","Type":"ContainerDied","Data":"bd35854a22909300bd120d0ad831f1bbdd1af8622d831f6af0b5169f5d301ccd"}
Jul 07 17:28:30.804903 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:30.804707    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:30.805422 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:30.805010    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:31.007096 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:31.007063    2561 generic.go:356] "Generic (PLEG): container finished" podID="65bfec28-49d4-436c-b19e-c3f9effdbb30" containerID="f4396b21c99204f11c4d25fae6fe0dab98d837c29add2c69fb146bc9d032b49c" exitCode=0
Jul 07 17:28:31.007252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:31.007135    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8kwgf" event={"ID":"65bfec28-49d4-436c-b19e-c3f9effdbb30","Type":"ContainerDied","Data":"f4396b21c99204f11c4d25fae6fe0dab98d837c29add2c69fb146bc9d032b49c"}
Jul 07 17:28:31.803543 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:31.803503    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:31.803543 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:31.803544    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:31.803810 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:31.803623    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:31.803810 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:31.803754    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:32.012934 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:32.012896    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8kwgf" event={"ID":"65bfec28-49d4-436c-b19e-c3f9effdbb30","Type":"ContainerStarted","Data":"d580b4b9d7319cacaee98441f93bf5417a694cc0b7f4ad17bda54e8643b3e6af"}
Jul 07 17:28:32.064022 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:32.063954    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8kwgf" podStartSLOduration=11.125960534 podStartE2EDuration="41.063936136s" totalImagesPullingTime="29.937975602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:27:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:32.062661818 +0000 UTC m=+41.826121664" watchObservedRunningTime="2026-07-07 17:28:32.063936136 +0000 UTC m=+41.827395983"
Jul 07 17:28:32.803361 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:32.803326    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:32.803530 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:32.803426    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:33.803708 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:33.803673    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:33.804107 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:33.803674    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:33.804107 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:33.803788    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:33.804107 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:33.803865    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:34.804072 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:34.804038    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:34.804459 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:34.804153    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:35.803614 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:35.803576    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:35.803795 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:35.803682    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:35.803795 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:35.803738    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:35.803872 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:35.803828    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:36.804242 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:36.804203    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:36.804716 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:36.804311    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:37.537361 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:37.537325    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g4svv"]
Jul 07 17:28:37.537506 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:37.537450    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:37.537593 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:37.537572    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:37.543483 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:37.543432    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r9xqr"]
Jul 07 17:28:37.543660 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:37.543600    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:37.543813 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:37.543785    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:37.544158 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:37.544134    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k74rl"]
Jul 07 17:28:37.544239 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:37.544224    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:37.544355 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:37.544327    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:38.804126 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:38.804094    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:38.804926 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:38.804094    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:38.804926 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:38.804217    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:38.804926 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:38.804105    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:38.804926 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:38.804287    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:38.804926 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:38.804346    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:40.805801 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:40.805769    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:40.806321 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:40.805860    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:40.806321 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:40.805904    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:40.806321 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:40.805899    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k74rl" podUID="ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974"
Jul 07 17:28:40.806321 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:40.806025    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9xqr" podUID="ab98c971-33fc-4c6a-a980-758f8f9f41fd"
Jul 07 17:28:40.806321 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:40.806111    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4svv" podUID="1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76"
Jul 07 17:28:41.538564 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.538296    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeReady"
Jul 07 17:28:41.538716 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.538582    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 17:28:41.598373 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.598339    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zz49v"]
Jul 07 17:28:41.601852 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.601829    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-glnnx"]
Jul 07 17:28:41.601993 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.601943    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:41.605170 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.605151    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 17:28:41.605170 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.605160    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-78k7c\""
Jul 07 17:28:41.605426 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.605403    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 17:28:41.605746 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.605728    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.609796 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.609773    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 17:28:41.609796 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.609784    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 17:28:41.609994 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.609820    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8ztdc\""
Jul 07 17:28:41.609994 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.609854    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 17:28:41.610885 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.610867    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 17:28:41.619372 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.619345    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-glnnx"]
Jul 07 17:28:41.620028 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.620003    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zz49v"]
Jul 07 17:28:41.629466 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.629442    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bq4q5"]
Jul 07 17:28:41.631189 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.631174    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bq4q5"
Jul 07 17:28:41.633793 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.633771    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 17:28:41.634059 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.634043    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 17:28:41.634157 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.634062    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tpq4p\""
Jul 07 17:28:41.634157 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.634087    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 17:28:41.641528 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.641508    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bq4q5"]
Jul 07 17:28:41.734056 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.734010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq876\" (UniqueName: \"kubernetes.io/projected/b223289d-337d-412d-a3d5-e0501f032ff5-kube-api-access-wq876\") pod \"dns-default-zz49v\" (UID: \"b223289d-337d-412d-a3d5-e0501f032ff5\") " pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:41.734056 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.734053    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-data-volume\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.734289 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.734093    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b223289d-337d-412d-a3d5-e0501f032ff5-tmp-dir\") pod \"dns-default-zz49v\" (UID: \"b223289d-337d-412d-a3d5-e0501f032ff5\") " pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:41.734289 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.734115    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.734289 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.734136    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltbms\" (UniqueName: \"kubernetes.io/projected/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-kube-api-access-ltbms\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.734289 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.734197    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/418d60e7-bc7e-42f3-b43f-10e6b45e1bfd-cert\") pod \"ingress-canary-bq4q5\" (UID: \"418d60e7-bc7e-42f3-b43f-10e6b45e1bfd\") " pod="openshift-ingress-canary/ingress-canary-bq4q5"
Jul 07 17:28:41.734289 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.734230    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b223289d-337d-412d-a3d5-e0501f032ff5-config-volume\") pod \"dns-default-zz49v\" (UID: \"b223289d-337d-412d-a3d5-e0501f032ff5\") " pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:41.734441 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.734305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-crio-socket\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.734441 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.734331    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.734441 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.734369    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bl5h\" (UniqueName: \"kubernetes.io/projected/418d60e7-bc7e-42f3-b43f-10e6b45e1bfd-kube-api-access-2bl5h\") pod \"ingress-canary-bq4q5\" (UID: \"418d60e7-bc7e-42f3-b43f-10e6b45e1bfd\") " pod="openshift-ingress-canary/ingress-canary-bq4q5"
Jul 07 17:28:41.734441 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.734407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b223289d-337d-412d-a3d5-e0501f032ff5-metrics-tls\") pod \"dns-default-zz49v\" (UID: \"b223289d-337d-412d-a3d5-e0501f032ff5\") " pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:41.835166 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835128    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/418d60e7-bc7e-42f3-b43f-10e6b45e1bfd-cert\") pod \"ingress-canary-bq4q5\" (UID: \"418d60e7-bc7e-42f3-b43f-10e6b45e1bfd\") " pod="openshift-ingress-canary/ingress-canary-bq4q5"
Jul 07 17:28:41.835584 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b223289d-337d-412d-a3d5-e0501f032ff5-config-volume\") pod \"dns-default-zz49v\" (UID: \"b223289d-337d-412d-a3d5-e0501f032ff5\") " pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:41.835584 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835194    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-crio-socket\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.835584 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.835584 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bl5h\" (UniqueName: \"kubernetes.io/projected/418d60e7-bc7e-42f3-b43f-10e6b45e1bfd-kube-api-access-2bl5h\") pod \"ingress-canary-bq4q5\" (UID: \"418d60e7-bc7e-42f3-b43f-10e6b45e1bfd\") " pod="openshift-ingress-canary/ingress-canary-bq4q5"
Jul 07 17:28:41.835584 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b223289d-337d-412d-a3d5-e0501f032ff5-metrics-tls\") pod \"dns-default-zz49v\" (UID: \"b223289d-337d-412d-a3d5-e0501f032ff5\") " pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:41.835584 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq876\" (UniqueName: \"kubernetes.io/projected/b223289d-337d-412d-a3d5-e0501f032ff5-kube-api-access-wq876\") pod \"dns-default-zz49v\" (UID: \"b223289d-337d-412d-a3d5-e0501f032ff5\") " pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:41.835584 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-data-volume\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.835584 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835405    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b223289d-337d-412d-a3d5-e0501f032ff5-tmp-dir\") pod \"dns-default-zz49v\" (UID: \"b223289d-337d-412d-a3d5-e0501f032ff5\") " pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:41.835584 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.835584 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835431    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-crio-socket\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.835584 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltbms\" (UniqueName: \"kubernetes.io/projected/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-kube-api-access-ltbms\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.836122 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835824    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b223289d-337d-412d-a3d5-e0501f032ff5-tmp-dir\") pod \"dns-default-zz49v\" (UID: \"b223289d-337d-412d-a3d5-e0501f032ff5\") " pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:41.836122 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835851    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b223289d-337d-412d-a3d5-e0501f032ff5-config-volume\") pod \"dns-default-zz49v\" (UID: \"b223289d-337d-412d-a3d5-e0501f032ff5\") " pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:41.836122 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.835862    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-data-volume\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.836273 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.836255    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.839488 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.839468    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b223289d-337d-412d-a3d5-e0501f032ff5-metrics-tls\") pod \"dns-default-zz49v\" (UID: \"b223289d-337d-412d-a3d5-e0501f032ff5\") " pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:41.839593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.839472    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.839593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.839574    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/418d60e7-bc7e-42f3-b43f-10e6b45e1bfd-cert\") pod \"ingress-canary-bq4q5\" (UID: \"418d60e7-bc7e-42f3-b43f-10e6b45e1bfd\") " pod="openshift-ingress-canary/ingress-canary-bq4q5"
Jul 07 17:28:41.845786 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.845759    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq876\" (UniqueName: \"kubernetes.io/projected/b223289d-337d-412d-a3d5-e0501f032ff5-kube-api-access-wq876\") pod \"dns-default-zz49v\" (UID: \"b223289d-337d-412d-a3d5-e0501f032ff5\") " pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:41.846234 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.846205    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltbms\" (UniqueName: \"kubernetes.io/projected/0d62b8a0-88c4-48c4-aae5-5e732026bcf5-kube-api-access-ltbms\") pod \"insights-runtime-extractor-glnnx\" (UID: \"0d62b8a0-88c4-48c4-aae5-5e732026bcf5\") " pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.846560 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.846541    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bl5h\" (UniqueName: \"kubernetes.io/projected/418d60e7-bc7e-42f3-b43f-10e6b45e1bfd-kube-api-access-2bl5h\") pod \"ingress-canary-bq4q5\" (UID: \"418d60e7-bc7e-42f3-b43f-10e6b45e1bfd\") " pod="openshift-ingress-canary/ingress-canary-bq4q5"
Jul 07 17:28:41.913025 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.912946    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:41.917571 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.917553    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-glnnx"
Jul 07 17:28:41.940831 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:41.940794    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bq4q5"
Jul 07 17:28:42.074031 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.073994    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-glnnx"]
Jul 07 17:28:42.090995 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.090903    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zz49v"]
Jul 07 17:28:42.094018 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:28:42.093990    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb223289d_337d_412d_a3d5_e0501f032ff5.slice/crio-55e426d233ec4364b9277c220429a01082c5b4542eaa5c9d4c7f1fda609139bf WatchSource:0}: Error finding container 55e426d233ec4364b9277c220429a01082c5b4542eaa5c9d4c7f1fda609139bf: Status 404 returned error can't find the container with id 55e426d233ec4364b9277c220429a01082c5b4542eaa5c9d4c7f1fda609139bf
Jul 07 17:28:42.105856 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.105829    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bq4q5"]
Jul 07 17:28:42.110455 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:28:42.110425    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418d60e7_bc7e_42f3_b43f_10e6b45e1bfd.slice/crio-30c99aab8da3f7f360876aa1c0cc1efd6643478b431cae715ac32809b6fd2889 WatchSource:0}: Error finding container 30c99aab8da3f7f360876aa1c0cc1efd6643478b431cae715ac32809b6fd2889: Status 404 returned error can't find the container with id 30c99aab8da3f7f360876aa1c0cc1efd6643478b431cae715ac32809b6fd2889
Jul 07 17:28:42.228366 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.228331    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-644d485d99-knhcf"]
Jul 07 17:28:42.230906 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.230890    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.235114 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.235091    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xsg7v\""
Jul 07 17:28:42.235222 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.235115    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 17:28:42.235222 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.235091    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 17:28:42.236040 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.236015    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 17:28:42.236136 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.236047    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 17:28:42.236136 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.236052    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 17:28:42.236136 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.236055    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 17:28:42.237246 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.237229    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 17:28:42.244002 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.243955    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644d485d99-knhcf"]
Jul 07 17:28:42.244091 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.243961    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 17:28:42.340269 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.340228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-trusted-ca-bundle\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.340269 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.340266    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-oauth-serving-cert\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.340496 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.340363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-service-ca\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.340496 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.340392    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c65cg\" (UniqueName: \"kubernetes.io/projected/53b71d96-d63a-434b-b7ac-0387c717923c-kube-api-access-c65cg\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.340496 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.340415    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b71d96-d63a-434b-b7ac-0387c717923c-console-serving-cert\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.340496 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.340492    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b71d96-d63a-434b-b7ac-0387c717923c-console-oauth-config\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.340643 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.340535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-console-config\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.441616 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.441524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-service-ca\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.441616 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.441563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c65cg\" (UniqueName: \"kubernetes.io/projected/53b71d96-d63a-434b-b7ac-0387c717923c-kube-api-access-c65cg\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.441616 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.441582    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b71d96-d63a-434b-b7ac-0387c717923c-console-serving-cert\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.441838 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.441770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b71d96-d63a-434b-b7ac-0387c717923c-console-oauth-config\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.441838 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.441832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-console-config\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.441933 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.441873    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-trusted-ca-bundle\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.442013 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.441988    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-oauth-serving-cert\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.442443 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.442400    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-service-ca\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.442663 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.442641    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-oauth-serving-cert\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.442741 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.442671    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-console-config\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.442741 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.442714    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-trusted-ca-bundle\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.444195 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.444170    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b71d96-d63a-434b-b7ac-0387c717923c-console-serving-cert\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.444272 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.444212    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b71d96-d63a-434b-b7ac-0387c717923c-console-oauth-config\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.452482 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.452464    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c65cg\" (UniqueName: \"kubernetes.io/projected/53b71d96-d63a-434b-b7ac-0387c717923c-kube-api-access-c65cg\") pod \"console-644d485d99-knhcf\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") " pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.541522 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.541470    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:42.756388 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.756313    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644d485d99-knhcf"]
Jul 07 17:28:42.763720 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:28:42.763689    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b71d96_d63a_434b_b7ac_0387c717923c.slice/crio-8b2643c2228ef01e170d9da7977a263d63aa05c6e64ea3de7f0ce7ca304a200c WatchSource:0}: Error finding container 8b2643c2228ef01e170d9da7977a263d63aa05c6e64ea3de7f0ce7ca304a200c: Status 404 returned error can't find the container with id 8b2643c2228ef01e170d9da7977a263d63aa05c6e64ea3de7f0ce7ca304a200c
Jul 07 17:28:42.805938 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.805902    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:42.806678 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.806278    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:42.806678 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.806596    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:42.810857 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.810088    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 17:28:42.810857 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.810230    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 17:28:42.810857 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.810363    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 17:28:42.810857 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.810489    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 17:28:42.813711 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.811256    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v8q6k\""
Jul 07 17:28:42.813711 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:42.811519    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hxlp2\""
Jul 07 17:28:43.043886 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:43.043800    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zz49v" event={"ID":"b223289d-337d-412d-a3d5-e0501f032ff5","Type":"ContainerStarted","Data":"55e426d233ec4364b9277c220429a01082c5b4542eaa5c9d4c7f1fda609139bf"}
Jul 07 17:28:43.046102 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:43.046074    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644d485d99-knhcf" event={"ID":"53b71d96-d63a-434b-b7ac-0387c717923c","Type":"ContainerStarted","Data":"8b2643c2228ef01e170d9da7977a263d63aa05c6e64ea3de7f0ce7ca304a200c"}
Jul 07 17:28:43.049330 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:43.049239    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bq4q5" event={"ID":"418d60e7-bc7e-42f3-b43f-10e6b45e1bfd","Type":"ContainerStarted","Data":"30c99aab8da3f7f360876aa1c0cc1efd6643478b431cae715ac32809b6fd2889"}
Jul 07 17:28:43.051446 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:43.051375    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-glnnx" event={"ID":"0d62b8a0-88c4-48c4-aae5-5e732026bcf5","Type":"ContainerStarted","Data":"cfaf98f3dc73082d3595330a424a285dd5e925e52427a43595cba36ec19914c1"}
Jul 07 17:28:49.070944 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:49.070902    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zz49v" event={"ID":"b223289d-337d-412d-a3d5-e0501f032ff5","Type":"ContainerStarted","Data":"1ab25f60d8c4ef30aeb1115c9b0f1cb16a1941ae7c1658cfa571b8f51acf8a87"}
Jul 07 17:28:49.071434 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:49.070981    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zz49v" event={"ID":"b223289d-337d-412d-a3d5-e0501f032ff5","Type":"ContainerStarted","Data":"3870a4fd8a19cf9ee127feb6f029e731c83e274a85a504c29558f63caeb87152"}
Jul 07 17:28:49.071434 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:49.071134    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:49.072494 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:49.072473    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644d485d99-knhcf" event={"ID":"53b71d96-d63a-434b-b7ac-0387c717923c","Type":"ContainerStarted","Data":"b585eaba812d0a43bc1d9f348e080d17a0f3d5a3b563f1cf79f5eaedc1b4d401"}
Jul 07 17:28:49.074247 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:49.074216    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bq4q5" event={"ID":"418d60e7-bc7e-42f3-b43f-10e6b45e1bfd","Type":"ContainerStarted","Data":"32df83d0119b91a2b06db5343dd9eb1306b3bdc488bffd3cf1ba4928732f297b"}
Jul 07 17:28:49.076114 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:49.076089    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-glnnx" event={"ID":"0d62b8a0-88c4-48c4-aae5-5e732026bcf5","Type":"ContainerStarted","Data":"3a5cb0e23bda64c8a2e60a614419cac80996c0751b0964013c24d717cdf40deb"}
Jul 07 17:28:49.092922 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:49.092858    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zz49v" podStartSLOduration=1.964857427 podStartE2EDuration="8.092842007s" totalImagesPullingTime="6.12798458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:49.091450067 +0000 UTC m=+58.854909929" watchObservedRunningTime="2026-07-07 17:28:49.092842007 +0000 UTC m=+58.856301852"
Jul 07 17:28:49.110830 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:49.110782    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bq4q5" podStartSLOduration=1.6672082019999999 podStartE2EDuration="8.110766202s" totalImagesPullingTime="6.443558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:49.109844062 +0000 UTC m=+58.873303910" watchObservedRunningTime="2026-07-07 17:28:49.110766202 +0000 UTC m=+58.874226025"
Jul 07 17:28:49.130358 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:49.130299    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-644d485d99-knhcf" podStartSLOduration=1.3407566 podStartE2EDuration="7.130274308s" totalImagesPullingTime="5.789517708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:28:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:49.128961966 +0000 UTC m=+58.892421807" watchObservedRunningTime="2026-07-07 17:28:49.130274308 +0000 UTC m=+58.893734156"
Jul 07 17:28:50.082986 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:50.082451    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-glnnx" event={"ID":"0d62b8a0-88c4-48c4-aae5-5e732026bcf5","Type":"ContainerStarted","Data":"acabe9d196faed06fc4d0a405a067f83006cf33ccb39ca685d931193a8026c53"}
Jul 07 17:28:51.296601 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.296564    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"]
Jul 07 17:28:51.307211 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.307176    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"
Jul 07 17:28:51.310671 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.310647    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 17:28:51.311894 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.311563    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 07 17:28:51.311894 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.311666    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xpjxz\""
Jul 07 17:28:51.311894 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.311813    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 07 17:28:51.312160 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.311899    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 17:28:51.312160 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.311565    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 17:28:51.312283 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.312259    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"]
Jul 07 17:28:51.317058 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.317021    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.320409 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.320159    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 07 17:28:51.320533 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.320463    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-c2g8m\""
Jul 07 17:28:51.320674 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.320657    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 07 17:28:51.320956 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.320937    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 07 17:28:51.321073 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.320959    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"]
Jul 07 17:28:51.329734 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.329705    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"]
Jul 07 17:28:51.334455 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.334422    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-98xg9"]
Jul 07 17:28:51.338891 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.338661    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.342655 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.342166    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 17:28:51.342655 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.342460    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 17:28:51.344057 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.342961    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qgfqj\""
Jul 07 17:28:51.344057 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.343252    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 17:28:51.427484 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.427696 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427497    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-tls\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.427696 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427529    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.427696 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz7m7\" (UniqueName: \"kubernetes.io/projected/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-api-access-hz7m7\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.427696 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427577    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.427696 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.427696 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96e7fc26-0780-4e64-99fd-8de373c0cc54-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-d6j9w\" (UID: \"96e7fc26-0780-4e64-99fd-8de373c0cc54\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"
Jul 07 17:28:51.428080 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427702    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.428080 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.428080 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427766    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-wtmp\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.428080 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427849    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/769c5fa4-5419-4ada-940a-fefcbd820e9a-metrics-client-ca\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.428080 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427874    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e7fc26-0780-4e64-99fd-8de373c0cc54-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-d6j9w\" (UID: \"96e7fc26-0780-4e64-99fd-8de373c0cc54\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"
Jul 07 17:28:51.428080 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427907    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/769c5fa4-5419-4ada-940a-fefcbd820e9a-root\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.428080 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427929    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/769c5fa4-5419-4ada-940a-fefcbd820e9a-sys\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.428080 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.427989    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-textfile\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.428080 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.428039    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtljg\" (UniqueName: \"kubernetes.io/projected/769c5fa4-5419-4ada-940a-fefcbd820e9a-kube-api-access-qtljg\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.428531 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.428091    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.428531 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.428121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e7fc26-0780-4e64-99fd-8de373c0cc54-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-d6j9w\" (UID: \"96e7fc26-0780-4e64-99fd-8de373c0cc54\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"
Jul 07 17:28:51.428531 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.428138    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhffc\" (UniqueName: \"kubernetes.io/projected/96e7fc26-0780-4e64-99fd-8de373c0cc54-kube-api-access-xhffc\") pod \"openshift-state-metrics-54cf96dfcf-d6j9w\" (UID: \"96e7fc26-0780-4e64-99fd-8de373c0cc54\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"
Jul 07 17:28:51.529023 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.528991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/769c5fa4-5419-4ada-940a-fefcbd820e9a-metrics-client-ca\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.529195 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529041    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e7fc26-0780-4e64-99fd-8de373c0cc54-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-d6j9w\" (UID: \"96e7fc26-0780-4e64-99fd-8de373c0cc54\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"
Jul 07 17:28:51.529195 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/769c5fa4-5419-4ada-940a-fefcbd820e9a-root\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.529195 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/769c5fa4-5419-4ada-940a-fefcbd820e9a-sys\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.529195 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529190    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-textfile\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.529366 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529216    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtljg\" (UniqueName: \"kubernetes.io/projected/769c5fa4-5419-4ada-940a-fefcbd820e9a-kube-api-access-qtljg\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.529366 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529280    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.529366 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529317    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e7fc26-0780-4e64-99fd-8de373c0cc54-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-d6j9w\" (UID: \"96e7fc26-0780-4e64-99fd-8de373c0cc54\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"
Jul 07 17:28:51.529366 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529342    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhffc\" (UniqueName: \"kubernetes.io/projected/96e7fc26-0780-4e64-99fd-8de373c0cc54-kube-api-access-xhffc\") pod \"openshift-state-metrics-54cf96dfcf-d6j9w\" (UID: \"96e7fc26-0780-4e64-99fd-8de373c0cc54\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"
Jul 07 17:28:51.529516 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529371    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.529516 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-tls\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.529516 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529442    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.529516 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529468    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz7m7\" (UniqueName: \"kubernetes.io/projected/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-api-access-hz7m7\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.529516 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529494    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.529712 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529519    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.529712 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529566    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96e7fc26-0780-4e64-99fd-8de373c0cc54-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-d6j9w\" (UID: \"96e7fc26-0780-4e64-99fd-8de373c0cc54\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"
Jul 07 17:28:51.529712 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529595    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.529712 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.529712 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-wtmp\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.529712 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529670    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e7fc26-0780-4e64-99fd-8de373c0cc54-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-d6j9w\" (UID: \"96e7fc26-0780-4e64-99fd-8de373c0cc54\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"
Jul 07 17:28:51.529924 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529809    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-wtmp\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.529924 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529856    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/769c5fa4-5419-4ada-940a-fefcbd820e9a-root\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.529924 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.529890    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/769c5fa4-5419-4ada-940a-fefcbd820e9a-sys\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.530098 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.530073    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/769c5fa4-5419-4ada-940a-fefcbd820e9a-metrics-client-ca\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.530240 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.530161    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-textfile\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.530240 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:51.530176    2561 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 07 17:28:51.530240 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:51.530239    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-state-metrics-tls podName:c435f6a7-0da0-466d-a5aa-cf305d2ecc6d nodeName:}" failed. No retries permitted until 2026-07-07 17:28:52.030223157 +0000 UTC m=+61.793682996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-mjs29" (UID: "c435f6a7-0da0-466d-a5aa-cf305d2ecc6d") : secret "kube-state-metrics-tls" not found
Jul 07 17:28:51.530449 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.530428    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.530540 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:51.530177    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 17:28:51.531009 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.530982    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.531407 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.531363    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.531498 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.531450    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.531684 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:51.531621    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-tls podName:769c5fa4-5419-4ada-940a-fefcbd820e9a nodeName:}" failed. No retries permitted until 2026-07-07 17:28:52.031598554 +0000 UTC m=+61.795058398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-tls") pod "node-exporter-98xg9" (UID: "769c5fa4-5419-4ada-940a-fefcbd820e9a") : secret "node-exporter-tls" not found
Jul 07 17:28:51.533147 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.533125    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e7fc26-0780-4e64-99fd-8de373c0cc54-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-d6j9w\" (UID: \"96e7fc26-0780-4e64-99fd-8de373c0cc54\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"
Jul 07 17:28:51.534297 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.533168    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.534297 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.533722    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.534297 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.533785    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96e7fc26-0780-4e64-99fd-8de373c0cc54-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-d6j9w\" (UID: \"96e7fc26-0780-4e64-99fd-8de373c0cc54\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"
Jul 07 17:28:51.540678 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.540652    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz7m7\" (UniqueName: \"kubernetes.io/projected/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-api-access-hz7m7\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:51.543014 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.542990    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtljg\" (UniqueName: \"kubernetes.io/projected/769c5fa4-5419-4ada-940a-fefcbd820e9a-kube-api-access-qtljg\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:51.545408 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.545389    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhffc\" (UniqueName: \"kubernetes.io/projected/96e7fc26-0780-4e64-99fd-8de373c0cc54-kube-api-access-xhffc\") pod \"openshift-state-metrics-54cf96dfcf-d6j9w\" (UID: \"96e7fc26-0780-4e64-99fd-8de373c0cc54\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"
Jul 07 17:28:51.620041 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.620002    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"
Jul 07 17:28:51.992858 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:51.992696    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w"]
Jul 07 17:28:51.995315 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:28:51.995288    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e7fc26_0780_4e64_99fd_8de373c0cc54.slice/crio-d57612d3a2168fb050a71e2b20e584d47a7d4e8120ea242f2acf8eb1791fb168 WatchSource:0}: Error finding container d57612d3a2168fb050a71e2b20e584d47a7d4e8120ea242f2acf8eb1791fb168: Status 404 returned error can't find the container with id d57612d3a2168fb050a71e2b20e584d47a7d4e8120ea242f2acf8eb1791fb168
Jul 07 17:28:52.033508 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.033486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-tls\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:52.033630 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.033518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:52.033671 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:52.033647    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 17:28:52.033727 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:52.033717    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-tls podName:769c5fa4-5419-4ada-940a-fefcbd820e9a nodeName:}" failed. No retries permitted until 2026-07-07 17:28:53.033695564 +0000 UTC m=+62.797155391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-tls") pod "node-exporter-98xg9" (UID: "769c5fa4-5419-4ada-940a-fefcbd820e9a") : secret "node-exporter-tls" not found
Jul 07 17:28:52.035858 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.035836    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c435f6a7-0da0-466d-a5aa-cf305d2ecc6d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mjs29\" (UID: \"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:52.090665 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.090634    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w" event={"ID":"96e7fc26-0780-4e64-99fd-8de373c0cc54","Type":"ContainerStarted","Data":"faf3102fb049a3d5a073f7f47753f15c47a6ecb8d9a009b5bc5a82f300b9acfe"}
Jul 07 17:28:52.090767 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.090702    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w" event={"ID":"96e7fc26-0780-4e64-99fd-8de373c0cc54","Type":"ContainerStarted","Data":"d57612d3a2168fb050a71e2b20e584d47a7d4e8120ea242f2acf8eb1791fb168"}
Jul 07 17:28:52.232105 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.232022    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"
Jul 07 17:28:52.400527 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.400494    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29"]
Jul 07 17:28:52.404674 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:28:52.404639    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc435f6a7_0da0_466d_a5aa_cf305d2ecc6d.slice/crio-af1967fd697f82a88a7de6d0b5a65b3a4a695be594606a299d5c14fb9010f34e WatchSource:0}: Error finding container af1967fd697f82a88a7de6d0b5a65b3a4a695be594606a299d5c14fb9010f34e: Status 404 returned error can't find the container with id af1967fd697f82a88a7de6d0b5a65b3a4a695be594606a299d5c14fb9010f34e
Jul 07 17:28:52.413529 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.413507    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:28:52.433341 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.433312    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.436198 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.436172    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 07 17:28:52.436198 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.436181    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 07 17:28:52.436508 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.436491    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 07 17:28:52.436757 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.436741    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 07 17:28:52.436978 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.436942    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 07 17:28:52.437096 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.436983    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 07 17:28:52.437096 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.436983    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 07 17:28:52.437214 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.437106    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-z7wdt\""
Jul 07 17:28:52.437276 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.437222    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 07 17:28:52.437276 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.437259    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 07 17:28:52.447010 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.446988    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:28:52.537182 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.537074    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.537182 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.537125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfwp2\" (UniqueName: \"kubernetes.io/projected/62fd10ae-747a-49ed-b721-7ca5ac394f67-kube-api-access-tfwp2\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.537405 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.537209    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62fd10ae-747a-49ed-b721-7ca5ac394f67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.537405 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.537272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-config-volume\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.537405 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.537291    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62fd10ae-747a-49ed-b721-7ca5ac394f67-config-out\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.537405 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.537336    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-web-config\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.537405 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.537379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62fd10ae-747a-49ed-b721-7ca5ac394f67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.537405 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.537398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62fd10ae-747a-49ed-b721-7ca5ac394f67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.537706 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.537415    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.537706 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.537485    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.537706 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.537513    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62fd10ae-747a-49ed-b721-7ca5ac394f67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.537706 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.537539    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.537706 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.537607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.542012 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.541962    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:52.542176 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.542085    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:28:52.543542 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.543498    2561 patch_prober.go:28] interesting pod/console-644d485d99-knhcf container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body=
Jul 07 17:28:52.543665 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.543560    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-644d485d99-knhcf" podUID="53b71d96-d63a-434b-b7ac-0387c717923c" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused"
Jul 07 17:28:52.638926 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.638884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62fd10ae-747a-49ed-b721-7ca5ac394f67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.639149 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.638998    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-config-volume\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.639149 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.639027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62fd10ae-747a-49ed-b721-7ca5ac394f67-config-out\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.639149 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.639052    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-web-config\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.639149 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.639123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62fd10ae-747a-49ed-b721-7ca5ac394f67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.639373 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.639151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62fd10ae-747a-49ed-b721-7ca5ac394f67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.639373 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.639195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.639373 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.639237    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.639373 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.639267    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62fd10ae-747a-49ed-b721-7ca5ac394f67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.639373 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.639308    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.639373 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.639357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.639673 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.639412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.639673 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.639439    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfwp2\" (UniqueName: \"kubernetes.io/projected/62fd10ae-747a-49ed-b721-7ca5ac394f67-kube-api-access-tfwp2\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.639673 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:52.639548    2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 07 17:28:52.639673 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.639567    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62fd10ae-747a-49ed-b721-7ca5ac394f67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.639673 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:28:52.639609    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-main-tls podName:62fd10ae-747a-49ed-b721-7ca5ac394f67 nodeName:}" failed. No retries permitted until 2026-07-07 17:28:53.139590213 +0000 UTC m=+62.903050052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "62fd10ae-747a-49ed-b721-7ca5ac394f67") : secret "alertmanager-main-tls" not found
Jul 07 17:28:52.640366 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.640338    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62fd10ae-747a-49ed-b721-7ca5ac394f67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.640751 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.640683    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62fd10ae-747a-49ed-b721-7ca5ac394f67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.642548 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.642516    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.642835 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.642812    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.642928 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.642883    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62fd10ae-747a-49ed-b721-7ca5ac394f67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.642928 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.642901    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.643243 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.643226    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-web-config\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.643370 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.643350    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.643551 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.643536    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62fd10ae-747a-49ed-b721-7ca5ac394f67-config-out\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.643602 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.643540    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-config-volume\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.648548 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.648529    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfwp2\" (UniqueName: \"kubernetes.io/projected/62fd10ae-747a-49ed-b721-7ca5ac394f67-kube-api-access-tfwp2\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:52.996439 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:52.996409    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bpk9k"
Jul 07 17:28:53.043408 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.043367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-tls\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:53.045799 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.045772    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/769c5fa4-5419-4ada-940a-fefcbd820e9a-node-exporter-tls\") pod \"node-exporter-98xg9\" (UID: \"769c5fa4-5419-4ada-940a-fefcbd820e9a\") " pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:53.096247 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.096209    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w" event={"ID":"96e7fc26-0780-4e64-99fd-8de373c0cc54","Type":"ContainerStarted","Data":"b3e03ea4a702e23faf10de7ab950e308f5204356d6246491191057a3829858fb"}
Jul 07 17:28:53.097931 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.097899    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29" event={"ID":"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d","Type":"ContainerStarted","Data":"af1967fd697f82a88a7de6d0b5a65b3a4a695be594606a299d5c14fb9010f34e"}
Jul 07 17:28:53.100420 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.100288    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-glnnx" event={"ID":"0d62b8a0-88c4-48c4-aae5-5e732026bcf5","Type":"ContainerStarted","Data":"f575e8bb1ecc46c7cf93e2031be6becf54e47d068d617625cc50f1811964e44d"}
Jul 07 17:28:53.122030 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.121961    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-glnnx" podStartSLOduration=2.091557903 podStartE2EDuration="12.121943883s" totalImagesPullingTime="10.03038598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:28:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:53.121260181 +0000 UTC m=+62.884720009" watchObservedRunningTime="2026-07-07 17:28:53.121943883 +0000 UTC m=+62.885403743"
Jul 07 17:28:53.144816 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.144772    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:53.147663 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.147632    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62fd10ae-747a-49ed-b721-7ca5ac394f67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62fd10ae-747a-49ed-b721-7ca5ac394f67\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:53.151478 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.151454    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-98xg9"
Jul 07 17:28:53.162429 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:28:53.162402    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod769c5fa4_5419_4ada_940a_fefcbd820e9a.slice/crio-a719294b341a5c21871af82dd716e6af2c8155cd440c5b44987a1956fa96e255 WatchSource:0}: Error finding container a719294b341a5c21871af82dd716e6af2c8155cd440c5b44987a1956fa96e255: Status 404 returned error can't find the container with id a719294b341a5c21871af82dd716e6af2c8155cd440c5b44987a1956fa96e255
Jul 07 17:28:53.289593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.289509    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5696546d8-xmm56"]
Jul 07 17:28:53.292779 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.292745    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.295268 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.295244    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 07 17:28:53.295556 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.295530    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 07 17:28:53.298280 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.296651    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1btdeiqlgah5t\""
Jul 07 17:28:53.298280 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.296813    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 07 17:28:53.298280 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.296911    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-b2qtl\""
Jul 07 17:28:53.298280 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.297078    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 07 17:28:53.298280 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.297140    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 07 17:28:53.307295 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.307267    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5696546d8-xmm56"]
Jul 07 17:28:53.343488 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.343460    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:28:53.347165 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.347132    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.347324 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.347186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.347324 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.347212    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.347324 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.347239    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-grpc-tls\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.347324 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.347277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-tls\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.347488 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.347355    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gnrh\" (UniqueName: \"kubernetes.io/projected/15f8427a-aa69-4563-834b-3edef30d1deb-kube-api-access-9gnrh\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.347488 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.347383    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.347488 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.347432    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15f8427a-aa69-4563-834b-3edef30d1deb-metrics-client-ca\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.448516 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.448484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gnrh\" (UniqueName: \"kubernetes.io/projected/15f8427a-aa69-4563-834b-3edef30d1deb-kube-api-access-9gnrh\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.448940 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.448528    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.448940 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.448578    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15f8427a-aa69-4563-834b-3edef30d1deb-metrics-client-ca\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.448940 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.448640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.448940 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.448670    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.448940 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.448697    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.448940 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.448721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-grpc-tls\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.448940 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.448760    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-tls\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.449900 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.449836    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15f8427a-aa69-4563-834b-3edef30d1deb-metrics-client-ca\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.453351 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.453315    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.453478 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.453390    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.453823 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.453801    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-tls\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.454492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.454462    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.454604 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.454529    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.455304 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.455281    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15f8427a-aa69-4563-834b-3edef30d1deb-secret-grpc-tls\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.462995 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.462942    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gnrh\" (UniqueName: \"kubernetes.io/projected/15f8427a-aa69-4563-834b-3edef30d1deb-kube-api-access-9gnrh\") pod \"thanos-querier-5696546d8-xmm56\" (UID: \"15f8427a-aa69-4563-834b-3edef30d1deb\") " pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.508836 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.508803    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:28:53.605081 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:53.605042    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:28:53.729894 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:28:53.729855    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62fd10ae_747a_49ed_b721_7ca5ac394f67.slice/crio-2482ac518f868ca3fc450f02f3c5ea3130cdd34ee1eceb655114d1db35f19ff0 WatchSource:0}: Error finding container 2482ac518f868ca3fc450f02f3c5ea3130cdd34ee1eceb655114d1db35f19ff0: Status 404 returned error can't find the container with id 2482ac518f868ca3fc450f02f3c5ea3130cdd34ee1eceb655114d1db35f19ff0
Jul 07 17:28:54.107255 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:54.107100    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62fd10ae-747a-49ed-b721-7ca5ac394f67","Type":"ContainerStarted","Data":"2482ac518f868ca3fc450f02f3c5ea3130cdd34ee1eceb655114d1db35f19ff0"}
Jul 07 17:28:54.110763 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:54.109865    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-98xg9" event={"ID":"769c5fa4-5419-4ada-940a-fefcbd820e9a","Type":"ContainerStarted","Data":"a719294b341a5c21871af82dd716e6af2c8155cd440c5b44987a1956fa96e255"}
Jul 07 17:28:54.222309 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:54.222203    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5696546d8-xmm56"]
Jul 07 17:28:54.232277 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:28:54.227598    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f8427a_aa69_4563_834b_3edef30d1deb.slice/crio-8ea87973773c2ca1bd4845c763c8631189362b818546d4fab4dd8ad42f540e2c WatchSource:0}: Error finding container 8ea87973773c2ca1bd4845c763c8631189362b818546d4fab4dd8ad42f540e2c: Status 404 returned error can't find the container with id 8ea87973773c2ca1bd4845c763c8631189362b818546d4fab4dd8ad42f540e2c
Jul 07 17:28:55.115717 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.115673    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5696546d8-xmm56" event={"ID":"15f8427a-aa69-4563-834b-3edef30d1deb","Type":"ContainerStarted","Data":"8ea87973773c2ca1bd4845c763c8631189362b818546d4fab4dd8ad42f540e2c"}
Jul 07 17:28:55.118921 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.118889    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w" event={"ID":"96e7fc26-0780-4e64-99fd-8de373c0cc54","Type":"ContainerStarted","Data":"f0bb809c7400fc7fde6738346ebc68ac3d6893fabda05f5584617eb35cbcb5c0"}
Jul 07 17:28:55.122450 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.121761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29" event={"ID":"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d","Type":"ContainerStarted","Data":"844caccfb303a59237447cfe05c65d01546a72179548101d817239655e77f0c7"}
Jul 07 17:28:55.122450 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.121829    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29" event={"ID":"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d","Type":"ContainerStarted","Data":"91a9dfee32aac00eac0ac5f523b8b9b996756b0255a2858cb8438b2af14e7ca9"}
Jul 07 17:28:55.122450 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.121860    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29" event={"ID":"c435f6a7-0da0-466d-a5aa-cf305d2ecc6d","Type":"ContainerStarted","Data":"fd9bd255c81000f9ba5d9250309ce2e1e0ea40e012c1122505240cc86e314e17"}
Jul 07 17:28:55.125451 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.125415    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-98xg9" event={"ID":"769c5fa4-5419-4ada-940a-fefcbd820e9a","Type":"ContainerStarted","Data":"43b7deb5312ffc0a017f18b827695cf0109579487ab693f4d83512466a63cf8e"}
Jul 07 17:28:55.141067 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.140999    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-d6j9w" podStartSLOduration=2.484709964 podStartE2EDuration="4.140957846s" totalImagesPullingTime="1.656247882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:55.139323907 +0000 UTC m=+64.902783756" watchObservedRunningTime="2026-07-07 17:28:55.140957846 +0000 UTC m=+64.904417757"
Jul 07 17:28:55.183736 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.183672    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mjs29" podStartSLOduration=2.523088744 podStartE2EDuration="4.183650333s" totalImagesPullingTime="1.660561589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:55.181703496 +0000 UTC m=+64.945163344" watchObservedRunningTime="2026-07-07 17:28:55.183650333 +0000 UTC m=+64.947110181"
Jul 07 17:28:55.796518 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.796480    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7bd65d9874-bc6nm"]
Jul 07 17:28:55.799569 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.799550    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.804207 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.804182    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 17:28:55.804207 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.804188    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 07 17:28:55.804364 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.804220    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 07 17:28:55.804364 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.804302    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-t7jsx\""
Jul 07 17:28:55.804364 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.804344    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1ecmksdhmsnqi\""
Jul 07 17:28:55.804540 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.804450    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 07 17:28:55.813153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.813130    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bd65d9874-bc6nm"]
Jul 07 17:28:55.872458 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.872412    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9b1e62b0-ad5f-4a89-920c-314cad74b1af-secret-metrics-server-tls\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.872458 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.872460    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdjl7\" (UniqueName: \"kubernetes.io/projected/9b1e62b0-ad5f-4a89-920c-314cad74b1af-kube-api-access-hdjl7\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.872669 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.872490    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9b1e62b0-ad5f-4a89-920c-314cad74b1af-audit-log\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.872669 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.872570    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9b1e62b0-ad5f-4a89-920c-314cad74b1af-secret-metrics-server-client-certs\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.872669 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.872604    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b1e62b0-ad5f-4a89-920c-314cad74b1af-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.872669 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.872647    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9b1e62b0-ad5f-4a89-920c-314cad74b1af-metrics-server-audit-profiles\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.872785 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.872679    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b1e62b0-ad5f-4a89-920c-314cad74b1af-client-ca-bundle\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.973900 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.973811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9b1e62b0-ad5f-4a89-920c-314cad74b1af-audit-log\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.973900 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.973882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9b1e62b0-ad5f-4a89-920c-314cad74b1af-secret-metrics-server-client-certs\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.974148 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.973916    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b1e62b0-ad5f-4a89-920c-314cad74b1af-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.974148 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.973989    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9b1e62b0-ad5f-4a89-920c-314cad74b1af-metrics-server-audit-profiles\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.974148 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.974039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b1e62b0-ad5f-4a89-920c-314cad74b1af-client-ca-bundle\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.974148 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.974066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9b1e62b0-ad5f-4a89-920c-314cad74b1af-secret-metrics-server-tls\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.974148 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.974106    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdjl7\" (UniqueName: \"kubernetes.io/projected/9b1e62b0-ad5f-4a89-920c-314cad74b1af-kube-api-access-hdjl7\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.974463 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.974434    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9b1e62b0-ad5f-4a89-920c-314cad74b1af-audit-log\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.974675 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.974650    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b1e62b0-ad5f-4a89-920c-314cad74b1af-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.975610 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.975580    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9b1e62b0-ad5f-4a89-920c-314cad74b1af-metrics-server-audit-profiles\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.977834 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.977809    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9b1e62b0-ad5f-4a89-920c-314cad74b1af-secret-metrics-server-tls\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.977954 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.977885    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9b1e62b0-ad5f-4a89-920c-314cad74b1af-secret-metrics-server-client-certs\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.977954 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.977940    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b1e62b0-ad5f-4a89-920c-314cad74b1af-client-ca-bundle\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:55.985166 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:55.985138    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdjl7\" (UniqueName: \"kubernetes.io/projected/9b1e62b0-ad5f-4a89-920c-314cad74b1af-kube-api-access-hdjl7\") pod \"metrics-server-7bd65d9874-bc6nm\" (UID: \"9b1e62b0-ad5f-4a89-920c-314cad74b1af\") " pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:56.108027 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.107992    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:28:56.132052 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.132012    2561 generic.go:356] "Generic (PLEG): container finished" podID="769c5fa4-5419-4ada-940a-fefcbd820e9a" containerID="43b7deb5312ffc0a017f18b827695cf0109579487ab693f4d83512466a63cf8e" exitCode=0
Jul 07 17:28:56.132452 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.132158    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-98xg9" event={"ID":"769c5fa4-5419-4ada-940a-fefcbd820e9a","Type":"ContainerDied","Data":"43b7deb5312ffc0a017f18b827695cf0109579487ab693f4d83512466a63cf8e"}
Jul 07 17:28:56.133846 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.133820    2561 generic.go:356] "Generic (PLEG): container finished" podID="62fd10ae-747a-49ed-b721-7ca5ac394f67" containerID="b0deebd4ee46ba659f753430046ff468913d4560d40ee31f9389300b46a91731" exitCode=0
Jul 07 17:28:56.134006 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.133900    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62fd10ae-747a-49ed-b721-7ca5ac394f67","Type":"ContainerDied","Data":"b0deebd4ee46ba659f753430046ff468913d4560d40ee31f9389300b46a91731"}
Jul 07 17:28:56.157560 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.156360    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-857c4bf4d9-hmgnw"]
Jul 07 17:28:56.161303 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.161281    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.175627 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.175557    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-857c4bf4d9-hmgnw"]
Jul 07 17:28:56.265581 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.265511    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bd65d9874-bc6nm"]
Jul 07 17:28:56.268813 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:28:56.268787    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b1e62b0_ad5f_4a89_920c_314cad74b1af.slice/crio-4eb74aae21fc42192d674fe022b111a0b543207632be62d6fd452c426106c7cc WatchSource:0}: Error finding container 4eb74aae21fc42192d674fe022b111a0b543207632be62d6fd452c426106c7cc: Status 404 returned error can't find the container with id 4eb74aae21fc42192d674fe022b111a0b543207632be62d6fd452c426106c7cc
Jul 07 17:28:56.278177 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.278154    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-serving-cert\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.278294 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.278277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-service-ca\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.278338 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.278306    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-trusted-ca-bundle\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.278368 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.278358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-oauth-serving-cert\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.278402 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.278376    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-oauth-config\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.278434 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.278407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-config\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.278434 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.278425    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxx7q\" (UniqueName: \"kubernetes.io/projected/ad4cc7fb-061f-4702-94e7-35430c5e954c-kube-api-access-bxx7q\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.379774 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.379612    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-serving-cert\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.379774 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.379708    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-service-ca\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.379774 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.379730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-trusted-ca-bundle\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.379774 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.379778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-oauth-serving-cert\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.380217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.380014    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-oauth-config\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.380217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.380079    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-config\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.380217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.380110    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxx7q\" (UniqueName: \"kubernetes.io/projected/ad4cc7fb-061f-4702-94e7-35430c5e954c-kube-api-access-bxx7q\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.380614 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.380567    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-oauth-serving-cert\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.380779 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.380756    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-service-ca\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.381015 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.380990    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-trusted-ca-bundle\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.381733 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.381712    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-config\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.382642 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.382616    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-oauth-config\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.382735 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.382700    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-serving-cert\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.391087 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.391063    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxx7q\" (UniqueName: \"kubernetes.io/projected/ad4cc7fb-061f-4702-94e7-35430c5e954c-kube-api-access-bxx7q\") pod \"console-857c4bf4d9-hmgnw\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") " pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.481394 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.481303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:56.481538 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.481401    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs\") pod \"network-metrics-daemon-r9xqr\" (UID: \"ab98c971-33fc-4c6a-a980-758f8f9f41fd\") " pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:56.487796 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.487771    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 17:28:56.488961 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.488949    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 17:28:56.494411 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.494390    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab98c971-33fc-4c6a-a980-758f8f9f41fd-metrics-certs\") pod \"network-metrics-daemon-r9xqr\" (UID: \"ab98c971-33fc-4c6a-a980-758f8f9f41fd\") " pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:56.494411 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.494407    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974-original-pull-secret\") pod \"global-pull-secret-syncer-k74rl\" (UID: \"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974\") " pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:56.495375 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.495350    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:28:56.620847 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.620815    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k74rl"
Jul 07 17:28:56.640849 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.640718    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-857c4bf4d9-hmgnw"]
Jul 07 17:28:56.643929 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:28:56.643893    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4cc7fb_061f_4702_94e7_35430c5e954c.slice/crio-d324febc1625143d229f414d1ec98d869d171794ad473400c7a7575a2ad35339 WatchSource:0}: Error finding container d324febc1625143d229f414d1ec98d869d171794ad473400c7a7575a2ad35339: Status 404 returned error can't find the container with id d324febc1625143d229f414d1ec98d869d171794ad473400c7a7575a2ad35339
Jul 07 17:28:56.666338 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.666114    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v8q6k\""
Jul 07 17:28:56.673829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.673797    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9xqr"
Jul 07 17:28:56.683087 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.683062    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdh4j\" (UniqueName: \"kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j\") pod \"network-check-target-g4svv\" (UID: \"1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76\") " pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:56.686815 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.686522    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 17:28:56.696804 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.696286    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 17:28:56.706548 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.706519    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdh4j\" (UniqueName: \"kubernetes.io/projected/1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76-kube-api-access-wdh4j\") pod \"network-check-target-g4svv\" (UID: \"1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76\") " pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:56.778179 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.778108    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k74rl"]
Jul 07 17:28:56.781819 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:28:56.781778    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff2b6c66_5e0e_4bb8_90f5_d8a972b0f974.slice/crio-6fecbf924bcc727f8993e92d202b72101e1037aff78da9c39a86b681f71b5b3f WatchSource:0}: Error finding container 6fecbf924bcc727f8993e92d202b72101e1037aff78da9c39a86b681f71b5b3f: Status 404 returned error can't find the container with id 6fecbf924bcc727f8993e92d202b72101e1037aff78da9c39a86b681f71b5b3f
Jul 07 17:28:56.839537 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.839502    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r9xqr"]
Jul 07 17:28:56.842761 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:28:56.842734    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab98c971_33fc_4c6a_a980_758f8f9f41fd.slice/crio-493b02bb9e4e693786cfef1eb9159990f97493fc3a1b708289aa6ca2f24f6105 WatchSource:0}: Error finding container 493b02bb9e4e693786cfef1eb9159990f97493fc3a1b708289aa6ca2f24f6105: Status 404 returned error can't find the container with id 493b02bb9e4e693786cfef1eb9159990f97493fc3a1b708289aa6ca2f24f6105
Jul 07 17:28:56.935044 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.935005    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hxlp2\""
Jul 07 17:28:56.943088 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:56.943045    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:28:57.102307 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.102281    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g4svv"]
Jul 07 17:28:57.141293 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.141236    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r9xqr" event={"ID":"ab98c971-33fc-4c6a-a980-758f8f9f41fd","Type":"ContainerStarted","Data":"493b02bb9e4e693786cfef1eb9159990f97493fc3a1b708289aa6ca2f24f6105"}
Jul 07 17:28:57.144471 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.144003    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857c4bf4d9-hmgnw" event={"ID":"ad4cc7fb-061f-4702-94e7-35430c5e954c","Type":"ContainerStarted","Data":"c3ccb8b0991ad8bc6a573b0e3f90cdac9facf9e6c869f81c56863739a763055f"}
Jul 07 17:28:57.144471 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.144050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857c4bf4d9-hmgnw" event={"ID":"ad4cc7fb-061f-4702-94e7-35430c5e954c","Type":"ContainerStarted","Data":"d324febc1625143d229f414d1ec98d869d171794ad473400c7a7575a2ad35339"}
Jul 07 17:28:57.147235 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.147210    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-98xg9" event={"ID":"769c5fa4-5419-4ada-940a-fefcbd820e9a","Type":"ContainerStarted","Data":"0d278acff8cf11d62e70da9b050d402c23bd887bed60086bd9f05614d9aeecee"}
Jul 07 17:28:57.147378 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.147259    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-98xg9" event={"ID":"769c5fa4-5419-4ada-940a-fefcbd820e9a","Type":"ContainerStarted","Data":"ee267123ef53983e596413ae15d727caec50f2df16d5ff909ff3b7f6219d02f4"}
Jul 07 17:28:57.148700 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.148674    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm" event={"ID":"9b1e62b0-ad5f-4a89-920c-314cad74b1af","Type":"ContainerStarted","Data":"4eb74aae21fc42192d674fe022b111a0b543207632be62d6fd452c426106c7cc"}
Jul 07 17:28:57.150096 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.150070    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k74rl" event={"ID":"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974","Type":"ContainerStarted","Data":"6fecbf924bcc727f8993e92d202b72101e1037aff78da9c39a86b681f71b5b3f"}
Jul 07 17:28:57.166276 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.166211    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-857c4bf4d9-hmgnw" podStartSLOduration=1.166188812 podStartE2EDuration="1.166188812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:28:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:57.165585172 +0000 UTC m=+66.929045053" watchObservedRunningTime="2026-07-07 17:28:57.166188812 +0000 UTC m=+66.929648691"
Jul 07 17:28:57.188418 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.188352    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-98xg9" podStartSLOduration=4.523928036 podStartE2EDuration="6.188336411s" totalImagesPullingTime="1.581406695s" totalInitContainerRuntime="83.00168ms" isStatefulPod=true podCreationTimestamp="2026-07-07 17:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:28:57.188229673 +0000 UTC m=+66.951689519" watchObservedRunningTime="2026-07-07 17:28:57.188336411 +0000 UTC m=+66.951796247"
Jul 07 17:28:57.595108 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.595072    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:28:57.601359 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.599694    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.602986 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.602797    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 17:28:57.603583 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.603560    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 17:28:57.604097 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.603912    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 17:28:57.604647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.604345    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 17:28:57.604647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.604526    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 17:28:57.604823 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.604678    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 17:28:57.604823 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.604797    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 17:28:57.604823 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.604814    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 17:28:57.605625 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.605122    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dve5m7m8vh5ac\""
Jul 07 17:28:57.605625 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.605122    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 17:28:57.605943 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.605926    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-frrgb\""
Jul 07 17:28:57.607944 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.607925    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 17:28:57.609905 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.609885    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 17:28:57.610024 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.610007    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 17:28:57.610605 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.610581    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 17:28:57.610715 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.610684    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 17:28:57.624662 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.624640    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:28:57.695080 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695045    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695080 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695330 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695103    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695330 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695149    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695330 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695179    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695330 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695330 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjcx9\" (UniqueName: \"kubernetes.io/projected/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-kube-api-access-jjcx9\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695510 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695510 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695394    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695510 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695418    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695510 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695445    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695510 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695673 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695512    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695673 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695673 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695565    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695673 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695582    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695673 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-config\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695673 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695650    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695910 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695698    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.695910 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.695716    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.756797 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:28:57.756760    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce1b9cc_5be5_4a4e_b3f5_819cdb3c8e76.slice/crio-94099127da201c3978006874bc58c9d35f8791953cec2303b6be509fccb2cb1c WatchSource:0}: Error finding container 94099127da201c3978006874bc58c9d35f8791953cec2303b6be509fccb2cb1c: Status 404 returned error can't find the container with id 94099127da201c3978006874bc58c9d35f8791953cec2303b6be509fccb2cb1c
Jul 07 17:28:57.796963 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.796932    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797156 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797156 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797042    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797156 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797067    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797156 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797156 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797156 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjcx9\" (UniqueName: \"kubernetes.io/projected/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-kube-api-access-jjcx9\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797156 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797200    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797274    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797292    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797308    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797325    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797405    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-config\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797427    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.797492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797474    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.798099 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.797554    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.800400 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.798292    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.800400 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.798293    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.800400 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.798680    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.800400 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.799004    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.800400 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.799482    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.800400 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.800234    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.801377 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.801265    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.801520 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.801494    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.802145 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.802095    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.803088 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.803065    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.803296 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.803244    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.803372 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.803350    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.803473 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.803458    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.803682 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.803656    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.803773 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.803705    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-config\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.803773 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.803740    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.804031 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.804013    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.804798 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.804781    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.805359 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.805339    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.807713 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.807690    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjcx9\" (UniqueName: \"kubernetes.io/projected/8d3241c7-6104-4f3b-b350-806bd0c8cfe1-kube-api-access-jjcx9\") pod \"prometheus-k8s-0\" (UID: \"8d3241c7-6104-4f3b-b350-806bd0c8cfe1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:57.913456 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:57.913359    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:28:58.160825 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:58.160782    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g4svv" event={"ID":"1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76","Type":"ContainerStarted","Data":"94099127da201c3978006874bc58c9d35f8791953cec2303b6be509fccb2cb1c"}
Jul 07 17:28:59.084740 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:59.084706    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zz49v"
Jul 07 17:28:59.903417 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:28:59.903390    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:28:59.910377 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:28:59.910318    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3241c7_6104_4f3b_b350_806bd0c8cfe1.slice/crio-100b23733d7393827606d95df12b2e3652cacad917697d982370477d4fc9f9b1 WatchSource:0}: Error finding container 100b23733d7393827606d95df12b2e3652cacad917697d982370477d4fc9f9b1: Status 404 returned error can't find the container with id 100b23733d7393827606d95df12b2e3652cacad917697d982370477d4fc9f9b1
Jul 07 17:29:00.174228 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:00.173547    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm" event={"ID":"9b1e62b0-ad5f-4a89-920c-314cad74b1af","Type":"ContainerStarted","Data":"88c1454cd9261fb40a39107fb8f79b714e720a4a0ed63f57d6625dd384e0315d"}
Jul 07 17:29:00.177305 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:00.177233    2561 generic.go:356] "Generic (PLEG): container finished" podID="8d3241c7-6104-4f3b-b350-806bd0c8cfe1" containerID="7d1109c459a3b7ba8add743f956fa42c7d8bbd5441f3f5d7ab6329dc51bd0568" exitCode=0
Jul 07 17:29:00.177454 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:00.177431    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d3241c7-6104-4f3b-b350-806bd0c8cfe1","Type":"ContainerDied","Data":"7d1109c459a3b7ba8add743f956fa42c7d8bbd5441f3f5d7ab6329dc51bd0568"}
Jul 07 17:29:00.177506 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:00.177495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d3241c7-6104-4f3b-b350-806bd0c8cfe1","Type":"ContainerStarted","Data":"100b23733d7393827606d95df12b2e3652cacad917697d982370477d4fc9f9b1"}
Jul 07 17:29:00.182189 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:00.182159    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62fd10ae-747a-49ed-b721-7ca5ac394f67","Type":"ContainerStarted","Data":"756e248e4e2fcaf6f0d3e88cac56fb6b926e005e9b994c396c5f9a7c8187cbca"}
Jul 07 17:29:00.182288 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:00.182249    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62fd10ae-747a-49ed-b721-7ca5ac394f67","Type":"ContainerStarted","Data":"5590254bc1dc573f8e90f86657559386e3b06e95ebb554b498f71d048c13ca5b"}
Jul 07 17:29:00.186072 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:00.186023    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5696546d8-xmm56" event={"ID":"15f8427a-aa69-4563-834b-3edef30d1deb","Type":"ContainerStarted","Data":"fd8af0e351c2032fe93ea55e4d372d6cdd06f7f6b697d8bfb872c300609987d8"}
Jul 07 17:29:00.186199 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:00.186119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5696546d8-xmm56" event={"ID":"15f8427a-aa69-4563-834b-3edef30d1deb","Type":"ContainerStarted","Data":"0dc365291d426cbcf3bdd59b8e9638df76a0369dc4c82744773d854958ca2ce0"}
Jul 07 17:29:00.190382 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:00.189616    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r9xqr" event={"ID":"ab98c971-33fc-4c6a-a980-758f8f9f41fd","Type":"ContainerStarted","Data":"8e33ca5d1b07296bd1df24bdea8e7b6b3b8863f761f4dc4135d6492bb7385e7f"}
Jul 07 17:29:00.194919 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:00.194820    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm" podStartSLOduration=1.758339464 podStartE2EDuration="5.194801627s" totalImagesPullingTime="3.436462163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:28:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:29:00.193332208 +0000 UTC m=+69.956792071" watchObservedRunningTime="2026-07-07 17:29:00.194801627 +0000 UTC m=+69.958261473"
Jul 07 17:29:01.198881 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:01.198837    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62fd10ae-747a-49ed-b721-7ca5ac394f67","Type":"ContainerStarted","Data":"bec95e0e54e976014e7555efc34734a3eea172906a48021120e14724f4ce9524"}
Jul 07 17:29:01.199354 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:01.198928    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62fd10ae-747a-49ed-b721-7ca5ac394f67","Type":"ContainerStarted","Data":"9e15dedaa5f916a917a070552b648e1349792d2b762d653fd588b37e416c7612"}
Jul 07 17:29:01.199354 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:01.198998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62fd10ae-747a-49ed-b721-7ca5ac394f67","Type":"ContainerStarted","Data":"ce9a25488a88908ba4dac9827e575e896a4ebe9cf189250ea20f6215e0667ea9"}
Jul 07 17:29:01.201492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:01.201455    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5696546d8-xmm56" event={"ID":"15f8427a-aa69-4563-834b-3edef30d1deb","Type":"ContainerStarted","Data":"37babbddece2f006ef0a290f44f97c0f9f5281508e4a5bd12cb978666e635b94"}
Jul 07 17:29:01.203378 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:01.203349    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r9xqr" event={"ID":"ab98c971-33fc-4c6a-a980-758f8f9f41fd","Type":"ContainerStarted","Data":"5dec6eb8dcee8bbc676590c0c19777061f0f2fc3bb780afb30aff5ce8d5b1c6f"}
Jul 07 17:29:01.224106 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:01.224038    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r9xqr" podStartSLOduration=67.357669026 podStartE2EDuration="1m10.224015227s" totalImagesPullingTime="2.866346201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:29:01.222221011 +0000 UTC m=+70.985680860" watchObservedRunningTime="2026-07-07 17:29:01.224015227 +0000 UTC m=+70.987475073"
Jul 07 17:29:02.020319 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.020219    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-644d485d99-knhcf"]
Jul 07 17:29:02.075124 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.075089    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d57f4f776-mwp4w"]
Jul 07 17:29:02.080949 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.080918    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.092141 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.092082    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d57f4f776-mwp4w"]
Jul 07 17:29:02.139580 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.139529    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-service-ca\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.139757 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.139695    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-oauth-serving-cert\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.139757 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.139736    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-serving-cert\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.139855 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.139772    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-config\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.139855 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.139799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-trusted-ca-bundle\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.145053 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.140510    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svclc\" (UniqueName: \"kubernetes.io/projected/9a7a3029-075a-4ced-b6b7-e5e4c905c475-kube-api-access-svclc\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.145053 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.140592    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-oauth-config\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.241407 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.241369    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-oauth-serving-cert\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.241864 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.241429    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-serving-cert\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.241864 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.241467    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-config\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.241864 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.241488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-trusted-ca-bundle\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.241864 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.241531    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svclc\" (UniqueName: \"kubernetes.io/projected/9a7a3029-075a-4ced-b6b7-e5e4c905c475-kube-api-access-svclc\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.241864 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.241566    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-oauth-config\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.241864 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.241609    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-service-ca\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.242481 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.242460    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-service-ca\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.243088 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.243052    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-oauth-serving-cert\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.245774 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.244475    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-trusted-ca-bundle\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.245774 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.245059    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-config\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.246563 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.246539    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-serving-cert\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.249205 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.249158    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-oauth-config\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.262780 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.262744    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svclc\" (UniqueName: \"kubernetes.io/projected/9a7a3029-075a-4ced-b6b7-e5e4c905c475-kube-api-access-svclc\") pod \"console-d57f4f776-mwp4w\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") " pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:02.394962 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:02.394921    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:03.406255 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:03.406230    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d57f4f776-mwp4w"]
Jul 07 17:29:03.409036 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:29:03.408995    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7a3029_075a_4ced_b6b7_e5e4c905c475.slice/crio-ba2c937f317b7d0d3df0e2af5460abd15f512f0d4f7bb2f41fbad0b72acde687 WatchSource:0}: Error finding container ba2c937f317b7d0d3df0e2af5460abd15f512f0d4f7bb2f41fbad0b72acde687: Status 404 returned error can't find the container with id ba2c937f317b7d0d3df0e2af5460abd15f512f0d4f7bb2f41fbad0b72acde687
Jul 07 17:29:04.220836 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.220799    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k74rl" event={"ID":"ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974","Type":"ContainerStarted","Data":"58597d168fdd9e46ed55dfe207215684cc39b82dc5d1a0a8ed70e03256e4e9b9"}
Jul 07 17:29:04.225138 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.225047    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62fd10ae-747a-49ed-b721-7ca5ac394f67","Type":"ContainerStarted","Data":"f6e747ddeda6011d39ad7de1b0ff3c7788a221c323dfbad6cd083c4268694676"}
Jul 07 17:29:04.228802 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.228775    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5696546d8-xmm56" event={"ID":"15f8427a-aa69-4563-834b-3edef30d1deb","Type":"ContainerStarted","Data":"5f00f52d7e0c091bd8f7d05d0df54de8f379f1dc3808219f0151dc5ec9e97ba2"}
Jul 07 17:29:04.228987 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.228847    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5696546d8-xmm56" event={"ID":"15f8427a-aa69-4563-834b-3edef30d1deb","Type":"ContainerStarted","Data":"b2ccf6f86f7d0e677c0956f55d3ebe8a061b187e8e4cef99a5b046ec8d16555f"}
Jul 07 17:29:04.228987 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.228908    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:29:04.228987 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.228946    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5696546d8-xmm56" event={"ID":"15f8427a-aa69-4563-834b-3edef30d1deb","Type":"ContainerStarted","Data":"98e0d8573d80e3cd82c2d6237179fa9f86be3cc9f1b6185cf2d32223b5ece545"}
Jul 07 17:29:04.231094 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.231066    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d57f4f776-mwp4w" event={"ID":"9a7a3029-075a-4ced-b6b7-e5e4c905c475","Type":"ContainerStarted","Data":"c6274668522f870c7c9fa109c8ead4170820c9b2c955415b79375d25b8f3efc7"}
Jul 07 17:29:04.231225 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.231115    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d57f4f776-mwp4w" event={"ID":"9a7a3029-075a-4ced-b6b7-e5e4c905c475","Type":"ContainerStarted","Data":"ba2c937f317b7d0d3df0e2af5460abd15f512f0d4f7bb2f41fbad0b72acde687"}
Jul 07 17:29:04.232724 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.232684    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g4svv" event={"ID":"1ce1b9cc-5be5-4a4e-b3f5-819cdb3c8e76","Type":"ContainerStarted","Data":"6d27aebcf6af2b65e54445e152621bc6ec882a2edc124de3bf5c4d6dad737707"}
Jul 07 17:29:04.232836 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.232752    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:29:04.240129 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.240073    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k74rl" podStartSLOduration=66.785017671 podStartE2EDuration="1m13.240056995s" totalImagesPullingTime="6.455039324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:29:04.23788348 +0000 UTC m=+74.001343326" watchObservedRunningTime="2026-07-07 17:29:04.240056995 +0000 UTC m=+74.003516832"
Jul 07 17:29:04.271774 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.271335    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.332967274 podStartE2EDuration="12.271311847s" totalImagesPullingTime="7.920945059s" totalInitContainerRuntime="17.399514ms" isStatefulPod=false podCreationTimestamp="2026-07-07 17:28:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:29:04.269310953 +0000 UTC m=+74.032770800" watchObservedRunningTime="2026-07-07 17:29:04.271311847 +0000 UTC m=+74.034771709"
Jul 07 17:29:04.329671 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.329606    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d57f4f776-mwp4w" podStartSLOduration=2.329582844 podStartE2EDuration="2.329582844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:29:04.299871963 +0000 UTC m=+74.063331811" watchObservedRunningTime="2026-07-07 17:29:04.329582844 +0000 UTC m=+74.093042691"
Jul 07 17:29:04.330483 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.330423    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5696546d8-xmm56" podStartSLOduration=3.071746569 podStartE2EDuration="11.33040943s" totalImagesPullingTime="8.258662861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:28:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:29:04.327748357 +0000 UTC m=+74.091208228" watchObservedRunningTime="2026-07-07 17:29:04.33040943 +0000 UTC m=+74.093869254"
Jul 07 17:29:04.351120 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:04.351065    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-g4svv" podStartSLOduration=67.823205556 podStartE2EDuration="1m13.351046654s" totalImagesPullingTime="5.527841098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:29:04.348987837 +0000 UTC m=+74.112447692" watchObservedRunningTime="2026-07-07 17:29:04.351046654 +0000 UTC m=+74.114506499"
Jul 07 17:29:05.239806 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:05.239771    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d3241c7-6104-4f3b-b350-806bd0c8cfe1","Type":"ContainerStarted","Data":"af711e8087fcd4aeb357134e584fe2c195214f4759c720315550273e0aa96740"}
Jul 07 17:29:05.240254 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:05.239868    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d3241c7-6104-4f3b-b350-806bd0c8cfe1","Type":"ContainerStarted","Data":"dbecbe2a1fcab9e66eb77f0931abd30cc6d2654af3a65056b4055bf732aa6d57"}
Jul 07 17:29:05.247270 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:05.247234    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5696546d8-xmm56"
Jul 07 17:29:06.246883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:06.246844    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d3241c7-6104-4f3b-b350-806bd0c8cfe1","Type":"ContainerStarted","Data":"11f31ddfe4d39241d60d106709b7d307cc3ee67f496bfc6f3153d873f0f2dc47"}
Jul 07 17:29:06.247400 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:06.246912    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d3241c7-6104-4f3b-b350-806bd0c8cfe1","Type":"ContainerStarted","Data":"1a3e8d5632ff21c378c9499732687e81cdf9664c77ed7d3176d92b9c6ee58e4b"}
Jul 07 17:29:06.247400 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:06.246939    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d3241c7-6104-4f3b-b350-806bd0c8cfe1","Type":"ContainerStarted","Data":"a08109be69ef3f0c5eb50143e4935cf8e49ff4d80919d7e7a3d6ef51edb1270c"}
Jul 07 17:29:06.247400 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:06.246977    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d3241c7-6104-4f3b-b350-806bd0c8cfe1","Type":"ContainerStarted","Data":"90a87c4e52213d9ac6845b7fa29734c469f80b8c7b7977449a0c617bc8fda8ce"}
Jul 07 17:29:06.284844 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:06.284779    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.346853645 podStartE2EDuration="9.284759836s" totalImagesPullingTime="4.907015848s" totalInitContainerRuntime="30.890343ms" isStatefulPod=false podCreationTimestamp="2026-07-07 17:28:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:29:06.282394767 +0000 UTC m=+76.045854636" watchObservedRunningTime="2026-07-07 17:29:06.284759836 +0000 UTC m=+76.048219681"
Jul 07 17:29:06.495810 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:06.495765    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:29:06.496008 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:06.495827    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:29:06.501031 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:06.500934    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:29:07.256875 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:07.256841    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:29:07.914313 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:07.914285    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:29:12.395637 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:12.395463    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:12.395637 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:12.395561    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:12.401491 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:12.401463    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:13.283261 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:13.283228    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:29:13.358203 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:13.358167    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-857c4bf4d9-hmgnw"]
Jul 07 17:29:16.109134 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:16.109084    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:29:16.109555 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:16.109156    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:29:27.044676 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.044609    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-644d485d99-knhcf" podUID="53b71d96-d63a-434b-b7ac-0387c717923c" containerName="console" containerID="cri-o://b585eaba812d0a43bc1d9f348e080d17a0f3d5a3b563f1cf79f5eaedc1b4d401" gracePeriod=15
Jul 07 17:29:27.291293 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.291270    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:29:27.335629 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.335593    2561 generic.go:356] "Generic (PLEG): container finished" podID="53b71d96-d63a-434b-b7ac-0387c717923c" containerID="b585eaba812d0a43bc1d9f348e080d17a0f3d5a3b563f1cf79f5eaedc1b4d401" exitCode=0
Jul 07 17:29:27.335804 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.335639    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644d485d99-knhcf"
Jul 07 17:29:27.335804 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.335671    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644d485d99-knhcf" event={"ID":"53b71d96-d63a-434b-b7ac-0387c717923c","Type":"ContainerDied","Data":"b585eaba812d0a43bc1d9f348e080d17a0f3d5a3b563f1cf79f5eaedc1b4d401"}
Jul 07 17:29:27.335804 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.335716    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644d485d99-knhcf" event={"ID":"53b71d96-d63a-434b-b7ac-0387c717923c","Type":"ContainerDied","Data":"8b2643c2228ef01e170d9da7977a263d63aa05c6e64ea3de7f0ce7ca304a200c"}
Jul 07 17:29:27.335804 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.335737    2561 scope.go:117] "RemoveContainer" containerID="b585eaba812d0a43bc1d9f348e080d17a0f3d5a3b563f1cf79f5eaedc1b4d401"
Jul 07 17:29:27.345494 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.345472    2561 scope.go:117] "RemoveContainer" containerID="b585eaba812d0a43bc1d9f348e080d17a0f3d5a3b563f1cf79f5eaedc1b4d401"
Jul 07 17:29:27.345839 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:29:27.345814    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b585eaba812d0a43bc1d9f348e080d17a0f3d5a3b563f1cf79f5eaedc1b4d401\": container with ID starting with b585eaba812d0a43bc1d9f348e080d17a0f3d5a3b563f1cf79f5eaedc1b4d401 not found: ID does not exist" containerID="b585eaba812d0a43bc1d9f348e080d17a0f3d5a3b563f1cf79f5eaedc1b4d401"
Jul 07 17:29:27.345910 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.345848    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b585eaba812d0a43bc1d9f348e080d17a0f3d5a3b563f1cf79f5eaedc1b4d401"} err="failed to get container status \"b585eaba812d0a43bc1d9f348e080d17a0f3d5a3b563f1cf79f5eaedc1b4d401\": rpc error: code = NotFound desc = could not find container \"b585eaba812d0a43bc1d9f348e080d17a0f3d5a3b563f1cf79f5eaedc1b4d401\": container with ID starting with b585eaba812d0a43bc1d9f348e080d17a0f3d5a3b563f1cf79f5eaedc1b4d401 not found: ID does not exist"
Jul 07 17:29:27.380245 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.380211    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-console-config\") pod \"53b71d96-d63a-434b-b7ac-0387c717923c\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") "
Jul 07 17:29:27.380245 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.380247    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-trusted-ca-bundle\") pod \"53b71d96-d63a-434b-b7ac-0387c717923c\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") "
Jul 07 17:29:27.380448 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.380292    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c65cg\" (UniqueName: \"kubernetes.io/projected/53b71d96-d63a-434b-b7ac-0387c717923c-kube-api-access-c65cg\") pod \"53b71d96-d63a-434b-b7ac-0387c717923c\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") "
Jul 07 17:29:27.380448 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.380401    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b71d96-d63a-434b-b7ac-0387c717923c-console-serving-cert\") pod \"53b71d96-d63a-434b-b7ac-0387c717923c\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") "
Jul 07 17:29:27.380448 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.380442    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-service-ca\") pod \"53b71d96-d63a-434b-b7ac-0387c717923c\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") "
Jul 07 17:29:27.380601 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.380477    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b71d96-d63a-434b-b7ac-0387c717923c-console-oauth-config\") pod \"53b71d96-d63a-434b-b7ac-0387c717923c\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") "
Jul 07 17:29:27.380601 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.380531    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-oauth-serving-cert\") pod \"53b71d96-d63a-434b-b7ac-0387c717923c\" (UID: \"53b71d96-d63a-434b-b7ac-0387c717923c\") "
Jul 07 17:29:27.380820 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.380730    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-console-config" (OuterVolumeSpecName: "console-config") pod "53b71d96-d63a-434b-b7ac-0387c717923c" (UID: "53b71d96-d63a-434b-b7ac-0387c717923c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:29:27.380820 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.380771    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "53b71d96-d63a-434b-b7ac-0387c717923c" (UID: "53b71d96-d63a-434b-b7ac-0387c717923c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:29:27.381102 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.380818    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-service-ca" (OuterVolumeSpecName: "service-ca") pod "53b71d96-d63a-434b-b7ac-0387c717923c" (UID: "53b71d96-d63a-434b-b7ac-0387c717923c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:29:27.381102 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.380832    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-console-config\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:29:27.381102 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.381050    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "53b71d96-d63a-434b-b7ac-0387c717923c" (UID: "53b71d96-d63a-434b-b7ac-0387c717923c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:29:27.382852 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.382825    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53b71d96-d63a-434b-b7ac-0387c717923c-kube-api-access-c65cg" (OuterVolumeSpecName: "kube-api-access-c65cg") pod "53b71d96-d63a-434b-b7ac-0387c717923c" (UID: "53b71d96-d63a-434b-b7ac-0387c717923c"). InnerVolumeSpecName "kube-api-access-c65cg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:29:27.382852 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.382829    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53b71d96-d63a-434b-b7ac-0387c717923c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "53b71d96-d63a-434b-b7ac-0387c717923c" (UID: "53b71d96-d63a-434b-b7ac-0387c717923c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:29:27.383035 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.382884    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53b71d96-d63a-434b-b7ac-0387c717923c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "53b71d96-d63a-434b-b7ac-0387c717923c" (UID: "53b71d96-d63a-434b-b7ac-0387c717923c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:29:27.481286 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.481241    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-trusted-ca-bundle\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:29:27.481286 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.481277    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c65cg\" (UniqueName: \"kubernetes.io/projected/53b71d96-d63a-434b-b7ac-0387c717923c-kube-api-access-c65cg\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:29:27.481286 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.481292    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b71d96-d63a-434b-b7ac-0387c717923c-console-serving-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:29:27.481530 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.481305    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:29:27.481530 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.481324    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b71d96-d63a-434b-b7ac-0387c717923c-console-oauth-config\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:29:27.481530 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.481336    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b71d96-d63a-434b-b7ac-0387c717923c-oauth-serving-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:29:27.665283 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.665240    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-644d485d99-knhcf"]
Jul 07 17:29:27.668608 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:27.668580    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-644d485d99-knhcf"]
Jul 07 17:29:28.808580 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:28.808545    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53b71d96-d63a-434b-b7ac-0387c717923c" path="/var/lib/kubelet/pods/53b71d96-d63a-434b-b7ac-0387c717923c/volumes"
Jul 07 17:29:35.242427 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:35.242392    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-g4svv"
Jul 07 17:29:36.113744 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:36.113713    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:29:36.117715 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:36.117695    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7bd65d9874-bc6nm"
Jul 07 17:29:38.379398 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.379358    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-857c4bf4d9-hmgnw" podUID="ad4cc7fb-061f-4702-94e7-35430c5e954c" containerName="console" containerID="cri-o://c3ccb8b0991ad8bc6a573b0e3f90cdac9facf9e6c869f81c56863739a763055f" gracePeriod=15
Jul 07 17:29:38.668157 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.668131    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:29:38.756609 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.756556    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-serving-cert\") pod \"ad4cc7fb-061f-4702-94e7-35430c5e954c\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") "
Jul 07 17:29:38.756805 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.756622    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-trusted-ca-bundle\") pod \"ad4cc7fb-061f-4702-94e7-35430c5e954c\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") "
Jul 07 17:29:38.756805 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.756677    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-service-ca\") pod \"ad4cc7fb-061f-4702-94e7-35430c5e954c\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") "
Jul 07 17:29:38.756805 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.756701    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-config\") pod \"ad4cc7fb-061f-4702-94e7-35430c5e954c\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") "
Jul 07 17:29:38.756805 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.756751    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-oauth-serving-cert\") pod \"ad4cc7fb-061f-4702-94e7-35430c5e954c\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") "
Jul 07 17:29:38.757128 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.757100    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-service-ca" (OuterVolumeSpecName: "service-ca") pod "ad4cc7fb-061f-4702-94e7-35430c5e954c" (UID: "ad4cc7fb-061f-4702-94e7-35430c5e954c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:29:38.757180 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.757121    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ad4cc7fb-061f-4702-94e7-35430c5e954c" (UID: "ad4cc7fb-061f-4702-94e7-35430c5e954c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:29:38.757258 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.757237    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ad4cc7fb-061f-4702-94e7-35430c5e954c" (UID: "ad4cc7fb-061f-4702-94e7-35430c5e954c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:29:38.757394 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.757374    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-config" (OuterVolumeSpecName: "console-config") pod "ad4cc7fb-061f-4702-94e7-35430c5e954c" (UID: "ad4cc7fb-061f-4702-94e7-35430c5e954c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:29:38.759461 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.759430    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ad4cc7fb-061f-4702-94e7-35430c5e954c" (UID: "ad4cc7fb-061f-4702-94e7-35430c5e954c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:29:38.858230 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.857652    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxx7q\" (UniqueName: \"kubernetes.io/projected/ad4cc7fb-061f-4702-94e7-35430c5e954c-kube-api-access-bxx7q\") pod \"ad4cc7fb-061f-4702-94e7-35430c5e954c\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") "
Jul 07 17:29:38.858230 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.857707    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-oauth-config\") pod \"ad4cc7fb-061f-4702-94e7-35430c5e954c\" (UID: \"ad4cc7fb-061f-4702-94e7-35430c5e954c\") "
Jul 07 17:29:38.858230 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.857923    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-serving-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:29:38.858230 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.857938    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-trusted-ca-bundle\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:29:38.858230 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.857950    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:29:38.858230 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.857981    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-config\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:29:38.858230 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.857994    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad4cc7fb-061f-4702-94e7-35430c5e954c-oauth-serving-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:29:38.864657 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.864615    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad4cc7fb-061f-4702-94e7-35430c5e954c-kube-api-access-bxx7q" (OuterVolumeSpecName: "kube-api-access-bxx7q") pod "ad4cc7fb-061f-4702-94e7-35430c5e954c" (UID: "ad4cc7fb-061f-4702-94e7-35430c5e954c"). InnerVolumeSpecName "kube-api-access-bxx7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:29:38.865072 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.865031    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ad4cc7fb-061f-4702-94e7-35430c5e954c" (UID: "ad4cc7fb-061f-4702-94e7-35430c5e954c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:29:38.959467 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.959342    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxx7q\" (UniqueName: \"kubernetes.io/projected/ad4cc7fb-061f-4702-94e7-35430c5e954c-kube-api-access-bxx7q\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:29:38.959467 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:38.959380    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad4cc7fb-061f-4702-94e7-35430c5e954c-console-oauth-config\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:29:39.387393 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:39.387361    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad4cc7fb-061f-4702-94e7-35430c5e954c" containerID="c3ccb8b0991ad8bc6a573b0e3f90cdac9facf9e6c869f81c56863739a763055f" exitCode=0
Jul 07 17:29:39.387853 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:39.387416    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857c4bf4d9-hmgnw"
Jul 07 17:29:39.387853 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:39.387445    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857c4bf4d9-hmgnw" event={"ID":"ad4cc7fb-061f-4702-94e7-35430c5e954c","Type":"ContainerDied","Data":"c3ccb8b0991ad8bc6a573b0e3f90cdac9facf9e6c869f81c56863739a763055f"}
Jul 07 17:29:39.387853 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:39.387498    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857c4bf4d9-hmgnw" event={"ID":"ad4cc7fb-061f-4702-94e7-35430c5e954c","Type":"ContainerDied","Data":"d324febc1625143d229f414d1ec98d869d171794ad473400c7a7575a2ad35339"}
Jul 07 17:29:39.387853 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:39.387521    2561 scope.go:117] "RemoveContainer" containerID="c3ccb8b0991ad8bc6a573b0e3f90cdac9facf9e6c869f81c56863739a763055f"
Jul 07 17:29:39.402627 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:39.402606    2561 scope.go:117] "RemoveContainer" containerID="c3ccb8b0991ad8bc6a573b0e3f90cdac9facf9e6c869f81c56863739a763055f"
Jul 07 17:29:39.402897 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:29:39.402880    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3ccb8b0991ad8bc6a573b0e3f90cdac9facf9e6c869f81c56863739a763055f\": container with ID starting with c3ccb8b0991ad8bc6a573b0e3f90cdac9facf9e6c869f81c56863739a763055f not found: ID does not exist" containerID="c3ccb8b0991ad8bc6a573b0e3f90cdac9facf9e6c869f81c56863739a763055f"
Jul 07 17:29:39.402948 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:39.402905    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3ccb8b0991ad8bc6a573b0e3f90cdac9facf9e6c869f81c56863739a763055f"} err="failed to get container status \"c3ccb8b0991ad8bc6a573b0e3f90cdac9facf9e6c869f81c56863739a763055f\": rpc error: code = NotFound desc = could not find container \"c3ccb8b0991ad8bc6a573b0e3f90cdac9facf9e6c869f81c56863739a763055f\": container with ID starting with c3ccb8b0991ad8bc6a573b0e3f90cdac9facf9e6c869f81c56863739a763055f not found: ID does not exist"
Jul 07 17:29:39.419772 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:39.419732    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-857c4bf4d9-hmgnw"]
Jul 07 17:29:39.427753 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:39.427726    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-857c4bf4d9-hmgnw"]
Jul 07 17:29:40.814241 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:40.814201    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad4cc7fb-061f-4702-94e7-35430c5e954c" path="/var/lib/kubelet/pods/ad4cc7fb-061f-4702-94e7-35430c5e954c/volumes"
Jul 07 17:29:57.913814 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:57.913773    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:29:57.934330 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:57.934305    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:29:58.482588 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:29:58.482562    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:30:23.645799 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:23.645767    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d57f4f776-mwp4w"]
Jul 07 17:30:48.666481 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:48.666436    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d57f4f776-mwp4w" podUID="9a7a3029-075a-4ced-b6b7-e5e4c905c475" containerName="console" containerID="cri-o://c6274668522f870c7c9fa109c8ead4170820c9b2c955415b79375d25b8f3efc7" gracePeriod=15
Jul 07 17:30:48.910563 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:48.910535    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:30:49.000301 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.000197    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-oauth-config\") pod \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") "
Jul 07 17:30:49.000301 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.000257    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-serving-cert\") pod \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") "
Jul 07 17:30:49.000301 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.000279    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-trusted-ca-bundle\") pod \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") "
Jul 07 17:30:49.000594 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.000312    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-oauth-serving-cert\") pod \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") "
Jul 07 17:30:49.000594 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.000356    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-service-ca\") pod \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") "
Jul 07 17:30:49.000594 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.000379    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svclc\" (UniqueName: \"kubernetes.io/projected/9a7a3029-075a-4ced-b6b7-e5e4c905c475-kube-api-access-svclc\") pod \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") "
Jul 07 17:30:49.000594 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.000415    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-config\") pod \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\" (UID: \"9a7a3029-075a-4ced-b6b7-e5e4c905c475\") "
Jul 07 17:30:49.000845 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.000817    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9a7a3029-075a-4ced-b6b7-e5e4c905c475" (UID: "9a7a3029-075a-4ced-b6b7-e5e4c905c475"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:30:49.000913 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.000863    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a7a3029-075a-4ced-b6b7-e5e4c905c475" (UID: "9a7a3029-075a-4ced-b6b7-e5e4c905c475"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:30:49.000913 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.000893    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a7a3029-075a-4ced-b6b7-e5e4c905c475" (UID: "9a7a3029-075a-4ced-b6b7-e5e4c905c475"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:30:49.001024 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.000899    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-config" (OuterVolumeSpecName: "console-config") pod "9a7a3029-075a-4ced-b6b7-e5e4c905c475" (UID: "9a7a3029-075a-4ced-b6b7-e5e4c905c475"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:30:49.002769 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.002739    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a7a3029-075a-4ced-b6b7-e5e4c905c475" (UID: "9a7a3029-075a-4ced-b6b7-e5e4c905c475"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:30:49.002875 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.002799    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a7a3029-075a-4ced-b6b7-e5e4c905c475" (UID: "9a7a3029-075a-4ced-b6b7-e5e4c905c475"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:30:49.002875 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.002799    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a7a3029-075a-4ced-b6b7-e5e4c905c475-kube-api-access-svclc" (OuterVolumeSpecName: "kube-api-access-svclc") pod "9a7a3029-075a-4ced-b6b7-e5e4c905c475" (UID: "9a7a3029-075a-4ced-b6b7-e5e4c905c475"). InnerVolumeSpecName "kube-api-access-svclc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:30:49.101908 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.101853    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-oauth-serving-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:30:49.101908 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.101899    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:30:49.101908 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.101911    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svclc\" (UniqueName: \"kubernetes.io/projected/9a7a3029-075a-4ced-b6b7-e5e4c905c475-kube-api-access-svclc\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:30:49.101908 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.101919    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-config\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:30:49.101908 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.101928    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-oauth-config\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:30:49.102239 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.101938    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a7a3029-075a-4ced-b6b7-e5e4c905c475-console-serving-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:30:49.102239 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.101946    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a7a3029-075a-4ced-b6b7-e5e4c905c475-trusted-ca-bundle\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:30:49.659746 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.659710    2561 generic.go:356] "Generic (PLEG): container finished" podID="9a7a3029-075a-4ced-b6b7-e5e4c905c475" containerID="c6274668522f870c7c9fa109c8ead4170820c9b2c955415b79375d25b8f3efc7" exitCode=0
Jul 07 17:30:49.659746 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.659750    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d57f4f776-mwp4w" event={"ID":"9a7a3029-075a-4ced-b6b7-e5e4c905c475","Type":"ContainerDied","Data":"c6274668522f870c7c9fa109c8ead4170820c9b2c955415b79375d25b8f3efc7"}
Jul 07 17:30:49.660001 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.659761    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d57f4f776-mwp4w"
Jul 07 17:30:49.660001 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.659790    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d57f4f776-mwp4w" event={"ID":"9a7a3029-075a-4ced-b6b7-e5e4c905c475","Type":"ContainerDied","Data":"ba2c937f317b7d0d3df0e2af5460abd15f512f0d4f7bb2f41fbad0b72acde687"}
Jul 07 17:30:49.660001 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.659809    2561 scope.go:117] "RemoveContainer" containerID="c6274668522f870c7c9fa109c8ead4170820c9b2c955415b79375d25b8f3efc7"
Jul 07 17:30:49.669395 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.669210    2561 scope.go:117] "RemoveContainer" containerID="c6274668522f870c7c9fa109c8ead4170820c9b2c955415b79375d25b8f3efc7"
Jul 07 17:30:49.669627 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:30:49.669488    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6274668522f870c7c9fa109c8ead4170820c9b2c955415b79375d25b8f3efc7\": container with ID starting with c6274668522f870c7c9fa109c8ead4170820c9b2c955415b79375d25b8f3efc7 not found: ID does not exist" containerID="c6274668522f870c7c9fa109c8ead4170820c9b2c955415b79375d25b8f3efc7"
Jul 07 17:30:49.669627 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.669516    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6274668522f870c7c9fa109c8ead4170820c9b2c955415b79375d25b8f3efc7"} err="failed to get container status \"c6274668522f870c7c9fa109c8ead4170820c9b2c955415b79375d25b8f3efc7\": rpc error: code = NotFound desc = could not find container \"c6274668522f870c7c9fa109c8ead4170820c9b2c955415b79375d25b8f3efc7\": container with ID starting with c6274668522f870c7c9fa109c8ead4170820c9b2c955415b79375d25b8f3efc7 not found: ID does not exist"
Jul 07 17:30:49.682676 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.682642    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d57f4f776-mwp4w"]
Jul 07 17:30:49.687500 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:49.687477    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d57f4f776-mwp4w"]
Jul 07 17:30:50.808713 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:30:50.808674    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a7a3029-075a-4ced-b6b7-e5e4c905c475" path="/var/lib/kubelet/pods/9a7a3029-075a-4ced-b6b7-e5e4c905c475/volumes"
Jul 07 17:31:58.781838 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.781802    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fqbs7"]
Jul 07 17:31:58.782379 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.782123    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad4cc7fb-061f-4702-94e7-35430c5e954c" containerName="console"
Jul 07 17:31:58.782379 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.782136    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad4cc7fb-061f-4702-94e7-35430c5e954c" containerName="console"
Jul 07 17:31:58.782379 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.782153    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53b71d96-d63a-434b-b7ac-0387c717923c" containerName="console"
Jul 07 17:31:58.782379 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.782158    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="53b71d96-d63a-434b-b7ac-0387c717923c" containerName="console"
Jul 07 17:31:58.782379 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.782173    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a7a3029-075a-4ced-b6b7-e5e4c905c475" containerName="console"
Jul 07 17:31:58.782379 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.782178    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a7a3029-075a-4ced-b6b7-e5e4c905c475" containerName="console"
Jul 07 17:31:58.782379 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.782227    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a7a3029-075a-4ced-b6b7-e5e4c905c475" containerName="console"
Jul 07 17:31:58.782379 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.782236    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="53b71d96-d63a-434b-b7ac-0387c717923c" containerName="console"
Jul 07 17:31:58.782379 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.782242    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad4cc7fb-061f-4702-94e7-35430c5e954c" containerName="console"
Jul 07 17:31:58.784259 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.784241    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fqbs7"
Jul 07 17:31:58.786736 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.786708    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rf9w5\""
Jul 07 17:31:58.786856 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.786751    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 17:31:58.787599 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.787581    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 17:31:58.797831 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.797804    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fqbs7"]
Jul 07 17:31:58.884411 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.884352    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c91c2694-9a45-4410-8cd5-2eee6094827b-bound-sa-token\") pod \"cert-manager-55b4d954d5-fqbs7\" (UID: \"c91c2694-9a45-4410-8cd5-2eee6094827b\") " pod="cert-manager/cert-manager-55b4d954d5-fqbs7"
Jul 07 17:31:58.884411 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.884426    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l645r\" (UniqueName: \"kubernetes.io/projected/c91c2694-9a45-4410-8cd5-2eee6094827b-kube-api-access-l645r\") pod \"cert-manager-55b4d954d5-fqbs7\" (UID: \"c91c2694-9a45-4410-8cd5-2eee6094827b\") " pod="cert-manager/cert-manager-55b4d954d5-fqbs7"
Jul 07 17:31:58.985091 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.985046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c91c2694-9a45-4410-8cd5-2eee6094827b-bound-sa-token\") pod \"cert-manager-55b4d954d5-fqbs7\" (UID: \"c91c2694-9a45-4410-8cd5-2eee6094827b\") " pod="cert-manager/cert-manager-55b4d954d5-fqbs7"
Jul 07 17:31:58.985091 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.985095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l645r\" (UniqueName: \"kubernetes.io/projected/c91c2694-9a45-4410-8cd5-2eee6094827b-kube-api-access-l645r\") pod \"cert-manager-55b4d954d5-fqbs7\" (UID: \"c91c2694-9a45-4410-8cd5-2eee6094827b\") " pod="cert-manager/cert-manager-55b4d954d5-fqbs7"
Jul 07 17:31:58.997431 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.997408    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l645r\" (UniqueName: \"kubernetes.io/projected/c91c2694-9a45-4410-8cd5-2eee6094827b-kube-api-access-l645r\") pod \"cert-manager-55b4d954d5-fqbs7\" (UID: \"c91c2694-9a45-4410-8cd5-2eee6094827b\") " pod="cert-manager/cert-manager-55b4d954d5-fqbs7"
Jul 07 17:31:58.997555 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:58.997523    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c91c2694-9a45-4410-8cd5-2eee6094827b-bound-sa-token\") pod \"cert-manager-55b4d954d5-fqbs7\" (UID: \"c91c2694-9a45-4410-8cd5-2eee6094827b\") " pod="cert-manager/cert-manager-55b4d954d5-fqbs7"
Jul 07 17:31:59.103469 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:59.103435    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fqbs7"
Jul 07 17:31:59.241143 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:59.241110    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fqbs7"]
Jul 07 17:31:59.244685 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:31:59.244659    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc91c2694_9a45_4410_8cd5_2eee6094827b.slice/crio-d7078e54ad6bb7b4a2f68bda9f9dc4e36cb5c760e03fe5976942479e53d12d72 WatchSource:0}: Error finding container d7078e54ad6bb7b4a2f68bda9f9dc4e36cb5c760e03fe5976942479e53d12d72: Status 404 returned error can't find the container with id d7078e54ad6bb7b4a2f68bda9f9dc4e36cb5c760e03fe5976942479e53d12d72
Jul 07 17:31:59.923719 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:31:59.923682    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fqbs7" event={"ID":"c91c2694-9a45-4410-8cd5-2eee6094827b","Type":"ContainerStarted","Data":"d7078e54ad6bb7b4a2f68bda9f9dc4e36cb5c760e03fe5976942479e53d12d72"}
Jul 07 17:32:02.938962 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:02.938918    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fqbs7" event={"ID":"c91c2694-9a45-4410-8cd5-2eee6094827b","Type":"ContainerStarted","Data":"743d5e3df3f925b2cb4c5640340111de6af1d58c9ef54838a176deae68159e71"}
Jul 07 17:32:30.464448 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.464387    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-fqbs7" podStartSLOduration=29.393585577 podStartE2EDuration="32.464367288s" totalImagesPullingTime="3.070781711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:32:02.958533569 +0000 UTC m=+252.721993416" watchObservedRunningTime="2026-07-07 17:32:30.464367288 +0000 UTC m=+280.227827135"
Jul 07 17:32:30.465946 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.465918    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"]
Jul 07 17:32:30.468330 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.468309    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:30.472277 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.472239    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:32:30.472408 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.472362    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 17:32:30.473932 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.473907    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 17:32:30.474041 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.473962    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 17:32:30.474150 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.474056    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 17:32:30.474150 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.474120    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mcc8t\""
Jul 07 17:32:30.480441 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.480419    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"]
Jul 07 17:32:30.551372 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.551338    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fb00a91-4ed0-4904-a380-39b231037406-cert\") pod \"lws-controller-manager-677d4664c8-cbzv9\" (UID: \"7fb00a91-4ed0-4904-a380-39b231037406\") " pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:30.551372 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.551375    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fb00a91-4ed0-4904-a380-39b231037406-metrics-cert\") pod \"lws-controller-manager-677d4664c8-cbzv9\" (UID: \"7fb00a91-4ed0-4904-a380-39b231037406\") " pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:30.551607 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.551407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4rhc\" (UniqueName: \"kubernetes.io/projected/7fb00a91-4ed0-4904-a380-39b231037406-kube-api-access-s4rhc\") pod \"lws-controller-manager-677d4664c8-cbzv9\" (UID: \"7fb00a91-4ed0-4904-a380-39b231037406\") " pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:30.551607 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.551499    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7fb00a91-4ed0-4904-a380-39b231037406-manager-config\") pod \"lws-controller-manager-677d4664c8-cbzv9\" (UID: \"7fb00a91-4ed0-4904-a380-39b231037406\") " pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:30.651952 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.651914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fb00a91-4ed0-4904-a380-39b231037406-cert\") pod \"lws-controller-manager-677d4664c8-cbzv9\" (UID: \"7fb00a91-4ed0-4904-a380-39b231037406\") " pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:30.652115 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.651960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fb00a91-4ed0-4904-a380-39b231037406-metrics-cert\") pod \"lws-controller-manager-677d4664c8-cbzv9\" (UID: \"7fb00a91-4ed0-4904-a380-39b231037406\") " pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:30.652115 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.652039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4rhc\" (UniqueName: \"kubernetes.io/projected/7fb00a91-4ed0-4904-a380-39b231037406-kube-api-access-s4rhc\") pod \"lws-controller-manager-677d4664c8-cbzv9\" (UID: \"7fb00a91-4ed0-4904-a380-39b231037406\") " pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:30.652115 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.652088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7fb00a91-4ed0-4904-a380-39b231037406-manager-config\") pod \"lws-controller-manager-677d4664c8-cbzv9\" (UID: \"7fb00a91-4ed0-4904-a380-39b231037406\") " pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:30.652713 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.652692    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7fb00a91-4ed0-4904-a380-39b231037406-manager-config\") pod \"lws-controller-manager-677d4664c8-cbzv9\" (UID: \"7fb00a91-4ed0-4904-a380-39b231037406\") " pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:30.654662 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.654631    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fb00a91-4ed0-4904-a380-39b231037406-cert\") pod \"lws-controller-manager-677d4664c8-cbzv9\" (UID: \"7fb00a91-4ed0-4904-a380-39b231037406\") " pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:30.654761 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.654698    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fb00a91-4ed0-4904-a380-39b231037406-metrics-cert\") pod \"lws-controller-manager-677d4664c8-cbzv9\" (UID: \"7fb00a91-4ed0-4904-a380-39b231037406\") " pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:30.663123 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.663096    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4rhc\" (UniqueName: \"kubernetes.io/projected/7fb00a91-4ed0-4904-a380-39b231037406-kube-api-access-s4rhc\") pod \"lws-controller-manager-677d4664c8-cbzv9\" (UID: \"7fb00a91-4ed0-4904-a380-39b231037406\") " pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:30.777816 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.777740    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:30.929613 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:30.929576    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"]
Jul 07 17:32:30.932843 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:32:30.932812    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb00a91_4ed0_4904_a380_39b231037406.slice/crio-483b9035515ab31b0aa839cfb3b01156d598e55f525a95764d14e59b712f465e WatchSource:0}: Error finding container 483b9035515ab31b0aa839cfb3b01156d598e55f525a95764d14e59b712f465e: Status 404 returned error can't find the container with id 483b9035515ab31b0aa839cfb3b01156d598e55f525a95764d14e59b712f465e
Jul 07 17:32:31.053805 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:31.053723    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9" event={"ID":"7fb00a91-4ed0-4904-a380-39b231037406","Type":"ContainerStarted","Data":"483b9035515ab31b0aa839cfb3b01156d598e55f525a95764d14e59b712f465e"}
Jul 07 17:32:34.067930 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:34.067883    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9" event={"ID":"7fb00a91-4ed0-4904-a380-39b231037406","Type":"ContainerStarted","Data":"cf7788cc3cb90060d8f10cc3988a67d1616488ce885b7b7f8c226ed69ab34d2d"}
Jul 07 17:32:34.068452 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:34.068043    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:34.093824 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:34.093772    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9" podStartSLOduration=1.786334157 podStartE2EDuration="4.093758818s" totalImagesPullingTime="2.307424661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:32:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:32:34.09187386 +0000 UTC m=+283.855333708" watchObservedRunningTime="2026-07-07 17:32:34.093758818 +0000 UTC m=+283.857218725"
Jul 07 17:32:37.477559 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.477521    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"]
Jul 07 17:32:37.482793 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.482772    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.487693 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.487667    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hbjds\""
Jul 07 17:32:37.487823 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.487671    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 17:32:37.488398 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.488377    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 17:32:37.488489 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.488415    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 17:32:37.488489 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.488432    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 17:32:37.511865 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.511835    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"]
Jul 07 17:32:37.611357 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.611320    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ddfe359-c8d0-4de5-9846-14e96588f64b-manifests\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.611538 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.611384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ddfe359-c8d0-4de5-9846-14e96588f64b-tmp\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.611538 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.611430    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ddfe359-c8d0-4de5-9846-14e96588f64b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.611538 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.611449    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgfv9\" (UniqueName: \"kubernetes.io/projected/5ddfe359-c8d0-4de5-9846-14e96588f64b-kube-api-access-rgfv9\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.611538 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.611516    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ddfe359-c8d0-4de5-9846-14e96588f64b-webhook-cert\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.712120 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.712080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ddfe359-c8d0-4de5-9846-14e96588f64b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.712120 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.712117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgfv9\" (UniqueName: \"kubernetes.io/projected/5ddfe359-c8d0-4de5-9846-14e96588f64b-kube-api-access-rgfv9\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.712428 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.712140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ddfe359-c8d0-4de5-9846-14e96588f64b-webhook-cert\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.712428 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.712176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ddfe359-c8d0-4de5-9846-14e96588f64b-manifests\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.712428 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.712214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ddfe359-c8d0-4de5-9846-14e96588f64b-tmp\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.712702 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.712679    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ddfe359-c8d0-4de5-9846-14e96588f64b-manifests\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.714730 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.714696    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ddfe359-c8d0-4de5-9846-14e96588f64b-tmp\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.714855 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.714774    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ddfe359-c8d0-4de5-9846-14e96588f64b-webhook-cert\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.714855 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.714812    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ddfe359-c8d0-4de5-9846-14e96588f64b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.724112 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.724082    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgfv9\" (UniqueName: \"kubernetes.io/projected/5ddfe359-c8d0-4de5-9846-14e96588f64b-kube-api-access-rgfv9\") pod \"opendatahub-operator-controller-manager-88cd6769f-w5k86\" (UID: \"5ddfe359-c8d0-4de5-9846-14e96588f64b\") " pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.792999 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.792894    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:37.944395 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:37.940785    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"]
Jul 07 17:32:37.947494 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:32:37.947471    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ddfe359_c8d0_4de5_9846_14e96588f64b.slice/crio-7bfeeef2181f026a128839da68ed3c43ade1c25233fe7c8cc472c8519d049a8c WatchSource:0}: Error finding container 7bfeeef2181f026a128839da68ed3c43ade1c25233fe7c8cc472c8519d049a8c: Status 404 returned error can't find the container with id 7bfeeef2181f026a128839da68ed3c43ade1c25233fe7c8cc472c8519d049a8c
Jul 07 17:32:38.084772 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:38.084742    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86" event={"ID":"5ddfe359-c8d0-4de5-9846-14e96588f64b","Type":"ContainerStarted","Data":"7bfeeef2181f026a128839da68ed3c43ade1c25233fe7c8cc472c8519d049a8c"}
Jul 07 17:32:41.099796 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:41.099757    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86" event={"ID":"5ddfe359-c8d0-4de5-9846-14e96588f64b","Type":"ContainerStarted","Data":"1122a7dc2e1e195d42b4e4e3009e2108490cafe7c3325ce8781fc90b4127d16d"}
Jul 07 17:32:42.104953 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:42.104913    2561 generic.go:356] "Generic (PLEG): container finished" podID="5ddfe359-c8d0-4de5-9846-14e96588f64b" containerID="1122a7dc2e1e195d42b4e4e3009e2108490cafe7c3325ce8781fc90b4127d16d" exitCode=0
Jul 07 17:32:42.104953 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:42.104955    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86" event={"ID":"5ddfe359-c8d0-4de5-9846-14e96588f64b","Type":"ContainerDied","Data":"1122a7dc2e1e195d42b4e4e3009e2108490cafe7c3325ce8781fc90b4127d16d"}
Jul 07 17:32:43.116221 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:43.116184    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86" event={"ID":"5ddfe359-c8d0-4de5-9846-14e96588f64b","Type":"ContainerStarted","Data":"49288e476e8709485fdf9c3c7c6d328b9acd1694e329b41e1e07c068849713c3"}
Jul 07 17:32:43.116609 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:43.116317    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:43.143019 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:43.142951    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86" podStartSLOduration=1.391501651 podStartE2EDuration="6.142921376s" totalImagesPullingTime="3.657536607s" totalInitContainerRuntime="1.093883118s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:32:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:32:43.141455797 +0000 UTC m=+292.904915663" watchObservedRunningTime="2026-07-07 17:32:43.142921376 +0000 UTC m=+292.906381223"
Jul 07 17:32:45.074219 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:45.074187    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-677d4664c8-cbzv9"
Jul 07 17:32:50.653992 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:50.653940    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 17:32:54.122113 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:54.122079    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-88cd6769f-w5k86"
Jul 07 17:32:57.491051 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.491008    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx"]
Jul 07 17:32:57.494808 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.494783    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx"
Jul 07 17:32:57.501075 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.501054    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 17:32:57.501225 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.501092    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 17:32:57.501225 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.501163    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 17:32:57.502036 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.501713    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 17:32:57.502327 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.502302    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pfhlb\""
Jul 07 17:32:57.516628 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.516592    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx"]
Jul 07 17:32:57.590394 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.590354    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp56x\" (UniqueName: \"kubernetes.io/projected/58e9691d-dc23-4529-9754-63c005a47313-kube-api-access-mp56x\") pod \"kube-auth-proxy-bbcb8bd4c-qckpx\" (UID: \"58e9691d-dc23-4529-9754-63c005a47313\") " pod="openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx"
Jul 07 17:32:57.590588 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.590411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58e9691d-dc23-4529-9754-63c005a47313-tmp\") pod \"kube-auth-proxy-bbcb8bd4c-qckpx\" (UID: \"58e9691d-dc23-4529-9754-63c005a47313\") " pod="openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx"
Jul 07 17:32:57.590588 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.590473    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e9691d-dc23-4529-9754-63c005a47313-tls-certs\") pod \"kube-auth-proxy-bbcb8bd4c-qckpx\" (UID: \"58e9691d-dc23-4529-9754-63c005a47313\") " pod="openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx"
Jul 07 17:32:57.691152 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.691108    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e9691d-dc23-4529-9754-63c005a47313-tls-certs\") pod \"kube-auth-proxy-bbcb8bd4c-qckpx\" (UID: \"58e9691d-dc23-4529-9754-63c005a47313\") " pod="openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx"
Jul 07 17:32:57.691358 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.691204    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp56x\" (UniqueName: \"kubernetes.io/projected/58e9691d-dc23-4529-9754-63c005a47313-kube-api-access-mp56x\") pod \"kube-auth-proxy-bbcb8bd4c-qckpx\" (UID: \"58e9691d-dc23-4529-9754-63c005a47313\") " pod="openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx"
Jul 07 17:32:57.691358 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.691241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58e9691d-dc23-4529-9754-63c005a47313-tmp\") pod \"kube-auth-proxy-bbcb8bd4c-qckpx\" (UID: \"58e9691d-dc23-4529-9754-63c005a47313\") " pod="openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx"
Jul 07 17:32:57.693549 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.693526    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58e9691d-dc23-4529-9754-63c005a47313-tmp\") pod \"kube-auth-proxy-bbcb8bd4c-qckpx\" (UID: \"58e9691d-dc23-4529-9754-63c005a47313\") " pod="openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx"
Jul 07 17:32:57.693786 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.693769    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e9691d-dc23-4529-9754-63c005a47313-tls-certs\") pod \"kube-auth-proxy-bbcb8bd4c-qckpx\" (UID: \"58e9691d-dc23-4529-9754-63c005a47313\") " pod="openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx"
Jul 07 17:32:57.701924 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.701900    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp56x\" (UniqueName: \"kubernetes.io/projected/58e9691d-dc23-4529-9754-63c005a47313-kube-api-access-mp56x\") pod \"kube-auth-proxy-bbcb8bd4c-qckpx\" (UID: \"58e9691d-dc23-4529-9754-63c005a47313\") " pod="openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx"
Jul 07 17:32:57.805587 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.805504    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx"
Jul 07 17:32:57.960624 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.960599    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx"]
Jul 07 17:32:57.963267 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:32:57.963237    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e9691d_dc23_4529_9754_63c005a47313.slice/crio-06a6b54ce085d74ff4894836e007dbd2a8f250788c195062dba898d2adeee2a8 WatchSource:0}: Error finding container 06a6b54ce085d74ff4894836e007dbd2a8f250788c195062dba898d2adeee2a8: Status 404 returned error can't find the container with id 06a6b54ce085d74ff4894836e007dbd2a8f250788c195062dba898d2adeee2a8
Jul 07 17:32:57.965110 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:57.965091    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:32:58.181407 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:32:58.181366    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx" event={"ID":"58e9691d-dc23-4529-9754-63c005a47313","Type":"ContainerStarted","Data":"06a6b54ce085d74ff4894836e007dbd2a8f250788c195062dba898d2adeee2a8"}
Jul 07 17:33:02.199639 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:02.199601    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx" event={"ID":"58e9691d-dc23-4529-9754-63c005a47313","Type":"ContainerStarted","Data":"cbcaa7b1825d3f08e99e4c2afd67e7edb84249fcb02271062567a497c573e22b"}
Jul 07 17:33:06.672726 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.672661    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-bbcb8bd4c-qckpx" podStartSLOduration=6.483252836 podStartE2EDuration="9.67263781s" totalImagesPullingTime="3.189384974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:33:02.224264053 +0000 UTC m=+311.987723901" watchObservedRunningTime="2026-07-07 17:33:06.67263781 +0000 UTC m=+316.436097657"
Jul 07 17:33:06.673812 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.673784    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"]
Jul 07 17:33:06.677432 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.677411    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.681012 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.680990    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 17:33:06.681012 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.681005    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9jnrp\""
Jul 07 17:33:06.695008 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.694958    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"]
Jul 07 17:33:06.778397 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.778359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.778397 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.778394    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.778633 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.778413    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.778633 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.778431    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.778633 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.778499    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.778633 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.778522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.778633 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.778592    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7npnn\" (UniqueName: \"kubernetes.io/projected/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-kube-api-access-7npnn\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.778815 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.778644    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.778815 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.778671    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.879695 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.879647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.879903 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.879706    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.879903 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.879735    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.879903 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.879758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.879903 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.879783    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.879903 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.879840    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.879903 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.879881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.880248 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.879921    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7npnn\" (UniqueName: \"kubernetes.io/projected/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-kube-api-access-7npnn\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.880248 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.880013    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.880248 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.880157    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.880392 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.880304    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.880454 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.880396    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.880623 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.880602    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.880695 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.880664    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.882239 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.882217    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.882637 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.882618    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.894179 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.894144    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7npnn\" (UniqueName: \"kubernetes.io/projected/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-kube-api-access-7npnn\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.896248 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.896220    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c89d460f-0b4c-4a93-bce4-05d0b9a2ace8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678kjwkc\" (UID: \"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:06.987954 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:06.987847    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:07.150224 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:07.150177    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"]
Jul 07 17:33:07.152838 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:33:07.152816    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc89d460f_0b4c_4a93_bce4_05d0b9a2ace8.slice/crio-677540647a7c1e15c8400519a0c5692ed731a18c9827191bf5f53c02cf03e515 WatchSource:0}: Error finding container 677540647a7c1e15c8400519a0c5692ed731a18c9827191bf5f53c02cf03e515: Status 404 returned error can't find the container with id 677540647a7c1e15c8400519a0c5692ed731a18c9827191bf5f53c02cf03e515
Jul 07 17:33:07.223604 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:07.223569    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc" event={"ID":"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8","Type":"ContainerStarted","Data":"677540647a7c1e15c8400519a0c5692ed731a18c9827191bf5f53c02cf03e515"}
Jul 07 17:33:09.682651 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:09.682612    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:33:09.682934 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:09.682693    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:33:09.682934 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:09.682734    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:33:10.239546 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:10.239509    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc" event={"ID":"c89d460f-0b4c-4a93-bce4-05d0b9a2ace8","Type":"ContainerStarted","Data":"251e203da073b3989a9c8d27412ff8b76932188dbdf8f53f8f84ec8fa21e6499"}
Jul 07 17:33:10.299850 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:10.299782    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc" podStartSLOduration=1.77224672 podStartE2EDuration="4.299753489s" totalImagesPullingTime="2.527506769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:33:10.290925868 +0000 UTC m=+320.054385739" watchObservedRunningTime="2026-07-07 17:33:10.299753489 +0000 UTC m=+320.063213335"
Jul 07 17:33:10.988727 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:10.988690    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:10.993745 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:10.993719    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:11.243718 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:11.243634    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:33:11.244796 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:33:11.244777    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678kjwkc"
Jul 07 17:34:35.382048 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:35.382013    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9tl45"]
Jul 07 17:34:35.385214 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:35.385196    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9tl45"
Jul 07 17:34:35.389547 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:35.389518    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 17:34:35.389547 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:35.389542    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 17:34:35.389746 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:35.389553    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 17:34:35.389746 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:35.389542    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6q6zl\""
Jul 07 17:34:35.404353 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:35.404322    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9tl45"]
Jul 07 17:34:35.485559 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:35.485518    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wrs6\" (UniqueName: \"kubernetes.io/projected/bb768db6-1216-4f11-9955-b44efb8497e5-kube-api-access-4wrs6\") pod \"dns-operator-controller-manager-864dd78c4c-9tl45\" (UID: \"bb768db6-1216-4f11-9955-b44efb8497e5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9tl45"
Jul 07 17:34:35.586219 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:35.586167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wrs6\" (UniqueName: \"kubernetes.io/projected/bb768db6-1216-4f11-9955-b44efb8497e5-kube-api-access-4wrs6\") pod \"dns-operator-controller-manager-864dd78c4c-9tl45\" (UID: \"bb768db6-1216-4f11-9955-b44efb8497e5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9tl45"
Jul 07 17:34:35.596226 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:35.596191    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wrs6\" (UniqueName: \"kubernetes.io/projected/bb768db6-1216-4f11-9955-b44efb8497e5-kube-api-access-4wrs6\") pod \"dns-operator-controller-manager-864dd78c4c-9tl45\" (UID: \"bb768db6-1216-4f11-9955-b44efb8497e5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9tl45"
Jul 07 17:34:35.695803 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:35.695713    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9tl45"
Jul 07 17:34:35.835741 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:35.835717    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9tl45"]
Jul 07 17:34:35.838132 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:34:35.838104    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb768db6_1216_4f11_9955_b44efb8497e5.slice/crio-6afbfb5bbb0281342f69c348f6c40feadd409503a94b53159da9b5d45708334d WatchSource:0}: Error finding container 6afbfb5bbb0281342f69c348f6c40feadd409503a94b53159da9b5d45708334d: Status 404 returned error can't find the container with id 6afbfb5bbb0281342f69c348f6c40feadd409503a94b53159da9b5d45708334d
Jul 07 17:34:36.619102 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:36.619068    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9tl45" event={"ID":"bb768db6-1216-4f11-9955-b44efb8497e5","Type":"ContainerStarted","Data":"6afbfb5bbb0281342f69c348f6c40feadd409503a94b53159da9b5d45708334d"}
Jul 07 17:34:38.630795 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:38.630759    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9tl45" event={"ID":"bb768db6-1216-4f11-9955-b44efb8497e5","Type":"ContainerStarted","Data":"b1b3e654ddbe5f41d2334d4c515711c479465b7f1535819cc80d85ee41bd7825"}
Jul 07 17:34:38.631292 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:38.630882    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9tl45"
Jul 07 17:34:38.657470 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:38.657393    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9tl45" podStartSLOduration=1.469990661 podStartE2EDuration="3.657377375s" totalImagesPullingTime="2.187386714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:34:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:34:38.655447246 +0000 UTC m=+408.418907091" watchObservedRunningTime="2026-07-07 17:34:38.657377375 +0000 UTC m=+408.420837199"
Jul 07 17:34:39.190475 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.190439    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"]
Jul 07 17:34:39.193822 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.193800    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"
Jul 07 17:34:39.196779 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.196760    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 07 17:34:39.196871 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.196820    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4ttxb\""
Jul 07 17:34:39.196871 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.196833    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 07 17:34:39.205593 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.205570    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"]
Jul 07 17:34:39.325461 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.325418    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j84f7\" (UniqueName: \"kubernetes.io/projected/9746c878-d06e-445e-a988-b273c33492da-kube-api-access-j84f7\") pod \"kuadrant-console-plugin-66b5774985-9dkps\" (UID: \"9746c878-d06e-445e-a988-b273c33492da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"
Jul 07 17:34:39.325640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.325488    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9746c878-d06e-445e-a988-b273c33492da-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9dkps\" (UID: \"9746c878-d06e-445e-a988-b273c33492da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"
Jul 07 17:34:39.325640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.325553    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9746c878-d06e-445e-a988-b273c33492da-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9dkps\" (UID: \"9746c878-d06e-445e-a988-b273c33492da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"
Jul 07 17:34:39.426389 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.426344    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9746c878-d06e-445e-a988-b273c33492da-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9dkps\" (UID: \"9746c878-d06e-445e-a988-b273c33492da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"
Jul 07 17:34:39.426598 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.426408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9746c878-d06e-445e-a988-b273c33492da-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9dkps\" (UID: \"9746c878-d06e-445e-a988-b273c33492da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"
Jul 07 17:34:39.426598 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.426462    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j84f7\" (UniqueName: \"kubernetes.io/projected/9746c878-d06e-445e-a988-b273c33492da-kube-api-access-j84f7\") pod \"kuadrant-console-plugin-66b5774985-9dkps\" (UID: \"9746c878-d06e-445e-a988-b273c33492da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"
Jul 07 17:34:39.426598 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:34:39.426499    2561 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 07 17:34:39.426754 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:34:39.426600    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9746c878-d06e-445e-a988-b273c33492da-plugin-serving-cert podName:9746c878-d06e-445e-a988-b273c33492da nodeName:}" failed. No retries permitted until 2026-07-07 17:34:39.92657665 +0000 UTC m=+409.690036477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/9746c878-d06e-445e-a988-b273c33492da-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9dkps" (UID: "9746c878-d06e-445e-a988-b273c33492da") : secret "plugin-serving-cert" not found
Jul 07 17:34:39.427096 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.427076    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9746c878-d06e-445e-a988-b273c33492da-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9dkps\" (UID: \"9746c878-d06e-445e-a988-b273c33492da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"
Jul 07 17:34:39.438812 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.438789    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j84f7\" (UniqueName: \"kubernetes.io/projected/9746c878-d06e-445e-a988-b273c33492da-kube-api-access-j84f7\") pod \"kuadrant-console-plugin-66b5774985-9dkps\" (UID: \"9746c878-d06e-445e-a988-b273c33492da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"
Jul 07 17:34:39.931548 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.931512    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9746c878-d06e-445e-a988-b273c33492da-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9dkps\" (UID: \"9746c878-d06e-445e-a988-b273c33492da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"
Jul 07 17:34:39.934120 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:39.934098    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9746c878-d06e-445e-a988-b273c33492da-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9dkps\" (UID: \"9746c878-d06e-445e-a988-b273c33492da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"
Jul 07 17:34:40.103528 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:40.103495    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"
Jul 07 17:34:40.241570 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:40.241545    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps"]
Jul 07 17:34:40.244472 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:34:40.244438    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9746c878_d06e_445e_a988_b273c33492da.slice/crio-2e715004727d2ab947512567f5902dcd596ff2c948def50d1ce8a62feb82a4c0 WatchSource:0}: Error finding container 2e715004727d2ab947512567f5902dcd596ff2c948def50d1ce8a62feb82a4c0: Status 404 returned error can't find the container with id 2e715004727d2ab947512567f5902dcd596ff2c948def50d1ce8a62feb82a4c0
Jul 07 17:34:40.641552 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:40.641517    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps" event={"ID":"9746c878-d06e-445e-a988-b273c33492da","Type":"ContainerStarted","Data":"2e715004727d2ab947512567f5902dcd596ff2c948def50d1ce8a62feb82a4c0"}
Jul 07 17:34:48.813188 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:48.813141    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"]
Jul 07 17:34:48.819145 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:48.818161    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:34:48.823303 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:48.823268    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4tcmv\""
Jul 07 17:34:48.830724 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:48.830698    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"]
Jul 07 17:34:48.921134 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:48.921098    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vkp6\" (UniqueName: \"kubernetes.io/projected/26840521-cc79-46cd-a6ba-55c1fc017b7f-kube-api-access-5vkp6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9c7sm\" (UID: \"26840521-cc79-46cd-a6ba-55c1fc017b7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:34:48.921347 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:48.921226    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26840521-cc79-46cd-a6ba-55c1fc017b7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9c7sm\" (UID: \"26840521-cc79-46cd-a6ba-55c1fc017b7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:34:49.022866 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.022831    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26840521-cc79-46cd-a6ba-55c1fc017b7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9c7sm\" (UID: \"26840521-cc79-46cd-a6ba-55c1fc017b7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:34:49.023084 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.022939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vkp6\" (UniqueName: \"kubernetes.io/projected/26840521-cc79-46cd-a6ba-55c1fc017b7f-kube-api-access-5vkp6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9c7sm\" (UID: \"26840521-cc79-46cd-a6ba-55c1fc017b7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:34:49.023295 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.023270    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26840521-cc79-46cd-a6ba-55c1fc017b7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9c7sm\" (UID: \"26840521-cc79-46cd-a6ba-55c1fc017b7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:34:49.033878 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.033850    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vkp6\" (UniqueName: \"kubernetes.io/projected/26840521-cc79-46cd-a6ba-55c1fc017b7f-kube-api-access-5vkp6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9c7sm\" (UID: \"26840521-cc79-46cd-a6ba-55c1fc017b7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:34:49.133308 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.133212    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:34:49.638614 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.638579    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9tl45"
Jul 07 17:34:49.653053 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.653018    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"]
Jul 07 17:34:49.659537 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.659501    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"]
Jul 07 17:34:49.682916 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.682874    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"]
Jul 07 17:34:49.688499 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.688474    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"
Jul 07 17:34:49.701230 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.701199    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"]
Jul 07 17:34:49.832539 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.832498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rpcd\" (UniqueName: \"kubernetes.io/projected/f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb-kube-api-access-4rpcd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fkbhm\" (UID: \"f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"
Jul 07 17:34:49.833000 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.832562    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fkbhm\" (UID: \"f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"
Jul 07 17:34:49.933494 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.933397    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fkbhm\" (UID: \"f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"
Jul 07 17:34:49.933672 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.933513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rpcd\" (UniqueName: \"kubernetes.io/projected/f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb-kube-api-access-4rpcd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fkbhm\" (UID: \"f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"
Jul 07 17:34:49.933853 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.933828    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fkbhm\" (UID: \"f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"
Jul 07 17:34:49.948666 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:49.948641    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rpcd\" (UniqueName: \"kubernetes.io/projected/f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb-kube-api-access-4rpcd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fkbhm\" (UID: \"f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"
Jul 07 17:34:50.007547 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:34:50.007496    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"
Jul 07 17:35:04.001000 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:04.000960    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"]
Jul 07 17:35:04.115905 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:35:04.115828    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8eac7c5_52e8_40a1_a9ea_0fd1c66f1dfb.slice/crio-d6036aa92275f3e6d70434c1fdcdae8610a2b63d1a863aeab68cf02514c4f8ce WatchSource:0}: Error finding container d6036aa92275f3e6d70434c1fdcdae8610a2b63d1a863aeab68cf02514c4f8ce: Status 404 returned error can't find the container with id d6036aa92275f3e6d70434c1fdcdae8610a2b63d1a863aeab68cf02514c4f8ce
Jul 07 17:35:04.767807 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:04.767722    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps" event={"ID":"9746c878-d06e-445e-a988-b273c33492da","Type":"ContainerStarted","Data":"97ce2125798a535beaed82d91ad3e161b4a542e58d4145b540de1f0cea6e9c38"}
Jul 07 17:35:04.769326 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:04.769298    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm" event={"ID":"f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb","Type":"ContainerStarted","Data":"d6036aa92275f3e6d70434c1fdcdae8610a2b63d1a863aeab68cf02514c4f8ce"}
Jul 07 17:35:04.791577 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:04.791521    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9dkps" podStartSLOduration=1.562180239 podStartE2EDuration="25.791497227s" totalImagesPullingTime="24.229316988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:35:04.790613217 +0000 UTC m=+434.554073065" watchObservedRunningTime="2026-07-07 17:35:04.791497227 +0000 UTC m=+434.554957076"
Jul 07 17:35:06.393453 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:35:06.393409    2561 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-9c7sm_kuadrant-system_26840521-cc79-46cd-a6ba-55c1fc017b7f_0(5544025dfdc32c071ae4b662e330d2fca074e0013eea0158764b874a438be928): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-9c7sm to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 07 17:35:06.393819 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:35:06.393478    2561 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-9c7sm_kuadrant-system_26840521-cc79-46cd-a6ba-55c1fc017b7f_0(5544025dfdc32c071ae4b662e330d2fca074e0013eea0158764b874a438be928): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-9c7sm to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:35:06.779869 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:06.779784    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:35:06.783028 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:35:06.782992    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9c7sm\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="26840521-cc79-46cd-a6ba-55c1fc017b7f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:35:06.787479 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:06.787455    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:35:06.790054 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:35:06.790017    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9c7sm\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="26840521-cc79-46cd-a6ba-55c1fc017b7f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:35:06.897694 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:06.897663    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26840521-cc79-46cd-a6ba-55c1fc017b7f-extensions-socket-volume\") pod \"26840521-cc79-46cd-a6ba-55c1fc017b7f\" (UID: \"26840521-cc79-46cd-a6ba-55c1fc017b7f\") "
Jul 07 17:35:06.897898 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:06.897755    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vkp6\" (UniqueName: \"kubernetes.io/projected/26840521-cc79-46cd-a6ba-55c1fc017b7f-kube-api-access-5vkp6\") pod \"26840521-cc79-46cd-a6ba-55c1fc017b7f\" (UID: \"26840521-cc79-46cd-a6ba-55c1fc017b7f\") "
Jul 07 17:35:06.897993 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:06.897941    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26840521-cc79-46cd-a6ba-55c1fc017b7f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "26840521-cc79-46cd-a6ba-55c1fc017b7f" (UID: "26840521-cc79-46cd-a6ba-55c1fc017b7f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:35:06.898076 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:06.898062    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26840521-cc79-46cd-a6ba-55c1fc017b7f-extensions-socket-volume\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:35:06.900004 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:06.899962    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26840521-cc79-46cd-a6ba-55c1fc017b7f-kube-api-access-5vkp6" (OuterVolumeSpecName: "kube-api-access-5vkp6") pod "26840521-cc79-46cd-a6ba-55c1fc017b7f" (UID: "26840521-cc79-46cd-a6ba-55c1fc017b7f"). InnerVolumeSpecName "kube-api-access-5vkp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:35:06.999111 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:06.999072    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vkp6\" (UniqueName: \"kubernetes.io/projected/26840521-cc79-46cd-a6ba-55c1fc017b7f-kube-api-access-5vkp6\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:35:07.785314 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:07.785275    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:35:07.788274 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:35:07.788241    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9c7sm\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="26840521-cc79-46cd-a6ba-55c1fc017b7f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:35:07.795879 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:35:07.795847    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9c7sm\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="26840521-cc79-46cd-a6ba-55c1fc017b7f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9c7sm"
Jul 07 17:35:08.811419 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:08.811378    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26840521-cc79-46cd-a6ba-55c1fc017b7f" path="/var/lib/kubelet/pods/26840521-cc79-46cd-a6ba-55c1fc017b7f/volumes"
Jul 07 17:35:10.800605 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:10.800493    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm" event={"ID":"f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb","Type":"ContainerStarted","Data":"0af7ac1bfc4b58f2a222a796cb7113eee4b5153da37268f2e8a6a7aa532ace2f"}
Jul 07 17:35:10.800605 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:10.800582    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"
Jul 07 17:35:10.825008 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:10.824924    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm" podStartSLOduration=16.221887439 podStartE2EDuration="21.824903086s" totalImagesPullingTime="5.603015647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:35:10.819552296 +0000 UTC m=+440.583012142" watchObservedRunningTime="2026-07-07 17:35:10.824903086 +0000 UTC m=+440.588362934"
Jul 07 17:35:21.807987 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:21.807939    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"
Jul 07 17:35:34.063318 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.063280    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"]
Jul 07 17:35:34.063851 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.063487    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm" podUID="f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb" containerName="manager" containerID="cri-o://0af7ac1bfc4b58f2a222a796cb7113eee4b5153da37268f2e8a6a7aa532ace2f" gracePeriod=10
Jul 07 17:35:34.320139 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.320069    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"
Jul 07 17:35:34.358563 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.358530    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rpcd\" (UniqueName: \"kubernetes.io/projected/f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb-kube-api-access-4rpcd\") pod \"f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb\" (UID: \"f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb\") "
Jul 07 17:35:34.358742 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.358607    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb-extensions-socket-volume\") pod \"f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb\" (UID: \"f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb\") "
Jul 07 17:35:34.359230 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.359197    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb" (UID: "f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:35:34.360930 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.360899    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb-kube-api-access-4rpcd" (OuterVolumeSpecName: "kube-api-access-4rpcd") pod "f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb" (UID: "f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb"). InnerVolumeSpecName "kube-api-access-4rpcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:35:34.459800 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.459763    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb-extensions-socket-volume\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:35:34.459800 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.459792    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rpcd\" (UniqueName: \"kubernetes.io/projected/f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb-kube-api-access-4rpcd\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:35:34.917407 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.917369    2561 generic.go:356] "Generic (PLEG): container finished" podID="f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb" containerID="0af7ac1bfc4b58f2a222a796cb7113eee4b5153da37268f2e8a6a7aa532ace2f" exitCode=0
Jul 07 17:35:34.917591 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.917424    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"
Jul 07 17:35:34.917591 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.917462    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm" event={"ID":"f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb","Type":"ContainerDied","Data":"0af7ac1bfc4b58f2a222a796cb7113eee4b5153da37268f2e8a6a7aa532ace2f"}
Jul 07 17:35:34.917591 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.917514    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm" event={"ID":"f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb","Type":"ContainerDied","Data":"d6036aa92275f3e6d70434c1fdcdae8610a2b63d1a863aeab68cf02514c4f8ce"}
Jul 07 17:35:34.917591 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.917535    2561 scope.go:117] "RemoveContainer" containerID="0af7ac1bfc4b58f2a222a796cb7113eee4b5153da37268f2e8a6a7aa532ace2f"
Jul 07 17:35:34.926194 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.926165    2561 scope.go:117] "RemoveContainer" containerID="0af7ac1bfc4b58f2a222a796cb7113eee4b5153da37268f2e8a6a7aa532ace2f"
Jul 07 17:35:34.926499 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:35:34.926479    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0af7ac1bfc4b58f2a222a796cb7113eee4b5153da37268f2e8a6a7aa532ace2f\": container with ID starting with 0af7ac1bfc4b58f2a222a796cb7113eee4b5153da37268f2e8a6a7aa532ace2f not found: ID does not exist" containerID="0af7ac1bfc4b58f2a222a796cb7113eee4b5153da37268f2e8a6a7aa532ace2f"
Jul 07 17:35:34.926548 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.926509    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0af7ac1bfc4b58f2a222a796cb7113eee4b5153da37268f2e8a6a7aa532ace2f"} err="failed to get container status \"0af7ac1bfc4b58f2a222a796cb7113eee4b5153da37268f2e8a6a7aa532ace2f\": rpc error: code = NotFound desc = could not find container \"0af7ac1bfc4b58f2a222a796cb7113eee4b5153da37268f2e8a6a7aa532ace2f\": container with ID starting with 0af7ac1bfc4b58f2a222a796cb7113eee4b5153da37268f2e8a6a7aa532ace2f not found: ID does not exist"
Jul 07 17:35:34.938601 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.938569    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"]
Jul 07 17:35:34.943778 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:34.943747    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fkbhm"]
Jul 07 17:35:36.809267 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:36.809237    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb" path="/var/lib/kubelet/pods/f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb/volumes"
Jul 07 17:35:38.237049 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.237006    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"]
Jul 07 17:35:38.237421 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.237359    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb" containerName="manager"
Jul 07 17:35:38.237421 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.237371    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb" containerName="manager"
Jul 07 17:35:38.237490 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.237442    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8eac7c5-52e8-40a1-a9ea-0fd1c66f1dfb" containerName="manager"
Jul 07 17:35:38.282691 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.282655    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"]
Jul 07 17:35:38.282858 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.282779    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.285727 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.285702    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-n4wcz\""
Jul 07 17:35:38.289498 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.289468    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.290136 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.290108    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.290301 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.290282    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.290468 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.290444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.290574 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.290483    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7vz6\" (UniqueName: \"kubernetes.io/projected/e5cbb00d-d555-480a-940c-46bcdca44c0e-kube-api-access-x7vz6\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.290574 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.290527    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cbb00d-d555-480a-940c-46bcdca44c0e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.290574 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.290558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.290710 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.290591    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cbb00d-d555-480a-940c-46bcdca44c0e-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.290710 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.290618    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cbb00d-d555-480a-940c-46bcdca44c0e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.391261 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.391219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.391261 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.391262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.391519 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.391287    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.391519 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.391312    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.391519 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.391339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7vz6\" (UniqueName: \"kubernetes.io/projected/e5cbb00d-d555-480a-940c-46bcdca44c0e-kube-api-access-x7vz6\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.391519 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.391377    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cbb00d-d555-480a-940c-46bcdca44c0e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.391519 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.391407    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.391519 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.391435    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cbb00d-d555-480a-940c-46bcdca44c0e-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.391809 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.391580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cbb00d-d555-480a-940c-46bcdca44c0e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.391891 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.391869    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.392060 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.392027    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.392176 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.392069    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.392176 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.392105    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.392295 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.392273    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cbb00d-d555-480a-940c-46bcdca44c0e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.394017 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.393994    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cbb00d-d555-480a-940c-46bcdca44c0e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.394121 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.394072    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cbb00d-d555-480a-940c-46bcdca44c0e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.402464 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.402437    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7vz6\" (UniqueName: \"kubernetes.io/projected/e5cbb00d-d555-480a-940c-46bcdca44c0e-kube-api-access-x7vz6\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.403926 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.403901    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cbb00d-d555-480a-940c-46bcdca44c0e-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6pjbv\" (UID: \"e5cbb00d-d555-480a-940c-46bcdca44c0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.593750 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.593718    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:38.733153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.733126    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"]
Jul 07 17:35:38.735693 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:35:38.735669    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5cbb00d_d555_480a_940c_46bcdca44c0e.slice/crio-3d0492665639e32390bee5a7147520d893e00648405ff1268aafb50dd49021b8 WatchSource:0}: Error finding container 3d0492665639e32390bee5a7147520d893e00648405ff1268aafb50dd49021b8: Status 404 returned error can't find the container with id 3d0492665639e32390bee5a7147520d893e00648405ff1268aafb50dd49021b8
Jul 07 17:35:38.737824 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.737795    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:35:38.737883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.737856    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:35:38.737924 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.737889    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:35:38.939870 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.939763    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv" event={"ID":"e5cbb00d-d555-480a-940c-46bcdca44c0e","Type":"ContainerStarted","Data":"50e7381183e5abd7995c1ea7971e9a9ac88e0a5ac881fc7c0ca1603530dff677"}
Jul 07 17:35:38.939870 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.939858    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv" event={"ID":"e5cbb00d-d555-480a-940c-46bcdca44c0e","Type":"ContainerStarted","Data":"3d0492665639e32390bee5a7147520d893e00648405ff1268aafb50dd49021b8"}
Jul 07 17:35:38.962168 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:38.962104    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv" podStartSLOduration=0.962083947 podStartE2EDuration="962.083947ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:35:38.961130507 +0000 UTC m=+468.724590355" watchObservedRunningTime="2026-07-07 17:35:38.962083947 +0000 UTC m=+468.725543794"
Jul 07 17:35:39.594227 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:39.594187    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:39.598704 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:39.598682    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:39.944635 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:39.944547    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:39.945656 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:39.945640    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:35:42.799109 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:42.799075    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-9w44d"]
Jul 07 17:35:42.814889 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:42.814864    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9w44d"
Jul 07 17:35:42.817381 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:42.817360    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mlkxs\""
Jul 07 17:35:42.821621 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:42.821596    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9w44d"]
Jul 07 17:35:42.830080 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:42.830044    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvgk8\" (UniqueName: \"kubernetes.io/projected/f4a39bd5-2781-4d0a-99b7-eeb7251246c7-kube-api-access-dvgk8\") pod \"authorino-58cd955675-9w44d\" (UID: \"f4a39bd5-2781-4d0a-99b7-eeb7251246c7\") " pod="kuadrant-system/authorino-58cd955675-9w44d"
Jul 07 17:35:42.931423 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:42.931395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvgk8\" (UniqueName: \"kubernetes.io/projected/f4a39bd5-2781-4d0a-99b7-eeb7251246c7-kube-api-access-dvgk8\") pod \"authorino-58cd955675-9w44d\" (UID: \"f4a39bd5-2781-4d0a-99b7-eeb7251246c7\") " pod="kuadrant-system/authorino-58cd955675-9w44d"
Jul 07 17:35:42.940472 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:42.940443    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvgk8\" (UniqueName: \"kubernetes.io/projected/f4a39bd5-2781-4d0a-99b7-eeb7251246c7-kube-api-access-dvgk8\") pod \"authorino-58cd955675-9w44d\" (UID: \"f4a39bd5-2781-4d0a-99b7-eeb7251246c7\") " pod="kuadrant-system/authorino-58cd955675-9w44d"
Jul 07 17:35:43.015299 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:43.015260    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-5p9ph"]
Jul 07 17:35:43.017460 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:43.017442    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5p9ph"
Jul 07 17:35:43.026405 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:43.026377    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5p9ph"]
Jul 07 17:35:43.032857 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:43.032817    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98c7h\" (UniqueName: \"kubernetes.io/projected/2d261cde-d752-45e6-abc9-52241ad99afa-kube-api-access-98c7h\") pod \"authorino-75d556bd77-5p9ph\" (UID: \"2d261cde-d752-45e6-abc9-52241ad99afa\") " pod="kuadrant-system/authorino-75d556bd77-5p9ph"
Jul 07 17:35:43.125253 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:43.125223    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9w44d"
Jul 07 17:35:43.139667 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:43.134236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98c7h\" (UniqueName: \"kubernetes.io/projected/2d261cde-d752-45e6-abc9-52241ad99afa-kube-api-access-98c7h\") pod \"authorino-75d556bd77-5p9ph\" (UID: \"2d261cde-d752-45e6-abc9-52241ad99afa\") " pod="kuadrant-system/authorino-75d556bd77-5p9ph"
Jul 07 17:35:43.143854 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:43.143822    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98c7h\" (UniqueName: \"kubernetes.io/projected/2d261cde-d752-45e6-abc9-52241ad99afa-kube-api-access-98c7h\") pod \"authorino-75d556bd77-5p9ph\" (UID: \"2d261cde-d752-45e6-abc9-52241ad99afa\") " pod="kuadrant-system/authorino-75d556bd77-5p9ph"
Jul 07 17:35:43.266240 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:43.266208    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9w44d"]
Jul 07 17:35:43.268355 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:35:43.268319    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4a39bd5_2781_4d0a_99b7_eeb7251246c7.slice/crio-c3e6412ff6147703aac23afb7f4c6755c0455f8c18128e218bd8e30a698c9e31 WatchSource:0}: Error finding container c3e6412ff6147703aac23afb7f4c6755c0455f8c18128e218bd8e30a698c9e31: Status 404 returned error can't find the container with id c3e6412ff6147703aac23afb7f4c6755c0455f8c18128e218bd8e30a698c9e31
Jul 07 17:35:43.328113 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:43.328071    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5p9ph"
Jul 07 17:35:43.466415 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:43.466385    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5p9ph"]
Jul 07 17:35:43.468925 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:35:43.468891    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d261cde_d752_45e6_abc9_52241ad99afa.slice/crio-68de7e1dc43b330bb8e72509d4c3553a5b521bb77c9933c917feff0bffb75470 WatchSource:0}: Error finding container 68de7e1dc43b330bb8e72509d4c3553a5b521bb77c9933c917feff0bffb75470: Status 404 returned error can't find the container with id 68de7e1dc43b330bb8e72509d4c3553a5b521bb77c9933c917feff0bffb75470
Jul 07 17:35:43.966186 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:43.966097    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9w44d" event={"ID":"f4a39bd5-2781-4d0a-99b7-eeb7251246c7","Type":"ContainerStarted","Data":"c3e6412ff6147703aac23afb7f4c6755c0455f8c18128e218bd8e30a698c9e31"}
Jul 07 17:35:43.968042 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:43.968006    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5p9ph" event={"ID":"2d261cde-d752-45e6-abc9-52241ad99afa","Type":"ContainerStarted","Data":"68de7e1dc43b330bb8e72509d4c3553a5b521bb77c9933c917feff0bffb75470"}
Jul 07 17:35:46.986918 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:46.986874    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9w44d" event={"ID":"f4a39bd5-2781-4d0a-99b7-eeb7251246c7","Type":"ContainerStarted","Data":"110f14c84cfc2c2752fccbec6bbecb80036f6a7c598627d3acac1b5a965eb7de"}
Jul 07 17:35:46.988310 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:46.988287    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5p9ph" event={"ID":"2d261cde-d752-45e6-abc9-52241ad99afa","Type":"ContainerStarted","Data":"405125f5b5bc0a852cf5d0a242f36d26d51a8ad1649c7d76a6b2bcce0a17f39e"}
Jul 07 17:35:47.004963 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:47.004913    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-9w44d" podStartSLOduration=1.611296454 podStartE2EDuration="5.004897465s" totalImagesPullingTime="3.393601011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:35:47.002794104 +0000 UTC m=+476.766253952" watchObservedRunningTime="2026-07-07 17:35:47.004897465 +0000 UTC m=+476.768357310"
Jul 07 17:35:47.021242 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:47.021155    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-5p9ph" podStartSLOduration=1.83412403 podStartE2EDuration="5.021133473s" totalImagesPullingTime="3.187009443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:35:47.02051652 +0000 UTC m=+476.783976367" watchObservedRunningTime="2026-07-07 17:35:47.021133473 +0000 UTC m=+476.784593320"
Jul 07 17:35:47.050640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:47.050597    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9w44d"]
Jul 07 17:35:48.997183 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:48.997137    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-9w44d" podUID="f4a39bd5-2781-4d0a-99b7-eeb7251246c7" containerName="authorino" containerID="cri-o://110f14c84cfc2c2752fccbec6bbecb80036f6a7c598627d3acac1b5a965eb7de" gracePeriod=30
Jul 07 17:35:49.247348 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:49.247285    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9w44d"
Jul 07 17:35:49.295364 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:49.295331    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvgk8\" (UniqueName: \"kubernetes.io/projected/f4a39bd5-2781-4d0a-99b7-eeb7251246c7-kube-api-access-dvgk8\") pod \"f4a39bd5-2781-4d0a-99b7-eeb7251246c7\" (UID: \"f4a39bd5-2781-4d0a-99b7-eeb7251246c7\") "
Jul 07 17:35:49.297530 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:49.297506    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4a39bd5-2781-4d0a-99b7-eeb7251246c7-kube-api-access-dvgk8" (OuterVolumeSpecName: "kube-api-access-dvgk8") pod "f4a39bd5-2781-4d0a-99b7-eeb7251246c7" (UID: "f4a39bd5-2781-4d0a-99b7-eeb7251246c7"). InnerVolumeSpecName "kube-api-access-dvgk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:35:49.396367 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:49.396329    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvgk8\" (UniqueName: \"kubernetes.io/projected/f4a39bd5-2781-4d0a-99b7-eeb7251246c7-kube-api-access-dvgk8\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:35:50.002916 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:50.002883    2561 generic.go:356] "Generic (PLEG): container finished" podID="f4a39bd5-2781-4d0a-99b7-eeb7251246c7" containerID="110f14c84cfc2c2752fccbec6bbecb80036f6a7c598627d3acac1b5a965eb7de" exitCode=0
Jul 07 17:35:50.003364 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:50.002923    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9w44d"
Jul 07 17:35:50.003364 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:50.002932    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9w44d" event={"ID":"f4a39bd5-2781-4d0a-99b7-eeb7251246c7","Type":"ContainerDied","Data":"110f14c84cfc2c2752fccbec6bbecb80036f6a7c598627d3acac1b5a965eb7de"}
Jul 07 17:35:50.003364 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:50.002998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9w44d" event={"ID":"f4a39bd5-2781-4d0a-99b7-eeb7251246c7","Type":"ContainerDied","Data":"c3e6412ff6147703aac23afb7f4c6755c0455f8c18128e218bd8e30a698c9e31"}
Jul 07 17:35:50.003364 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:50.003016    2561 scope.go:117] "RemoveContainer" containerID="110f14c84cfc2c2752fccbec6bbecb80036f6a7c598627d3acac1b5a965eb7de"
Jul 07 17:35:50.012536 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:50.012516    2561 scope.go:117] "RemoveContainer" containerID="110f14c84cfc2c2752fccbec6bbecb80036f6a7c598627d3acac1b5a965eb7de"
Jul 07 17:35:50.012844 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:35:50.012826    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"110f14c84cfc2c2752fccbec6bbecb80036f6a7c598627d3acac1b5a965eb7de\": container with ID starting with 110f14c84cfc2c2752fccbec6bbecb80036f6a7c598627d3acac1b5a965eb7de not found: ID does not exist" containerID="110f14c84cfc2c2752fccbec6bbecb80036f6a7c598627d3acac1b5a965eb7de"
Jul 07 17:35:50.012891 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:50.012853    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"110f14c84cfc2c2752fccbec6bbecb80036f6a7c598627d3acac1b5a965eb7de"} err="failed to get container status \"110f14c84cfc2c2752fccbec6bbecb80036f6a7c598627d3acac1b5a965eb7de\": rpc error: code = NotFound desc = could not find container \"110f14c84cfc2c2752fccbec6bbecb80036f6a7c598627d3acac1b5a965eb7de\": container with ID starting with 110f14c84cfc2c2752fccbec6bbecb80036f6a7c598627d3acac1b5a965eb7de not found: ID does not exist"
Jul 07 17:35:50.026123 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:50.026074    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9w44d"]
Jul 07 17:35:50.032549 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:50.032515    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-9w44d"]
Jul 07 17:35:50.810031 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:35:50.809994    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4a39bd5-2781-4d0a-99b7-eeb7251246c7" path="/var/lib/kubelet/pods/f4a39bd5-2781-4d0a-99b7-eeb7251246c7/volumes"
Jul 07 17:36:13.813031 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:13.810322    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dsrnb"]
Jul 07 17:36:13.813031 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:13.811155    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4a39bd5-2781-4d0a-99b7-eeb7251246c7" containerName="authorino"
Jul 07 17:36:13.813031 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:13.811175    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4a39bd5-2781-4d0a-99b7-eeb7251246c7" containerName="authorino"
Jul 07 17:36:13.813031 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:13.811324    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4a39bd5-2781-4d0a-99b7-eeb7251246c7" containerName="authorino"
Jul 07 17:36:13.815414 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:13.815385    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dsrnb"
Jul 07 17:36:13.820808 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:13.820781    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dsrnb"]
Jul 07 17:36:13.924310 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:13.924272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4b26\" (UniqueName: \"kubernetes.io/projected/2e8dccc6-2d09-4a18-ab0b-27078aa7b16b-kube-api-access-q4b26\") pod \"authorino-5d4b67c446-dsrnb\" (UID: \"2e8dccc6-2d09-4a18-ab0b-27078aa7b16b\") " pod="kuadrant-system/authorino-5d4b67c446-dsrnb"
Jul 07 17:36:14.025293 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.025258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4b26\" (UniqueName: \"kubernetes.io/projected/2e8dccc6-2d09-4a18-ab0b-27078aa7b16b-kube-api-access-q4b26\") pod \"authorino-5d4b67c446-dsrnb\" (UID: \"2e8dccc6-2d09-4a18-ab0b-27078aa7b16b\") " pod="kuadrant-system/authorino-5d4b67c446-dsrnb"
Jul 07 17:36:14.037852 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.037822    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4b26\" (UniqueName: \"kubernetes.io/projected/2e8dccc6-2d09-4a18-ab0b-27078aa7b16b-kube-api-access-q4b26\") pod \"authorino-5d4b67c446-dsrnb\" (UID: \"2e8dccc6-2d09-4a18-ab0b-27078aa7b16b\") " pod="kuadrant-system/authorino-5d4b67c446-dsrnb"
Jul 07 17:36:14.060691 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.060660    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dsrnb"]
Jul 07 17:36:14.060943 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.060931    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dsrnb"
Jul 07 17:36:14.090546 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.090513    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57c4b77849-g9fsp"]
Jul 07 17:36:14.095067 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.095041    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c4b77849-g9fsp"
Jul 07 17:36:14.105878 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.105847    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57c4b77849-g9fsp"]
Jul 07 17:36:14.199835 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.199808    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dsrnb"]
Jul 07 17:36:14.202291 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:36:14.202261    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e8dccc6_2d09_4a18_ab0b_27078aa7b16b.slice/crio-5b618774955ad003a3a20442ff519a8093fc835168360bb1ca164172df564462 WatchSource:0}: Error finding container 5b618774955ad003a3a20442ff519a8093fc835168360bb1ca164172df564462: Status 404 returned error can't find the container with id 5b618774955ad003a3a20442ff519a8093fc835168360bb1ca164172df564462
Jul 07 17:36:14.211423 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.211394    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57c4b77849-g9fsp"]
Jul 07 17:36:14.211696 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:36:14.211678    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rg8s8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-57c4b77849-g9fsp" podUID="b2b6376f-45fe-4b01-a678-2fa58b51c508"
Jul 07 17:36:14.227714 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.227685    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg8s8\" (UniqueName: \"kubernetes.io/projected/b2b6376f-45fe-4b01-a678-2fa58b51c508-kube-api-access-rg8s8\") pod \"authorino-57c4b77849-g9fsp\" (UID: \"b2b6376f-45fe-4b01-a678-2fa58b51c508\") " pod="kuadrant-system/authorino-57c4b77849-g9fsp"
Jul 07 17:36:14.238487 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.238458    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7db76b7d77-5qtnj"]
Jul 07 17:36:14.241614 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.241597    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7db76b7d77-5qtnj"
Jul 07 17:36:14.244042 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.244019    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 17:36:14.250372 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.250341    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7db76b7d77-5qtnj"]
Jul 07 17:36:14.328814 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.328722    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg8s8\" (UniqueName: \"kubernetes.io/projected/b2b6376f-45fe-4b01-a678-2fa58b51c508-kube-api-access-rg8s8\") pod \"authorino-57c4b77849-g9fsp\" (UID: \"b2b6376f-45fe-4b01-a678-2fa58b51c508\") " pod="kuadrant-system/authorino-57c4b77849-g9fsp"
Jul 07 17:36:14.339017 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.338989    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg8s8\" (UniqueName: \"kubernetes.io/projected/b2b6376f-45fe-4b01-a678-2fa58b51c508-kube-api-access-rg8s8\") pod \"authorino-57c4b77849-g9fsp\" (UID: \"b2b6376f-45fe-4b01-a678-2fa58b51c508\") " pod="kuadrant-system/authorino-57c4b77849-g9fsp"
Jul 07 17:36:14.429752 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.429716    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8da31106-a831-4a64-bd03-7e9f42bd4b45-tls-cert\") pod \"authorino-7db76b7d77-5qtnj\" (UID: \"8da31106-a831-4a64-bd03-7e9f42bd4b45\") " pod="kuadrant-system/authorino-7db76b7d77-5qtnj"
Jul 07 17:36:14.429962 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.429767    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v64gf\" (UniqueName: \"kubernetes.io/projected/8da31106-a831-4a64-bd03-7e9f42bd4b45-kube-api-access-v64gf\") pod \"authorino-7db76b7d77-5qtnj\" (UID: \"8da31106-a831-4a64-bd03-7e9f42bd4b45\") " pod="kuadrant-system/authorino-7db76b7d77-5qtnj"
Jul 07 17:36:14.530903 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.530874    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8da31106-a831-4a64-bd03-7e9f42bd4b45-tls-cert\") pod \"authorino-7db76b7d77-5qtnj\" (UID: \"8da31106-a831-4a64-bd03-7e9f42bd4b45\") " pod="kuadrant-system/authorino-7db76b7d77-5qtnj"
Jul 07 17:36:14.531072 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.530922    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v64gf\" (UniqueName: \"kubernetes.io/projected/8da31106-a831-4a64-bd03-7e9f42bd4b45-kube-api-access-v64gf\") pod \"authorino-7db76b7d77-5qtnj\" (UID: \"8da31106-a831-4a64-bd03-7e9f42bd4b45\") " pod="kuadrant-system/authorino-7db76b7d77-5qtnj"
Jul 07 17:36:14.533438 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.533410    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8da31106-a831-4a64-bd03-7e9f42bd4b45-tls-cert\") pod \"authorino-7db76b7d77-5qtnj\" (UID: \"8da31106-a831-4a64-bd03-7e9f42bd4b45\") " pod="kuadrant-system/authorino-7db76b7d77-5qtnj"
Jul 07 17:36:14.540304 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.540280    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v64gf\" (UniqueName: \"kubernetes.io/projected/8da31106-a831-4a64-bd03-7e9f42bd4b45-kube-api-access-v64gf\") pod \"authorino-7db76b7d77-5qtnj\" (UID: \"8da31106-a831-4a64-bd03-7e9f42bd4b45\") " pod="kuadrant-system/authorino-7db76b7d77-5qtnj"
Jul 07 17:36:14.551805 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.551782    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7db76b7d77-5qtnj"
Jul 07 17:36:14.699130 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:14.699077    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7db76b7d77-5qtnj"]
Jul 07 17:36:14.701766 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:36:14.701736    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8da31106_a831_4a64_bd03_7e9f42bd4b45.slice/crio-79698e20ecac9b7d7291413f1647930edfad3e65f2c0d232ddb90e297dd6288c WatchSource:0}: Error finding container 79698e20ecac9b7d7291413f1647930edfad3e65f2c0d232ddb90e297dd6288c: Status 404 returned error can't find the container with id 79698e20ecac9b7d7291413f1647930edfad3e65f2c0d232ddb90e297dd6288c
Jul 07 17:36:15.114129 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:15.114093    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7db76b7d77-5qtnj" event={"ID":"8da31106-a831-4a64-bd03-7e9f42bd4b45","Type":"ContainerStarted","Data":"79698e20ecac9b7d7291413f1647930edfad3e65f2c0d232ddb90e297dd6288c"}
Jul 07 17:36:15.115547 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:15.115530    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c4b77849-g9fsp"
Jul 07 17:36:15.115612 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:15.115530    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dsrnb" event={"ID":"2e8dccc6-2d09-4a18-ab0b-27078aa7b16b","Type":"ContainerStarted","Data":"c449ee9c2d3d43506529d5415b37f4104383de868a1f2091620ab6ce49dfb529"}
Jul 07 17:36:15.115612 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:15.115578    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dsrnb" event={"ID":"2e8dccc6-2d09-4a18-ab0b-27078aa7b16b","Type":"ContainerStarted","Data":"5b618774955ad003a3a20442ff519a8093fc835168360bb1ca164172df564462"}
Jul 07 17:36:15.115682 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:15.115595    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-dsrnb" podUID="2e8dccc6-2d09-4a18-ab0b-27078aa7b16b" containerName="authorino" containerID="cri-o://c449ee9c2d3d43506529d5415b37f4104383de868a1f2091620ab6ce49dfb529" gracePeriod=30
Jul 07 17:36:15.123993 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:15.123953    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c4b77849-g9fsp"
Jul 07 17:36:15.133080 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:15.133035    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-dsrnb" podStartSLOduration=1.832923649 podStartE2EDuration="2.133018905s" totalImagesPullingTime="300.095256ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:15.132152973 +0000 UTC m=+504.895612820" watchObservedRunningTime="2026-07-07 17:36:15.133018905 +0000 UTC m=+504.896478788"
Jul 07 17:36:15.236736 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:15.236709    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg8s8\" (UniqueName: \"kubernetes.io/projected/b2b6376f-45fe-4b01-a678-2fa58b51c508-kube-api-access-rg8s8\") pod \"b2b6376f-45fe-4b01-a678-2fa58b51c508\" (UID: \"b2b6376f-45fe-4b01-a678-2fa58b51c508\") "
Jul 07 17:36:15.238689 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:15.238658    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2b6376f-45fe-4b01-a678-2fa58b51c508-kube-api-access-rg8s8" (OuterVolumeSpecName: "kube-api-access-rg8s8") pod "b2b6376f-45fe-4b01-a678-2fa58b51c508" (UID: "b2b6376f-45fe-4b01-a678-2fa58b51c508"). InnerVolumeSpecName "kube-api-access-rg8s8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:36:15.338465 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:15.338433    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg8s8\" (UniqueName: \"kubernetes.io/projected/b2b6376f-45fe-4b01-a678-2fa58b51c508-kube-api-access-rg8s8\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:36:15.369271 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:15.369205    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dsrnb"
Jul 07 17:36:15.540566 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:15.540522    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4b26\" (UniqueName: \"kubernetes.io/projected/2e8dccc6-2d09-4a18-ab0b-27078aa7b16b-kube-api-access-q4b26\") pod \"2e8dccc6-2d09-4a18-ab0b-27078aa7b16b\" (UID: \"2e8dccc6-2d09-4a18-ab0b-27078aa7b16b\") "
Jul 07 17:36:15.542732 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:15.542706    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e8dccc6-2d09-4a18-ab0b-27078aa7b16b-kube-api-access-q4b26" (OuterVolumeSpecName: "kube-api-access-q4b26") pod "2e8dccc6-2d09-4a18-ab0b-27078aa7b16b" (UID: "2e8dccc6-2d09-4a18-ab0b-27078aa7b16b"). InnerVolumeSpecName "kube-api-access-q4b26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:36:15.641725 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:15.641644    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4b26\" (UniqueName: \"kubernetes.io/projected/2e8dccc6-2d09-4a18-ab0b-27078aa7b16b-kube-api-access-q4b26\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:36:16.121556 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.121518    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7db76b7d77-5qtnj" event={"ID":"8da31106-a831-4a64-bd03-7e9f42bd4b45","Type":"ContainerStarted","Data":"e30c3959f809e9c5d221be01e765e5dc27545f6e280c8fdddd8f99fb3d5cb343"}
Jul 07 17:36:16.122839 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.122809    2561 generic.go:356] "Generic (PLEG): container finished" podID="2e8dccc6-2d09-4a18-ab0b-27078aa7b16b" containerID="c449ee9c2d3d43506529d5415b37f4104383de868a1f2091620ab6ce49dfb529" exitCode=0
Jul 07 17:36:16.122956 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.122847    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dsrnb"
Jul 07 17:36:16.122956 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.122894    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dsrnb" event={"ID":"2e8dccc6-2d09-4a18-ab0b-27078aa7b16b","Type":"ContainerDied","Data":"c449ee9c2d3d43506529d5415b37f4104383de868a1f2091620ab6ce49dfb529"}
Jul 07 17:36:16.122956 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.122934    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dsrnb" event={"ID":"2e8dccc6-2d09-4a18-ab0b-27078aa7b16b","Type":"ContainerDied","Data":"5b618774955ad003a3a20442ff519a8093fc835168360bb1ca164172df564462"}
Jul 07 17:36:16.122956 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.122956    2561 scope.go:117] "RemoveContainer" containerID="c449ee9c2d3d43506529d5415b37f4104383de868a1f2091620ab6ce49dfb529"
Jul 07 17:36:16.123200 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.123027    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c4b77849-g9fsp"
Jul 07 17:36:16.132303 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.132278    2561 scope.go:117] "RemoveContainer" containerID="c449ee9c2d3d43506529d5415b37f4104383de868a1f2091620ab6ce49dfb529"
Jul 07 17:36:16.132629 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:36:16.132607    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c449ee9c2d3d43506529d5415b37f4104383de868a1f2091620ab6ce49dfb529\": container with ID starting with c449ee9c2d3d43506529d5415b37f4104383de868a1f2091620ab6ce49dfb529 not found: ID does not exist" containerID="c449ee9c2d3d43506529d5415b37f4104383de868a1f2091620ab6ce49dfb529"
Jul 07 17:36:16.132700 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.132637    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c449ee9c2d3d43506529d5415b37f4104383de868a1f2091620ab6ce49dfb529"} err="failed to get container status \"c449ee9c2d3d43506529d5415b37f4104383de868a1f2091620ab6ce49dfb529\": rpc error: code = NotFound desc = could not find container \"c449ee9c2d3d43506529d5415b37f4104383de868a1f2091620ab6ce49dfb529\": container with ID starting with c449ee9c2d3d43506529d5415b37f4104383de868a1f2091620ab6ce49dfb529 not found: ID does not exist"
Jul 07 17:36:16.140829 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.140776    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7db76b7d77-5qtnj" podStartSLOduration=1.614583016 podStartE2EDuration="2.140762168s" totalImagesPullingTime="526.179152ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:16.139084538 +0000 UTC m=+505.902544384" watchObservedRunningTime="2026-07-07 17:36:16.140762168 +0000 UTC m=+505.904222013"
Jul 07 17:36:16.156429 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.156395    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dsrnb"]
Jul 07 17:36:16.159011 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.158983    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dsrnb"]
Jul 07 17:36:16.169209 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.169177    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5p9ph"]
Jul 07 17:36:16.169427 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.169400    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-5p9ph" podUID="2d261cde-d752-45e6-abc9-52241ad99afa" containerName="authorino" containerID="cri-o://405125f5b5bc0a852cf5d0a242f36d26d51a8ad1649c7d76a6b2bcce0a17f39e" gracePeriod=30
Jul 07 17:36:16.185120 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.185082    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57c4b77849-g9fsp"]
Jul 07 17:36:16.194303 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.194270    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57c4b77849-g9fsp"]
Jul 07 17:36:16.440295 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.440270    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5p9ph"
Jul 07 17:36:16.551178 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.551134    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98c7h\" (UniqueName: \"kubernetes.io/projected/2d261cde-d752-45e6-abc9-52241ad99afa-kube-api-access-98c7h\") pod \"2d261cde-d752-45e6-abc9-52241ad99afa\" (UID: \"2d261cde-d752-45e6-abc9-52241ad99afa\") "
Jul 07 17:36:16.553398 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.553369    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d261cde-d752-45e6-abc9-52241ad99afa-kube-api-access-98c7h" (OuterVolumeSpecName: "kube-api-access-98c7h") pod "2d261cde-d752-45e6-abc9-52241ad99afa" (UID: "2d261cde-d752-45e6-abc9-52241ad99afa"). InnerVolumeSpecName "kube-api-access-98c7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:36:16.652591 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.652498    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98c7h\" (UniqueName: \"kubernetes.io/projected/2d261cde-d752-45e6-abc9-52241ad99afa-kube-api-access-98c7h\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:36:16.815206 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.815171    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e8dccc6-2d09-4a18-ab0b-27078aa7b16b" path="/var/lib/kubelet/pods/2e8dccc6-2d09-4a18-ab0b-27078aa7b16b/volumes"
Jul 07 17:36:16.815576 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:16.815556    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2b6376f-45fe-4b01-a678-2fa58b51c508" path="/var/lib/kubelet/pods/b2b6376f-45fe-4b01-a678-2fa58b51c508/volumes"
Jul 07 17:36:17.128235 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:17.128194    2561 generic.go:356] "Generic (PLEG): container finished" podID="2d261cde-d752-45e6-abc9-52241ad99afa" containerID="405125f5b5bc0a852cf5d0a242f36d26d51a8ad1649c7d76a6b2bcce0a17f39e" exitCode=0
Jul 07 17:36:17.128716 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:17.128258    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5p9ph"
Jul 07 17:36:17.128716 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:17.128285    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5p9ph" event={"ID":"2d261cde-d752-45e6-abc9-52241ad99afa","Type":"ContainerDied","Data":"405125f5b5bc0a852cf5d0a242f36d26d51a8ad1649c7d76a6b2bcce0a17f39e"}
Jul 07 17:36:17.128716 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:17.128330    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5p9ph" event={"ID":"2d261cde-d752-45e6-abc9-52241ad99afa","Type":"ContainerDied","Data":"68de7e1dc43b330bb8e72509d4c3553a5b521bb77c9933c917feff0bffb75470"}
Jul 07 17:36:17.128716 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:17.128349    2561 scope.go:117] "RemoveContainer" containerID="405125f5b5bc0a852cf5d0a242f36d26d51a8ad1649c7d76a6b2bcce0a17f39e"
Jul 07 17:36:17.137053 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:17.137030    2561 scope.go:117] "RemoveContainer" containerID="405125f5b5bc0a852cf5d0a242f36d26d51a8ad1649c7d76a6b2bcce0a17f39e"
Jul 07 17:36:17.137384 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:36:17.137363    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"405125f5b5bc0a852cf5d0a242f36d26d51a8ad1649c7d76a6b2bcce0a17f39e\": container with ID starting with 405125f5b5bc0a852cf5d0a242f36d26d51a8ad1649c7d76a6b2bcce0a17f39e not found: ID does not exist" containerID="405125f5b5bc0a852cf5d0a242f36d26d51a8ad1649c7d76a6b2bcce0a17f39e"
Jul 07 17:36:17.137467 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:17.137392    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"405125f5b5bc0a852cf5d0a242f36d26d51a8ad1649c7d76a6b2bcce0a17f39e"} err="failed to get container status \"405125f5b5bc0a852cf5d0a242f36d26d51a8ad1649c7d76a6b2bcce0a17f39e\": rpc error: code = NotFound desc = could not find container \"405125f5b5bc0a852cf5d0a242f36d26d51a8ad1649c7d76a6b2bcce0a17f39e\": container with ID starting with 405125f5b5bc0a852cf5d0a242f36d26d51a8ad1649c7d76a6b2bcce0a17f39e not found: ID does not exist"
Jul 07 17:36:17.146822 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:17.146791    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5p9ph"]
Jul 07 17:36:17.151365 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:17.151330    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5p9ph"]
Jul 07 17:36:18.811081 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:18.811040    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d261cde-d752-45e6-abc9-52241ad99afa" path="/var/lib/kubelet/pods/2d261cde-d752-45e6-abc9-52241ad99afa/volumes"
Jul 07 17:36:20.638225 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.638184    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5df8fc765-mqkns"]
Jul 07 17:36:20.638800 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.638724    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e8dccc6-2d09-4a18-ab0b-27078aa7b16b" containerName="authorino"
Jul 07 17:36:20.638800 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.638788    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e8dccc6-2d09-4a18-ab0b-27078aa7b16b" containerName="authorino"
Jul 07 17:36:20.638933 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.638816    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d261cde-d752-45e6-abc9-52241ad99afa" containerName="authorino"
Jul 07 17:36:20.638933 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.638824    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d261cde-d752-45e6-abc9-52241ad99afa" containerName="authorino"
Jul 07 17:36:20.639065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.638939    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e8dccc6-2d09-4a18-ab0b-27078aa7b16b" containerName="authorino"
Jul 07 17:36:20.639065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.638952    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d261cde-d752-45e6-abc9-52241ad99afa" containerName="authorino"
Jul 07 17:36:20.643508 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.643484    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df8fc765-mqkns"
Jul 07 17:36:20.646251 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.646225    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 17:36:20.646251 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.646249    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rnj5p\""
Jul 07 17:36:20.646428 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.646297    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 17:36:20.652784 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.652757    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df8fc765-mqkns"]
Jul 07 17:36:20.686737 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.686705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6fhn\" (UniqueName: \"kubernetes.io/projected/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-kube-api-access-w6fhn\") pod \"maas-controller-5df8fc765-mqkns\" (UID: \"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1\") " pod="opendatahub/maas-controller-5df8fc765-mqkns"
Jul 07 17:36:20.686956 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.686776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-webhook-cert\") pod \"maas-controller-5df8fc765-mqkns\" (UID: \"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1\") " pod="opendatahub/maas-controller-5df8fc765-mqkns"
Jul 07 17:36:20.787385 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.787348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6fhn\" (UniqueName: \"kubernetes.io/projected/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-kube-api-access-w6fhn\") pod \"maas-controller-5df8fc765-mqkns\" (UID: \"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1\") " pod="opendatahub/maas-controller-5df8fc765-mqkns"
Jul 07 17:36:20.787569 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.787413    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-webhook-cert\") pod \"maas-controller-5df8fc765-mqkns\" (UID: \"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1\") " pod="opendatahub/maas-controller-5df8fc765-mqkns"
Jul 07 17:36:20.787569 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:36:20.787505    2561 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 07 17:36:20.787569 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:36:20.787567    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-webhook-cert podName:4f250d22-668c-4d6f-bccb-ed3e8e56ebe1 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:21.287550557 +0000 UTC m=+511.051010381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-webhook-cert") pod "maas-controller-5df8fc765-mqkns" (UID: "4f250d22-668c-4d6f-bccb-ed3e8e56ebe1") : secret "maas-controller-webhook-cert" not found
Jul 07 17:36:20.796862 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.796829    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6fhn\" (UniqueName: \"kubernetes.io/projected/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-kube-api-access-w6fhn\") pod \"maas-controller-5df8fc765-mqkns\" (UID: \"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1\") " pod="opendatahub/maas-controller-5df8fc765-mqkns"
Jul 07 17:36:20.831884 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.831848    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c5bb8b8df-wxvc4"]
Jul 07 17:36:20.834322 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.834302    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4"
Jul 07 17:36:20.850919 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.850886    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c5bb8b8df-wxvc4"]
Jul 07 17:36:20.888662 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.888568    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78hzw\" (UniqueName: \"kubernetes.io/projected/042fcae6-0a70-4647-aa9a-eab5a4dd1497-kube-api-access-78hzw\") pod \"maas-controller-6c5bb8b8df-wxvc4\" (UID: \"042fcae6-0a70-4647-aa9a-eab5a4dd1497\") " pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4"
Jul 07 17:36:20.888662 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.888604    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/042fcae6-0a70-4647-aa9a-eab5a4dd1497-webhook-cert\") pod \"maas-controller-6c5bb8b8df-wxvc4\" (UID: \"042fcae6-0a70-4647-aa9a-eab5a4dd1497\") " pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4"
Jul 07 17:36:20.989932 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.989897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78hzw\" (UniqueName: \"kubernetes.io/projected/042fcae6-0a70-4647-aa9a-eab5a4dd1497-kube-api-access-78hzw\") pod \"maas-controller-6c5bb8b8df-wxvc4\" (UID: \"042fcae6-0a70-4647-aa9a-eab5a4dd1497\") " pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4"
Jul 07 17:36:20.989932 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.989938    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/042fcae6-0a70-4647-aa9a-eab5a4dd1497-webhook-cert\") pod \"maas-controller-6c5bb8b8df-wxvc4\" (UID: \"042fcae6-0a70-4647-aa9a-eab5a4dd1497\") " pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4"
Jul 07 17:36:20.990166 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:36:20.990129    2561 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 07 17:36:20.990225 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:36:20.990214    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042fcae6-0a70-4647-aa9a-eab5a4dd1497-webhook-cert podName:042fcae6-0a70-4647-aa9a-eab5a4dd1497 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:21.490192659 +0000 UTC m=+511.253652484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/042fcae6-0a70-4647-aa9a-eab5a4dd1497-webhook-cert") pod "maas-controller-6c5bb8b8df-wxvc4" (UID: "042fcae6-0a70-4647-aa9a-eab5a4dd1497") : secret "maas-controller-webhook-cert" not found
Jul 07 17:36:20.999812 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:20.999785    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78hzw\" (UniqueName: \"kubernetes.io/projected/042fcae6-0a70-4647-aa9a-eab5a4dd1497-kube-api-access-78hzw\") pod \"maas-controller-6c5bb8b8df-wxvc4\" (UID: \"042fcae6-0a70-4647-aa9a-eab5a4dd1497\") " pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4"
Jul 07 17:36:21.292877 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:21.292786    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-webhook-cert\") pod \"maas-controller-5df8fc765-mqkns\" (UID: \"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1\") " pod="opendatahub/maas-controller-5df8fc765-mqkns"
Jul 07 17:36:21.295465 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:21.295431    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-webhook-cert\") pod \"maas-controller-5df8fc765-mqkns\" (UID: \"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1\") " pod="opendatahub/maas-controller-5df8fc765-mqkns"
Jul 07 17:36:21.494323 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:21.494269    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/042fcae6-0a70-4647-aa9a-eab5a4dd1497-webhook-cert\") pod \"maas-controller-6c5bb8b8df-wxvc4\" (UID: \"042fcae6-0a70-4647-aa9a-eab5a4dd1497\") " pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4"
Jul 07 17:36:21.496870 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:21.496835    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/042fcae6-0a70-4647-aa9a-eab5a4dd1497-webhook-cert\") pod \"maas-controller-6c5bb8b8df-wxvc4\" (UID: \"042fcae6-0a70-4647-aa9a-eab5a4dd1497\") " pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4"
Jul 07 17:36:21.554603 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:21.554503    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df8fc765-mqkns"
Jul 07 17:36:21.695909 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:21.695881    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df8fc765-mqkns"]
Jul 07 17:36:21.697806 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:36:21.697783    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f250d22_668c_4d6f_bccb_ed3e8e56ebe1.slice/crio-4657619c071d0703f531763fb71ad4a3445db5c3eb40425c8aa410ebe02a3ef8 WatchSource:0}: Error finding container 4657619c071d0703f531763fb71ad4a3445db5c3eb40425c8aa410ebe02a3ef8: Status 404 returned error can't find the container with id 4657619c071d0703f531763fb71ad4a3445db5c3eb40425c8aa410ebe02a3ef8
Jul 07 17:36:21.744766 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:21.744727    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4"
Jul 07 17:36:21.887579 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:21.887553    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c5bb8b8df-wxvc4"]
Jul 07 17:36:21.889800 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:36:21.889773    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042fcae6_0a70_4647_aa9a_eab5a4dd1497.slice/crio-e9135f5cc4b23f5e33bdda15f4e5f1f1493fc10bd7c5bba50fa3010b6364da67 WatchSource:0}: Error finding container e9135f5cc4b23f5e33bdda15f4e5f1f1493fc10bd7c5bba50fa3010b6364da67: Status 404 returned error can't find the container with id e9135f5cc4b23f5e33bdda15f4e5f1f1493fc10bd7c5bba50fa3010b6364da67
Jul 07 17:36:22.154647 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:22.154548    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df8fc765-mqkns" event={"ID":"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1","Type":"ContainerStarted","Data":"4657619c071d0703f531763fb71ad4a3445db5c3eb40425c8aa410ebe02a3ef8"}
Jul 07 17:36:22.155730 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:22.155705    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4" event={"ID":"042fcae6-0a70-4647-aa9a-eab5a4dd1497","Type":"ContainerStarted","Data":"e9135f5cc4b23f5e33bdda15f4e5f1f1493fc10bd7c5bba50fa3010b6364da67"}
Jul 07 17:36:24.177283 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:24.177173    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df8fc765-mqkns" event={"ID":"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1","Type":"ContainerStarted","Data":"dbfaaa63982c0b8b1439d9bbde43500dbb1bc671e3940ba207acf0b9f7fcd1df"}
Jul 07 17:36:24.177766 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:24.177374    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5df8fc765-mqkns"
Jul 07 17:36:24.178734 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:24.178706    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4" event={"ID":"042fcae6-0a70-4647-aa9a-eab5a4dd1497","Type":"ContainerStarted","Data":"d69a83113848a63fb03fcf4feef86b21ee38ec246199a0567f27c13249a16d62"}
Jul 07 17:36:24.178841 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:24.178829    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4"
Jul 07 17:36:24.198101 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:24.198053    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5df8fc765-mqkns" podStartSLOduration=2.003648706 podStartE2EDuration="4.198037125s" totalImagesPullingTime="2.194388419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:24.195812761 +0000 UTC m=+513.959272609" watchObservedRunningTime="2026-07-07 17:36:24.198037125 +0000 UTC m=+513.961496971"
Jul 07 17:36:24.222011 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:24.221935    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4" podStartSLOduration=2.230213212 podStartE2EDuration="4.221914994s" totalImagesPullingTime="1.991701782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:24.221804618 +0000 UTC m=+513.985264478" watchObservedRunningTime="2026-07-07 17:36:24.221914994 +0000 UTC m=+513.985374836"
Jul 07 17:36:35.190600 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:35.190571    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4"
Jul 07 17:36:35.191067 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:35.190644    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5df8fc765-mqkns"
Jul 07 17:36:35.260459 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:35.260426    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df8fc765-mqkns"]
Jul 07 17:36:35.260637 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:35.260614    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5df8fc765-mqkns" podUID="4f250d22-668c-4d6f-bccb-ed3e8e56ebe1" containerName="manager" containerID="cri-o://dbfaaa63982c0b8b1439d9bbde43500dbb1bc671e3940ba207acf0b9f7fcd1df" gracePeriod=30
Jul 07 17:36:35.519169 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:35.519138    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df8fc765-mqkns"
Jul 07 17:36:35.629217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:35.629185    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-webhook-cert\") pod \"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1\" (UID: \"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1\") "
Jul 07 17:36:35.629424 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:35.629277    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6fhn\" (UniqueName: \"kubernetes.io/projected/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-kube-api-access-w6fhn\") pod \"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1\" (UID: \"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1\") "
Jul 07 17:36:35.631624 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:35.631592    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4f250d22-668c-4d6f-bccb-ed3e8e56ebe1" (UID: "4f250d22-668c-4d6f-bccb-ed3e8e56ebe1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:36:35.631739 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:35.631644    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-kube-api-access-w6fhn" (OuterVolumeSpecName: "kube-api-access-w6fhn") pod "4f250d22-668c-4d6f-bccb-ed3e8e56ebe1" (UID: "4f250d22-668c-4d6f-bccb-ed3e8e56ebe1"). InnerVolumeSpecName "kube-api-access-w6fhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:36:35.730891 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:35.730833    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6fhn\" (UniqueName: \"kubernetes.io/projected/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-kube-api-access-w6fhn\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:36:35.730891 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:35.730884    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1-webhook-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:36:36.241793 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:36.241759    2561 generic.go:356] "Generic (PLEG): container finished" podID="4f250d22-668c-4d6f-bccb-ed3e8e56ebe1" containerID="dbfaaa63982c0b8b1439d9bbde43500dbb1bc671e3940ba207acf0b9f7fcd1df" exitCode=0
Jul 07 17:36:36.242215 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:36.241809    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df8fc765-mqkns"
Jul 07 17:36:36.242215 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:36.241840    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df8fc765-mqkns" event={"ID":"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1","Type":"ContainerDied","Data":"dbfaaa63982c0b8b1439d9bbde43500dbb1bc671e3940ba207acf0b9f7fcd1df"}
Jul 07 17:36:36.242215 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:36.241881    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df8fc765-mqkns" event={"ID":"4f250d22-668c-4d6f-bccb-ed3e8e56ebe1","Type":"ContainerDied","Data":"4657619c071d0703f531763fb71ad4a3445db5c3eb40425c8aa410ebe02a3ef8"}
Jul 07 17:36:36.242215 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:36.241902    2561 scope.go:117] "RemoveContainer" containerID="dbfaaa63982c0b8b1439d9bbde43500dbb1bc671e3940ba207acf0b9f7fcd1df"
Jul 07 17:36:36.250879 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:36.250861    2561 scope.go:117] "RemoveContainer" containerID="dbfaaa63982c0b8b1439d9bbde43500dbb1bc671e3940ba207acf0b9f7fcd1df"
Jul 07 17:36:36.251186 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:36:36.251169    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbfaaa63982c0b8b1439d9bbde43500dbb1bc671e3940ba207acf0b9f7fcd1df\": container with ID starting with dbfaaa63982c0b8b1439d9bbde43500dbb1bc671e3940ba207acf0b9f7fcd1df not found: ID does not exist" containerID="dbfaaa63982c0b8b1439d9bbde43500dbb1bc671e3940ba207acf0b9f7fcd1df"
Jul 07 17:36:36.251273 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:36.251194    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbfaaa63982c0b8b1439d9bbde43500dbb1bc671e3940ba207acf0b9f7fcd1df"} err="failed to get container status \"dbfaaa63982c0b8b1439d9bbde43500dbb1bc671e3940ba207acf0b9f7fcd1df\": rpc error: code = NotFound desc = could not find container \"dbfaaa63982c0b8b1439d9bbde43500dbb1bc671e3940ba207acf0b9f7fcd1df\": container with ID starting with dbfaaa63982c0b8b1439d9bbde43500dbb1bc671e3940ba207acf0b9f7fcd1df not found: ID does not exist"
Jul 07 17:36:36.264320 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:36.264290    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df8fc765-mqkns"]
Jul 07 17:36:36.270220 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:36.270195    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5df8fc765-mqkns"]
Jul 07 17:36:36.809254 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:36.809220    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f250d22-668c-4d6f-bccb-ed3e8e56ebe1" path="/var/lib/kubelet/pods/4f250d22-668c-4d6f-bccb-ed3e8e56ebe1/volumes"
Jul 07 17:36:57.037266 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.037233    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5fcf4f568d-pp5dn"]
Jul 07 17:36:57.037736 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.037630    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f250d22-668c-4d6f-bccb-ed3e8e56ebe1" containerName="manager"
Jul 07 17:36:57.037736 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.037642    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f250d22-668c-4d6f-bccb-ed3e8e56ebe1" containerName="manager"
Jul 07 17:36:57.037736 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.037703    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f250d22-668c-4d6f-bccb-ed3e8e56ebe1" containerName="manager"
Jul 07 17:36:57.043729 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.043708    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5fcf4f568d-pp5dn"
Jul 07 17:36:57.046212 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.046192    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 07 17:36:57.053012 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.052987    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5fcf4f568d-pp5dn"]
Jul 07 17:36:57.132188 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.132153    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed947c30-717c-434f-bac0-d7a37321473e-maas-api-tls\") pod \"maas-api-5fcf4f568d-pp5dn\" (UID: \"ed947c30-717c-434f-bac0-d7a37321473e\") " pod="opendatahub/maas-api-5fcf4f568d-pp5dn"
Jul 07 17:36:57.132188 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.132188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed947c30-717c-434f-bac0-d7a37321473e-openshift-service-ca\") pod \"maas-api-5fcf4f568d-pp5dn\" (UID: \"ed947c30-717c-434f-bac0-d7a37321473e\") " pod="opendatahub/maas-api-5fcf4f568d-pp5dn"
Jul 07 17:36:57.132394 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.132280    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d7c4\" (UniqueName: \"kubernetes.io/projected/ed947c30-717c-434f-bac0-d7a37321473e-kube-api-access-6d7c4\") pod \"maas-api-5fcf4f568d-pp5dn\" (UID: \"ed947c30-717c-434f-bac0-d7a37321473e\") " pod="opendatahub/maas-api-5fcf4f568d-pp5dn"
Jul 07 17:36:57.232773 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.232730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed947c30-717c-434f-bac0-d7a37321473e-maas-api-tls\") pod \"maas-api-5fcf4f568d-pp5dn\" (UID: \"ed947c30-717c-434f-bac0-d7a37321473e\") " pod="opendatahub/maas-api-5fcf4f568d-pp5dn"
Jul 07 17:36:57.232773 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.232777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed947c30-717c-434f-bac0-d7a37321473e-openshift-service-ca\") pod \"maas-api-5fcf4f568d-pp5dn\" (UID: \"ed947c30-717c-434f-bac0-d7a37321473e\") " pod="opendatahub/maas-api-5fcf4f568d-pp5dn"
Jul 07 17:36:57.233096 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.232897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d7c4\" (UniqueName: \"kubernetes.io/projected/ed947c30-717c-434f-bac0-d7a37321473e-kube-api-access-6d7c4\") pod \"maas-api-5fcf4f568d-pp5dn\" (UID: \"ed947c30-717c-434f-bac0-d7a37321473e\") " pod="opendatahub/maas-api-5fcf4f568d-pp5dn"
Jul 07 17:36:57.233485 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.233463    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed947c30-717c-434f-bac0-d7a37321473e-openshift-service-ca\") pod \"maas-api-5fcf4f568d-pp5dn\" (UID: \"ed947c30-717c-434f-bac0-d7a37321473e\") " pod="opendatahub/maas-api-5fcf4f568d-pp5dn"
Jul 07 17:36:57.235452 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.235428    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed947c30-717c-434f-bac0-d7a37321473e-maas-api-tls\") pod \"maas-api-5fcf4f568d-pp5dn\" (UID: \"ed947c30-717c-434f-bac0-d7a37321473e\") " pod="opendatahub/maas-api-5fcf4f568d-pp5dn"
Jul 07 17:36:57.244268 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.244247    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d7c4\" (UniqueName: \"kubernetes.io/projected/ed947c30-717c-434f-bac0-d7a37321473e-kube-api-access-6d7c4\") pod \"maas-api-5fcf4f568d-pp5dn\" (UID: \"ed947c30-717c-434f-bac0-d7a37321473e\") " pod="opendatahub/maas-api-5fcf4f568d-pp5dn"
Jul 07 17:36:57.356035 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.356003    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5fcf4f568d-pp5dn"
Jul 07 17:36:57.499822 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:57.499801    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5fcf4f568d-pp5dn"]
Jul 07 17:36:57.502034 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:36:57.502003    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded947c30_717c_434f_bac0_d7a37321473e.slice/crio-b307152995abd99cc574d9f27e54bf1bd59c54c784786cef1d5cf72adc14558b WatchSource:0}: Error finding container b307152995abd99cc574d9f27e54bf1bd59c54c784786cef1d5cf72adc14558b: Status 404 returned error can't find the container with id b307152995abd99cc574d9f27e54bf1bd59c54c784786cef1d5cf72adc14558b
Jul 07 17:36:58.359587 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:36:58.359548    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5fcf4f568d-pp5dn" event={"ID":"ed947c30-717c-434f-bac0-d7a37321473e","Type":"ContainerStarted","Data":"b307152995abd99cc574d9f27e54bf1bd59c54c784786cef1d5cf72adc14558b"}
Jul 07 17:37:00.370576 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:00.370539    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5fcf4f568d-pp5dn" event={"ID":"ed947c30-717c-434f-bac0-d7a37321473e","Type":"ContainerStarted","Data":"4bc78324fddb99a0337dc3b2dd297513d4406933e049b469c9724d3a587849c2"}
Jul 07 17:37:00.371009 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:00.370637    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5fcf4f568d-pp5dn"
Jul 07 17:37:00.393944 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:00.393871    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5fcf4f568d-pp5dn" podStartSLOduration=1.4276032889999999 podStartE2EDuration="3.393845473s" totalImagesPullingTime="1.966242184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:00.391042929 +0000 UTC m=+550.154502776" watchObservedRunningTime="2026-07-07 17:37:00.393845473 +0000 UTC m=+550.157305321"
Jul 07 17:37:06.384570 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:06.384542    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5fcf4f568d-pp5dn"
Jul 07 17:37:06.406700 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:06.406666    2561 generic.go:356] "Generic (PLEG): container finished" podID="e5cbb00d-d555-480a-940c-46bcdca44c0e" containerID="50e7381183e5abd7995c1ea7971e9a9ac88e0a5ac881fc7c0ca1603530dff677" exitCode=0
Jul 07 17:37:06.406883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:06.406741    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv" event={"ID":"e5cbb00d-d555-480a-940c-46bcdca44c0e","Type":"ContainerDied","Data":"50e7381183e5abd7995c1ea7971e9a9ac88e0a5ac881fc7c0ca1603530dff677"}
Jul 07 17:37:06.407202 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:06.407180    2561 scope.go:117] "RemoveContainer" containerID="50e7381183e5abd7995c1ea7971e9a9ac88e0a5ac881fc7c0ca1603530dff677"
Jul 07 17:37:06.408558 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:06.408528    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:37:06.408628 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:06.408615    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:37:06.408670 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:06.408650    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:37:07.413785 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:07.413756    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv" event={"ID":"e5cbb00d-d555-480a-940c-46bcdca44c0e","Type":"ContainerStarted","Data":"e19b3087d9777642197313d713484e9642d09e1712803cbe206a6f3018528837"}
Jul 07 17:37:07.596404 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:07.596348    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:37:07.596620 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:07.596537    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-6pjbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 07 17:37:07.596620 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:07.596587    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv" podUID="e5cbb00d-d555-480a-940c-46bcdca44c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 07 17:37:08.594513 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:08.594475    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-6pjbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 07 17:37:08.595627 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:08.595205    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv" podUID="e5cbb00d-d555-480a-940c-46bcdca44c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 07 17:37:09.595310 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:09.594797    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-6pjbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 07 17:37:09.595310 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:09.594869    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv" podUID="e5cbb00d-d555-480a-940c-46bcdca44c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 07 17:37:09.945262 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:09.945145    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:37:10.594682 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:10.594628    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-6pjbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 07 17:37:10.594905 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:10.594721    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv" podUID="e5cbb00d-d555-480a-940c-46bcdca44c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 07 17:37:11.599008 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:11.598977    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:37:11.600187 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:11.600165    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6pjbv"
Jul 07 17:37:55.410928 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.410884    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"]
Jul 07 17:37:55.414649 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.414623    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.418127 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.418102    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 17:37:55.418266 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.418124    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rm7gp\""
Jul 07 17:37:55.418266 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.418127    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 17:37:55.418266 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.418183    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 17:37:55.426190 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.426164    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"]
Jul 07 17:37:55.497930 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.497897    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f766b800-4db7-40f9-874d-7c1fadea4383-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.498129 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.497936    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqtfd\" (UniqueName: \"kubernetes.io/projected/f766b800-4db7-40f9-874d-7c1fadea4383-kube-api-access-tqtfd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.498129 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.497978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f766b800-4db7-40f9-874d-7c1fadea4383-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.498129 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.498058    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f766b800-4db7-40f9-874d-7c1fadea4383-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.498129 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.498093    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f766b800-4db7-40f9-874d-7c1fadea4383-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.498129 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.498129    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f766b800-4db7-40f9-874d-7c1fadea4383-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.599374 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.599333    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f766b800-4db7-40f9-874d-7c1fadea4383-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.599374 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.599380    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqtfd\" (UniqueName: \"kubernetes.io/projected/f766b800-4db7-40f9-874d-7c1fadea4383-kube-api-access-tqtfd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.599625 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.599409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f766b800-4db7-40f9-874d-7c1fadea4383-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.599625 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.599546    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f766b800-4db7-40f9-874d-7c1fadea4383-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.599625 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.599599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f766b800-4db7-40f9-874d-7c1fadea4383-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.599781 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.599671    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f766b800-4db7-40f9-874d-7c1fadea4383-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.599835 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.599781    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f766b800-4db7-40f9-874d-7c1fadea4383-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.599885 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.599838    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f766b800-4db7-40f9-874d-7c1fadea4383-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.599983 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.599951    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f766b800-4db7-40f9-874d-7c1fadea4383-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.602040 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.602020    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f766b800-4db7-40f9-874d-7c1fadea4383-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.602152 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.602129    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f766b800-4db7-40f9-874d-7c1fadea4383-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.609347 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.609316    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqtfd\" (UniqueName: \"kubernetes.io/projected/f766b800-4db7-40f9-874d-7c1fadea4383-kube-api-access-tqtfd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sl2cp\" (UID: \"f766b800-4db7-40f9-874d-7c1fadea4383\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.725786 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.725687    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:37:55.869061 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:55.869034    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"]
Jul 07 17:37:55.871457 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:37:55.871432    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf766b800_4db7_40f9_874d_7c1fadea4383.slice/crio-5a378fa7cfbe26e2ffb3d24aefc3f2980aaefb0458f617b993f89cb9c512e7b6 WatchSource:0}: Error finding container 5a378fa7cfbe26e2ffb3d24aefc3f2980aaefb0458f617b993f89cb9c512e7b6: Status 404 returned error can't find the container with id 5a378fa7cfbe26e2ffb3d24aefc3f2980aaefb0458f617b993f89cb9c512e7b6
Jul 07 17:37:56.656225 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:56.656194    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp" event={"ID":"f766b800-4db7-40f9-874d-7c1fadea4383","Type":"ContainerStarted","Data":"5a378fa7cfbe26e2ffb3d24aefc3f2980aaefb0458f617b993f89cb9c512e7b6"}
Jul 07 17:37:57.661867 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:57.661831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp" event={"ID":"f766b800-4db7-40f9-874d-7c1fadea4383","Type":"ContainerStarted","Data":"58d0606559baf386dd2c6251294eb474ba17f42048c570ac757187bd42062dcb"}
Jul 07 17:37:57.681637 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:37:57.681584    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp" podStartSLOduration=1.506425352 podStartE2EDuration="2.681567259s" totalImagesPullingTime="1.175141907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:57.679331779 +0000 UTC m=+607.442791626" watchObservedRunningTime="2026-07-07 17:37:57.681567259 +0000 UTC m=+607.445027104"
Jul 07 17:38:03.711861 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.711824    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"]
Jul 07 17:38:03.715572 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.715545    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.718014 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.717990    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 17:38:03.730603 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.730578    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"]
Jul 07 17:38:03.881943 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.881888    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.881943 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.881941    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx59g\" (UniqueName: \"kubernetes.io/projected/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-kube-api-access-hx59g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.882207 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.882008    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.882207 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.882052    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.882207 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.882089    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.882207 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.882152    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.983583 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.983476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.983583 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.983560    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.983833 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.983615    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.983833 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.983642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx59g\" (UniqueName: \"kubernetes.io/projected/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-kube-api-access-hx59g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.983833 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.983694    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.983833 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.983721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.984095 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.984037    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.984095 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.984078    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.984207 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.984121    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.986320 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.986296    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.986423 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.986350    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:03.994498 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:03.994476    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx59g\" (UniqueName: \"kubernetes.io/projected/fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82-kube-api-access-hx59g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s\" (UID: \"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:04.027413 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:04.027378    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:04.175606 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:04.175578    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"]
Jul 07 17:38:04.178195 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:38:04.178167    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0ca86b_ecd1_4f8b_99bc_97d233f7fa82.slice/crio-7577ccc7911bc377a3a464b33b1222c6755c9033c77900551edf3e1ea9163efa WatchSource:0}: Error finding container 7577ccc7911bc377a3a464b33b1222c6755c9033c77900551edf3e1ea9163efa: Status 404 returned error can't find the container with id 7577ccc7911bc377a3a464b33b1222c6755c9033c77900551edf3e1ea9163efa
Jul 07 17:38:04.179958 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:04.179941    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:38:04.700076 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:04.699954    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s" event={"ID":"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82","Type":"ContainerStarted","Data":"2d03bfae8a82aa6d0ae9112c42acdbd276781b8ebfeedc4ab2c1cc6c6f0632f7"}
Jul 07 17:38:04.700076 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:04.700037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s" event={"ID":"fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82","Type":"ContainerStarted","Data":"7577ccc7911bc377a3a464b33b1222c6755c9033c77900551edf3e1ea9163efa"}
Jul 07 17:38:04.720998 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:04.720520    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s" podStartSLOduration=1.490114913 podStartE2EDuration="1.720497262s" totalImagesPullingTime="230.382349ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:04.718306893 +0000 UTC m=+614.481766739" watchObservedRunningTime="2026-07-07 17:38:04.720497262 +0000 UTC m=+614.483957110"
Jul 07 17:38:05.725919 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:05.725878    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:38:05.726337 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:05.725955    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:38:05.739617 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:05.739587    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:38:06.722306 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:06.722276    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sl2cp"
Jul 07 17:38:14.028219 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:14.028133    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:14.028219 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:14.028202    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:14.040995 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:14.040952    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:38:14.760674 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:38:14.760647    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s"
Jul 07 17:39:24.404367 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:24.404310    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7565bddf64-dxz29"]
Jul 07 17:39:24.407835 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:24.407812    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7565bddf64-dxz29"
Jul 07 17:39:24.423923 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:24.423894    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7565bddf64-dxz29"]
Jul 07 17:39:24.543567 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:24.543527    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3be8befc-2943-40d7-85b5-0d75a93e1b83-tls-cert\") pod \"authorino-7565bddf64-dxz29\" (UID: \"3be8befc-2943-40d7-85b5-0d75a93e1b83\") " pod="kuadrant-system/authorino-7565bddf64-dxz29"
Jul 07 17:39:24.543567 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:24.543571    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl6z5\" (UniqueName: \"kubernetes.io/projected/3be8befc-2943-40d7-85b5-0d75a93e1b83-kube-api-access-zl6z5\") pod \"authorino-7565bddf64-dxz29\" (UID: \"3be8befc-2943-40d7-85b5-0d75a93e1b83\") " pod="kuadrant-system/authorino-7565bddf64-dxz29"
Jul 07 17:39:24.644883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:24.644842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3be8befc-2943-40d7-85b5-0d75a93e1b83-tls-cert\") pod \"authorino-7565bddf64-dxz29\" (UID: \"3be8befc-2943-40d7-85b5-0d75a93e1b83\") " pod="kuadrant-system/authorino-7565bddf64-dxz29"
Jul 07 17:39:24.645080 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:24.644890    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl6z5\" (UniqueName: \"kubernetes.io/projected/3be8befc-2943-40d7-85b5-0d75a93e1b83-kube-api-access-zl6z5\") pod \"authorino-7565bddf64-dxz29\" (UID: \"3be8befc-2943-40d7-85b5-0d75a93e1b83\") " pod="kuadrant-system/authorino-7565bddf64-dxz29"
Jul 07 17:39:24.647526 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:24.647494    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3be8befc-2943-40d7-85b5-0d75a93e1b83-tls-cert\") pod \"authorino-7565bddf64-dxz29\" (UID: \"3be8befc-2943-40d7-85b5-0d75a93e1b83\") " pod="kuadrant-system/authorino-7565bddf64-dxz29"
Jul 07 17:39:24.655506 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:24.655433    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl6z5\" (UniqueName: \"kubernetes.io/projected/3be8befc-2943-40d7-85b5-0d75a93e1b83-kube-api-access-zl6z5\") pod \"authorino-7565bddf64-dxz29\" (UID: \"3be8befc-2943-40d7-85b5-0d75a93e1b83\") " pod="kuadrant-system/authorino-7565bddf64-dxz29"
Jul 07 17:39:24.717419 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:24.717377    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7565bddf64-dxz29"
Jul 07 17:39:24.869142 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:24.869116    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7565bddf64-dxz29"]
Jul 07 17:39:24.871569 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:39:24.871520    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3be8befc_2943_40d7_85b5_0d75a93e1b83.slice/crio-b8e1cc734fb412526f6034db3b59813431329f097fe4cc5e7fd248e27be3eac3 WatchSource:0}: Error finding container b8e1cc734fb412526f6034db3b59813431329f097fe4cc5e7fd248e27be3eac3: Status 404 returned error can't find the container with id b8e1cc734fb412526f6034db3b59813431329f097fe4cc5e7fd248e27be3eac3
Jul 07 17:39:25.093464 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:25.093428    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7565bddf64-dxz29" event={"ID":"3be8befc-2943-40d7-85b5-0d75a93e1b83","Type":"ContainerStarted","Data":"b8e1cc734fb412526f6034db3b59813431329f097fe4cc5e7fd248e27be3eac3"}
Jul 07 17:39:26.100770 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:26.100724    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7565bddf64-dxz29" event={"ID":"3be8befc-2943-40d7-85b5-0d75a93e1b83","Type":"ContainerStarted","Data":"d0d0f315e0b2502ac69e84b4d5b973b35fe2836b0cc1a3afed632a2b4677597b"}
Jul 07 17:39:26.127731 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:26.127665    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7565bddf64-dxz29" podStartSLOduration=1.6158253070000002 podStartE2EDuration="2.127641753s" totalImagesPullingTime="511.816446ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:39:26.127282247 +0000 UTC m=+695.890742122" watchObservedRunningTime="2026-07-07 17:39:26.127641753 +0000 UTC m=+695.891101602"
Jul 07 17:39:26.163540 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:26.163501    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7db76b7d77-5qtnj"]
Jul 07 17:39:26.163773 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:26.163745    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7db76b7d77-5qtnj" podUID="8da31106-a831-4a64-bd03-7e9f42bd4b45" containerName="authorino" containerID="cri-o://e30c3959f809e9c5d221be01e765e5dc27545f6e280c8fdddd8f99fb3d5cb343" gracePeriod=30
Jul 07 17:39:26.441125 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:26.441100    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7db76b7d77-5qtnj"
Jul 07 17:39:26.565924 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:26.565889    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8da31106-a831-4a64-bd03-7e9f42bd4b45-tls-cert\") pod \"8da31106-a831-4a64-bd03-7e9f42bd4b45\" (UID: \"8da31106-a831-4a64-bd03-7e9f42bd4b45\") "
Jul 07 17:39:26.566095 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:26.566044    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v64gf\" (UniqueName: \"kubernetes.io/projected/8da31106-a831-4a64-bd03-7e9f42bd4b45-kube-api-access-v64gf\") pod \"8da31106-a831-4a64-bd03-7e9f42bd4b45\" (UID: \"8da31106-a831-4a64-bd03-7e9f42bd4b45\") "
Jul 07 17:39:26.568802 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:26.568763    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8da31106-a831-4a64-bd03-7e9f42bd4b45-kube-api-access-v64gf" (OuterVolumeSpecName: "kube-api-access-v64gf") pod "8da31106-a831-4a64-bd03-7e9f42bd4b45" (UID: "8da31106-a831-4a64-bd03-7e9f42bd4b45"). InnerVolumeSpecName "kube-api-access-v64gf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:39:26.578282 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:26.578250    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8da31106-a831-4a64-bd03-7e9f42bd4b45-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8da31106-a831-4a64-bd03-7e9f42bd4b45" (UID: "8da31106-a831-4a64-bd03-7e9f42bd4b45"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:39:26.668027 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:26.667949    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v64gf\" (UniqueName: \"kubernetes.io/projected/8da31106-a831-4a64-bd03-7e9f42bd4b45-kube-api-access-v64gf\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:39:26.668027 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:26.668030    2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8da31106-a831-4a64-bd03-7e9f42bd4b45-tls-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:39:27.112046 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:27.108336    2561 generic.go:356] "Generic (PLEG): container finished" podID="8da31106-a831-4a64-bd03-7e9f42bd4b45" containerID="e30c3959f809e9c5d221be01e765e5dc27545f6e280c8fdddd8f99fb3d5cb343" exitCode=0
Jul 07 17:39:27.112046 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:27.108448    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7db76b7d77-5qtnj"
Jul 07 17:39:27.112046 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:27.108552    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7db76b7d77-5qtnj" event={"ID":"8da31106-a831-4a64-bd03-7e9f42bd4b45","Type":"ContainerDied","Data":"e30c3959f809e9c5d221be01e765e5dc27545f6e280c8fdddd8f99fb3d5cb343"}
Jul 07 17:39:27.112046 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:27.108602    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7db76b7d77-5qtnj" event={"ID":"8da31106-a831-4a64-bd03-7e9f42bd4b45","Type":"ContainerDied","Data":"79698e20ecac9b7d7291413f1647930edfad3e65f2c0d232ddb90e297dd6288c"}
Jul 07 17:39:27.112046 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:27.108627    2561 scope.go:117] "RemoveContainer" containerID="e30c3959f809e9c5d221be01e765e5dc27545f6e280c8fdddd8f99fb3d5cb343"
Jul 07 17:39:27.126861 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:27.126832    2561 scope.go:117] "RemoveContainer" containerID="e30c3959f809e9c5d221be01e765e5dc27545f6e280c8fdddd8f99fb3d5cb343"
Jul 07 17:39:27.127211 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:39:27.127191    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e30c3959f809e9c5d221be01e765e5dc27545f6e280c8fdddd8f99fb3d5cb343\": container with ID starting with e30c3959f809e9c5d221be01e765e5dc27545f6e280c8fdddd8f99fb3d5cb343 not found: ID does not exist" containerID="e30c3959f809e9c5d221be01e765e5dc27545f6e280c8fdddd8f99fb3d5cb343"
Jul 07 17:39:27.127286 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:27.127222    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30c3959f809e9c5d221be01e765e5dc27545f6e280c8fdddd8f99fb3d5cb343"} err="failed to get container status \"e30c3959f809e9c5d221be01e765e5dc27545f6e280c8fdddd8f99fb3d5cb343\": rpc error: code = NotFound desc = could not find container \"e30c3959f809e9c5d221be01e765e5dc27545f6e280c8fdddd8f99fb3d5cb343\": container with ID starting with e30c3959f809e9c5d221be01e765e5dc27545f6e280c8fdddd8f99fb3d5cb343 not found: ID does not exist"
Jul 07 17:39:27.133146 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:27.133117    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7db76b7d77-5qtnj"]
Jul 07 17:39:27.139682 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:27.139655    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7db76b7d77-5qtnj"]
Jul 07 17:39:28.809513 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:39:28.809481    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8da31106-a831-4a64-bd03-7e9f42bd4b45" path="/var/lib/kubelet/pods/8da31106-a831-4a64-bd03-7e9f42bd4b45/volumes"
Jul 07 17:40:39.683362 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:39.683325    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c5bb8b8df-wxvc4"]
Jul 07 17:40:39.683941 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:39.683614    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4" podUID="042fcae6-0a70-4647-aa9a-eab5a4dd1497" containerName="manager" containerID="cri-o://d69a83113848a63fb03fcf4feef86b21ee38ec246199a0567f27c13249a16d62" gracePeriod=30
Jul 07 17:40:39.939958 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:39.939891    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4"
Jul 07 17:40:40.059223 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.059186    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78hzw\" (UniqueName: \"kubernetes.io/projected/042fcae6-0a70-4647-aa9a-eab5a4dd1497-kube-api-access-78hzw\") pod \"042fcae6-0a70-4647-aa9a-eab5a4dd1497\" (UID: \"042fcae6-0a70-4647-aa9a-eab5a4dd1497\") "
Jul 07 17:40:40.059223 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.059225    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/042fcae6-0a70-4647-aa9a-eab5a4dd1497-webhook-cert\") pod \"042fcae6-0a70-4647-aa9a-eab5a4dd1497\" (UID: \"042fcae6-0a70-4647-aa9a-eab5a4dd1497\") "
Jul 07 17:40:40.061428 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.061401    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/042fcae6-0a70-4647-aa9a-eab5a4dd1497-kube-api-access-78hzw" (OuterVolumeSpecName: "kube-api-access-78hzw") pod "042fcae6-0a70-4647-aa9a-eab5a4dd1497" (UID: "042fcae6-0a70-4647-aa9a-eab5a4dd1497"). InnerVolumeSpecName "kube-api-access-78hzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:40:40.061532 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.061427    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/042fcae6-0a70-4647-aa9a-eab5a4dd1497-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "042fcae6-0a70-4647-aa9a-eab5a4dd1497" (UID: "042fcae6-0a70-4647-aa9a-eab5a4dd1497"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:40:40.160330 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.160288    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78hzw\" (UniqueName: \"kubernetes.io/projected/042fcae6-0a70-4647-aa9a-eab5a4dd1497-kube-api-access-78hzw\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:40:40.160330 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.160320    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/042fcae6-0a70-4647-aa9a-eab5a4dd1497-webhook-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:40:40.474590 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.474550    2561 generic.go:356] "Generic (PLEG): container finished" podID="042fcae6-0a70-4647-aa9a-eab5a4dd1497" containerID="d69a83113848a63fb03fcf4feef86b21ee38ec246199a0567f27c13249a16d62" exitCode=0
Jul 07 17:40:40.474764 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.474599    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4"
Jul 07 17:40:40.474764 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.474641    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4" event={"ID":"042fcae6-0a70-4647-aa9a-eab5a4dd1497","Type":"ContainerDied","Data":"d69a83113848a63fb03fcf4feef86b21ee38ec246199a0567f27c13249a16d62"}
Jul 07 17:40:40.474764 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.474695    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c5bb8b8df-wxvc4" event={"ID":"042fcae6-0a70-4647-aa9a-eab5a4dd1497","Type":"ContainerDied","Data":"e9135f5cc4b23f5e33bdda15f4e5f1f1493fc10bd7c5bba50fa3010b6364da67"}
Jul 07 17:40:40.474764 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.474723    2561 scope.go:117] "RemoveContainer" containerID="d69a83113848a63fb03fcf4feef86b21ee38ec246199a0567f27c13249a16d62"
Jul 07 17:40:40.483952 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.483936    2561 scope.go:117] "RemoveContainer" containerID="d69a83113848a63fb03fcf4feef86b21ee38ec246199a0567f27c13249a16d62"
Jul 07 17:40:40.484236 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:40:40.484217    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d69a83113848a63fb03fcf4feef86b21ee38ec246199a0567f27c13249a16d62\": container with ID starting with d69a83113848a63fb03fcf4feef86b21ee38ec246199a0567f27c13249a16d62 not found: ID does not exist" containerID="d69a83113848a63fb03fcf4feef86b21ee38ec246199a0567f27c13249a16d62"
Jul 07 17:40:40.484288 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.484244    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69a83113848a63fb03fcf4feef86b21ee38ec246199a0567f27c13249a16d62"} err="failed to get container status \"d69a83113848a63fb03fcf4feef86b21ee38ec246199a0567f27c13249a16d62\": rpc error: code = NotFound desc = could not find container \"d69a83113848a63fb03fcf4feef86b21ee38ec246199a0567f27c13249a16d62\": container with ID starting with d69a83113848a63fb03fcf4feef86b21ee38ec246199a0567f27c13249a16d62 not found: ID does not exist"
Jul 07 17:40:40.497363 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.497335    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c5bb8b8df-wxvc4"]
Jul 07 17:40:40.501677 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.501655    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c5bb8b8df-wxvc4"]
Jul 07 17:40:40.810209 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:40.810175    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="042fcae6-0a70-4647-aa9a-eab5a4dd1497" path="/var/lib/kubelet/pods/042fcae6-0a70-4647-aa9a-eab5a4dd1497/volumes"
Jul 07 17:40:41.323547 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.323507    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c5bb8b8df-5nks6"]
Jul 07 17:40:41.323915 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.323902    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="042fcae6-0a70-4647-aa9a-eab5a4dd1497" containerName="manager"
Jul 07 17:40:41.324000 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.323917    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="042fcae6-0a70-4647-aa9a-eab5a4dd1497" containerName="manager"
Jul 07 17:40:41.324000 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.323927    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8da31106-a831-4a64-bd03-7e9f42bd4b45" containerName="authorino"
Jul 07 17:40:41.324000 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.323933    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8da31106-a831-4a64-bd03-7e9f42bd4b45" containerName="authorino"
Jul 07 17:40:41.324109 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.324032    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8da31106-a831-4a64-bd03-7e9f42bd4b45" containerName="authorino"
Jul 07 17:40:41.324109 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.324047    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="042fcae6-0a70-4647-aa9a-eab5a4dd1497" containerName="manager"
Jul 07 17:40:41.328393 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.328375    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c5bb8b8df-5nks6"
Jul 07 17:40:41.332060 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.332036    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 17:40:41.332189 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.332039    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 17:40:41.332189 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.332040    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rnj5p\""
Jul 07 17:40:41.338595 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.338566    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c5bb8b8df-5nks6"]
Jul 07 17:40:41.474590 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.474549    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkl56\" (UniqueName: \"kubernetes.io/projected/77e68694-d6af-40fc-8d2f-d604055eb9fe-kube-api-access-dkl56\") pod \"maas-controller-6c5bb8b8df-5nks6\" (UID: \"77e68694-d6af-40fc-8d2f-d604055eb9fe\") " pod="opendatahub/maas-controller-6c5bb8b8df-5nks6"
Jul 07 17:40:41.474783 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.474605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77e68694-d6af-40fc-8d2f-d604055eb9fe-webhook-cert\") pod \"maas-controller-6c5bb8b8df-5nks6\" (UID: \"77e68694-d6af-40fc-8d2f-d604055eb9fe\") " pod="opendatahub/maas-controller-6c5bb8b8df-5nks6"
Jul 07 17:40:41.575694 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.575596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkl56\" (UniqueName: \"kubernetes.io/projected/77e68694-d6af-40fc-8d2f-d604055eb9fe-kube-api-access-dkl56\") pod \"maas-controller-6c5bb8b8df-5nks6\" (UID: \"77e68694-d6af-40fc-8d2f-d604055eb9fe\") " pod="opendatahub/maas-controller-6c5bb8b8df-5nks6"
Jul 07 17:40:41.575694 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.575643    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77e68694-d6af-40fc-8d2f-d604055eb9fe-webhook-cert\") pod \"maas-controller-6c5bb8b8df-5nks6\" (UID: \"77e68694-d6af-40fc-8d2f-d604055eb9fe\") " pod="opendatahub/maas-controller-6c5bb8b8df-5nks6"
Jul 07 17:40:41.578433 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.578399    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77e68694-d6af-40fc-8d2f-d604055eb9fe-webhook-cert\") pod \"maas-controller-6c5bb8b8df-5nks6\" (UID: \"77e68694-d6af-40fc-8d2f-d604055eb9fe\") " pod="opendatahub/maas-controller-6c5bb8b8df-5nks6"
Jul 07 17:40:41.585324 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.585295    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkl56\" (UniqueName: \"kubernetes.io/projected/77e68694-d6af-40fc-8d2f-d604055eb9fe-kube-api-access-dkl56\") pod \"maas-controller-6c5bb8b8df-5nks6\" (UID: \"77e68694-d6af-40fc-8d2f-d604055eb9fe\") " pod="opendatahub/maas-controller-6c5bb8b8df-5nks6"
Jul 07 17:40:41.640305 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.640268    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c5bb8b8df-5nks6"
Jul 07 17:40:41.778836 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:41.778795    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c5bb8b8df-5nks6"]
Jul 07 17:40:41.781278 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:40:41.781254    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77e68694_d6af_40fc_8d2f_d604055eb9fe.slice/crio-2e423a12451de62a75a5ee50d0885b1692e72d70ceea1e9dc656a98ee4df0524 WatchSource:0}: Error finding container 2e423a12451de62a75a5ee50d0885b1692e72d70ceea1e9dc656a98ee4df0524: Status 404 returned error can't find the container with id 2e423a12451de62a75a5ee50d0885b1692e72d70ceea1e9dc656a98ee4df0524
Jul 07 17:40:42.487342 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:42.487313    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c5bb8b8df-5nks6" event={"ID":"77e68694-d6af-40fc-8d2f-d604055eb9fe","Type":"ContainerStarted","Data":"c650dc5057a9d0fbd5480a57207cc5f0f264a758fa76a85975d5386e64202861"}
Jul 07 17:40:42.487722 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:42.487361    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c5bb8b8df-5nks6" event={"ID":"77e68694-d6af-40fc-8d2f-d604055eb9fe","Type":"ContainerStarted","Data":"2e423a12451de62a75a5ee50d0885b1692e72d70ceea1e9dc656a98ee4df0524"}
Jul 07 17:40:42.487722 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:42.487430    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c5bb8b8df-5nks6"
Jul 07 17:40:42.507326 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:42.507258    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c5bb8b8df-5nks6" podStartSLOduration=0.863407936 podStartE2EDuration="1.507236766s" totalImagesPullingTime="643.82883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:42.505338839 +0000 UTC m=+772.268798685" watchObservedRunningTime="2026-07-07 17:40:42.507236766 +0000 UTC m=+772.270696613"
Jul 07 17:40:53.500210 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:40:53.500181    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c5bb8b8df-5nks6"
Jul 07 17:49:21.277668 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.277630    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66cbd9489b-mnlkp"]
Jul 07 17:49:21.281089 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.281071    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.286712 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.286685    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 17:49:21.286712 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.286701    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 17:49:21.287743 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.287718    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 17:49:21.287947 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.287722    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 17:49:21.288090 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.287742    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 17:49:21.288090 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.288066    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xsg7v\""
Jul 07 17:49:21.288552 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.288113    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 17:49:21.288552 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.288229    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 17:49:21.292003 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.291981    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 17:49:21.305035 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.305005    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66cbd9489b-mnlkp"]
Jul 07 17:49:21.339739 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.339701    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c25718f0-1514-41c5-8bde-ce7d9a92248a-console-oauth-config\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.339914 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.339763    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c25718f0-1514-41c5-8bde-ce7d9a92248a-console-serving-cert\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.339914 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.339801    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qb5c\" (UniqueName: \"kubernetes.io/projected/c25718f0-1514-41c5-8bde-ce7d9a92248a-kube-api-access-9qb5c\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.340056 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.339930    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c25718f0-1514-41c5-8bde-ce7d9a92248a-service-ca\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.340056 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.339984    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c25718f0-1514-41c5-8bde-ce7d9a92248a-oauth-serving-cert\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.340056 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.340017    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c25718f0-1514-41c5-8bde-ce7d9a92248a-console-config\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.340056 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.340034    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c25718f0-1514-41c5-8bde-ce7d9a92248a-trusted-ca-bundle\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.441166 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.441117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c25718f0-1514-41c5-8bde-ce7d9a92248a-console-oauth-config\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.441389 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.441178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c25718f0-1514-41c5-8bde-ce7d9a92248a-console-serving-cert\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.441389 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.441224    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qb5c\" (UniqueName: \"kubernetes.io/projected/c25718f0-1514-41c5-8bde-ce7d9a92248a-kube-api-access-9qb5c\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.441389 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.441323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c25718f0-1514-41c5-8bde-ce7d9a92248a-service-ca\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.441389 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.441358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c25718f0-1514-41c5-8bde-ce7d9a92248a-oauth-serving-cert\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.441611 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.441401    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c25718f0-1514-41c5-8bde-ce7d9a92248a-console-config\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.441611 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.441424    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c25718f0-1514-41c5-8bde-ce7d9a92248a-trusted-ca-bundle\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.442323 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.442292    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c25718f0-1514-41c5-8bde-ce7d9a92248a-oauth-serving-cert\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.442460 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.442353    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c25718f0-1514-41c5-8bde-ce7d9a92248a-service-ca\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.442529 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.442500    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c25718f0-1514-41c5-8bde-ce7d9a92248a-console-config\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.442791 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.442769    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c25718f0-1514-41c5-8bde-ce7d9a92248a-trusted-ca-bundle\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.444044 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.444022    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c25718f0-1514-41c5-8bde-ce7d9a92248a-console-serving-cert\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.444337 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.444319    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c25718f0-1514-41c5-8bde-ce7d9a92248a-console-oauth-config\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.451521 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.451496    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qb5c\" (UniqueName: \"kubernetes.io/projected/c25718f0-1514-41c5-8bde-ce7d9a92248a-kube-api-access-9qb5c\") pod \"console-66cbd9489b-mnlkp\" (UID: \"c25718f0-1514-41c5-8bde-ce7d9a92248a\") " pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.592314 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.591999    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:21.759252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:21.759226    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66cbd9489b-mnlkp"]
Jul 07 17:49:21.761657 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:49:21.761630    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc25718f0_1514_41c5_8bde_ce7d9a92248a.slice/crio-5fabd30af084a143dcc465cfb45f17c63b49aa50de226889f7c03ce1b68b79a7 WatchSource:0}: Error finding container 5fabd30af084a143dcc465cfb45f17c63b49aa50de226889f7c03ce1b68b79a7: Status 404 returned error can't find the container with id 5fabd30af084a143dcc465cfb45f17c63b49aa50de226889f7c03ce1b68b79a7
Jul 07 17:49:22.036113 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:22.036076    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66cbd9489b-mnlkp" event={"ID":"c25718f0-1514-41c5-8bde-ce7d9a92248a","Type":"ContainerStarted","Data":"2aea471e227a1c99f5c805f1c2044cc2afb90ce72c0dbc8e8600a18af3f996ce"}
Jul 07 17:49:22.036300 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:22.036134    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66cbd9489b-mnlkp" event={"ID":"c25718f0-1514-41c5-8bde-ce7d9a92248a","Type":"ContainerStarted","Data":"5fabd30af084a143dcc465cfb45f17c63b49aa50de226889f7c03ce1b68b79a7"}
Jul 07 17:49:22.058010 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:22.057924    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66cbd9489b-mnlkp" podStartSLOduration=1.05790165 podStartE2EDuration="1.05790165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:49:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:49:22.057421242 +0000 UTC m=+1291.820881089" watchObservedRunningTime="2026-07-07 17:49:22.05790165 +0000 UTC m=+1291.821361497"
Jul 07 17:49:31.593241 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:31.593129    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:31.593241 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:31.593212    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:31.598222 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:31.598193    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:49:32.088420 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:49:32.088382    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66cbd9489b-mnlkp"
Jul 07 17:52:46.159656 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.159622    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"]
Jul 07 17:52:46.163400 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.163293    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.165936 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.165913    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a41f21f0-openshift-default-dockercfg-wgrfb\""
Jul 07 17:52:46.188175 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.188148    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"]
Jul 07 17:52:46.288344 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.288296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-credential-socket\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.288532 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.288376    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mqbs\" (UniqueName: \"kubernetes.io/projected/7f4b52fb-a21b-472b-b51e-39bc7775721d-kube-api-access-2mqbs\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.288532 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.288397    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-podinfo\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.288532 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.288423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-data\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.288532 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.288445    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-workload-socket\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.288532 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.288494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-workload-certs\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.288696 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.288559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-token\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.288696 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.288576    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-envoy\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.288696 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.288597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f4b52fb-a21b-472b-b51e-39bc7775721d-istiod-ca-cert\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.389430 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.389396    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-credential-socket\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.389617 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.389476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mqbs\" (UniqueName: \"kubernetes.io/projected/7f4b52fb-a21b-472b-b51e-39bc7775721d-kube-api-access-2mqbs\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.389617 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.389508    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-podinfo\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.389617 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.389544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-data\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.389778 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.389669    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-workload-socket\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.389778 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.389703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-workload-certs\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.389778 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.389738    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-token\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.389778 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.389765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-envoy\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.390004 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.389802    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f4b52fb-a21b-472b-b51e-39bc7775721d-istiod-ca-cert\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.390004 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.389873    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-credential-socket\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.390004 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.389907    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-data\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.390155 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.390062    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-workload-socket\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.390155 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.390137    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-workload-certs\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.390470 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.390452    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f4b52fb-a21b-472b-b51e-39bc7775721d-istiod-ca-cert\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.392113 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.392092    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-envoy\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.392253 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.392236    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-podinfo\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.400841 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.400813    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mqbs\" (UniqueName: \"kubernetes.io/projected/7f4b52fb-a21b-472b-b51e-39bc7775721d-kube-api-access-2mqbs\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.401201 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.401182    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-token\") pod \"e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") " pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.474941 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.474850    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:46.615771 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.615744    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"]
Jul 07 17:52:46.617726 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:52:46.617702    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4b52fb_a21b_472b_b51e_39bc7775721d.slice/crio-2ea0351120132372108cb95995c1ac1b59debb4bc50bb4e523e138df005537a7 WatchSource:0}: Error finding container 2ea0351120132372108cb95995c1ac1b59debb4bc50bb4e523e138df005537a7: Status 404 returned error can't find the container with id 2ea0351120132372108cb95995c1ac1b59debb4bc50bb4e523e138df005537a7
Jul 07 17:52:46.619878 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.619844    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:52:46.619953 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.619913    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:52:46.619953 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:46.619943    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:52:47.065505 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.065472    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w" event={"ID":"7f4b52fb-a21b-472b-b51e-39bc7775721d","Type":"ContainerStarted","Data":"104aee8dc9cd9ab67e81ad24d8303576d665da3c8d2e92912d62f8c9576d4ae2"}
Jul 07 17:52:47.065699 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.065526    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w" event={"ID":"7f4b52fb-a21b-472b-b51e-39bc7775721d","Type":"ContainerStarted","Data":"2ea0351120132372108cb95995c1ac1b59debb4bc50bb4e523e138df005537a7"}
Jul 07 17:52:47.091398 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.091343    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w" podStartSLOduration=1.091326136 podStartE2EDuration="1.091326136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:52:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:52:47.089125902 +0000 UTC m=+1496.852585748" watchObservedRunningTime="2026-07-07 17:52:47.091326136 +0000 UTC m=+1496.854786064"
Jul 07 17:52:47.408152 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.408084    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"]
Jul 07 17:52:47.411506 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.411488    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:47.413957 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.413931    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-a41f21f0-serving-cert\""
Jul 07 17:52:47.414110 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.413998    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-q97km\""
Jul 07 17:52:47.423560 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.423531    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"]
Jul 07 17:52:47.475559 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.475522    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:47.480591 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.480565    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:47.502750 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.502720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/621f8959-1aca-4617-b324-f5a086e7617b-maas-api-tls\") pod \"maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn\" (UID: \"621f8959-1aca-4617-b324-f5a086e7617b\") " pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:47.502948 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.502811    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9dpv\" (UniqueName: \"kubernetes.io/projected/621f8959-1aca-4617-b324-f5a086e7617b-kube-api-access-v9dpv\") pod \"maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn\" (UID: \"621f8959-1aca-4617-b324-f5a086e7617b\") " pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:47.502948 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.502867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/621f8959-1aca-4617-b324-f5a086e7617b-openshift-service-ca\") pod \"maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn\" (UID: \"621f8959-1aca-4617-b324-f5a086e7617b\") " pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:47.604130 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.604088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/621f8959-1aca-4617-b324-f5a086e7617b-maas-api-tls\") pod \"maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn\" (UID: \"621f8959-1aca-4617-b324-f5a086e7617b\") " pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:47.604342 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.604191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9dpv\" (UniqueName: \"kubernetes.io/projected/621f8959-1aca-4617-b324-f5a086e7617b-kube-api-access-v9dpv\") pod \"maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn\" (UID: \"621f8959-1aca-4617-b324-f5a086e7617b\") " pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:47.604342 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.604235    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/621f8959-1aca-4617-b324-f5a086e7617b-openshift-service-ca\") pod \"maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn\" (UID: \"621f8959-1aca-4617-b324-f5a086e7617b\") " pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:47.604342 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:52:47.604259    2561 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-a41f21f0-serving-cert: secret "maas-api-e2e-ait-a41f21f0-serving-cert" not found
Jul 07 17:52:47.604342 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:52:47.604333    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/621f8959-1aca-4617-b324-f5a086e7617b-maas-api-tls podName:621f8959-1aca-4617-b324-f5a086e7617b nodeName:}" failed. No retries permitted until 2026-07-07 17:52:48.10431129 +0000 UTC m=+1497.867771127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/621f8959-1aca-4617-b324-f5a086e7617b-maas-api-tls") pod "maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn" (UID: "621f8959-1aca-4617-b324-f5a086e7617b") : secret "maas-api-e2e-ait-a41f21f0-serving-cert" not found
Jul 07 17:52:47.604891 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.604874    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/621f8959-1aca-4617-b324-f5a086e7617b-openshift-service-ca\") pod \"maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn\" (UID: \"621f8959-1aca-4617-b324-f5a086e7617b\") " pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:47.616811 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:47.616774    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9dpv\" (UniqueName: \"kubernetes.io/projected/621f8959-1aca-4617-b324-f5a086e7617b-kube-api-access-v9dpv\") pod \"maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn\" (UID: \"621f8959-1aca-4617-b324-f5a086e7617b\") " pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:48.070658 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:48.070594    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:48.071573 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:48.071549    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:48.111892 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:48.111861    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/621f8959-1aca-4617-b324-f5a086e7617b-maas-api-tls\") pod \"maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn\" (UID: \"621f8959-1aca-4617-b324-f5a086e7617b\") " pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:48.114736 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:48.114704    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/621f8959-1aca-4617-b324-f5a086e7617b-maas-api-tls\") pod \"maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn\" (UID: \"621f8959-1aca-4617-b324-f5a086e7617b\") " pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:48.324601 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:48.324500    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:48.472578 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:48.472551    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"]
Jul 07 17:52:48.474782 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:52:48.474725    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod621f8959_1aca_4617_b324_f5a086e7617b.slice/crio-904484ea4735d9277651e47f561b9ca511f665bf818bab6f48a26404a12dcb0c WatchSource:0}: Error finding container 904484ea4735d9277651e47f561b9ca511f665bf818bab6f48a26404a12dcb0c: Status 404 returned error can't find the container with id 904484ea4735d9277651e47f561b9ca511f665bf818bab6f48a26404a12dcb0c
Jul 07 17:52:48.476277 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:48.476251    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:52:49.077535 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:49.077506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn" event={"ID":"621f8959-1aca-4617-b324-f5a086e7617b","Type":"ContainerStarted","Data":"904484ea4735d9277651e47f561b9ca511f665bf818bab6f48a26404a12dcb0c"}
Jul 07 17:52:50.085046 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:50.085006    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn" event={"ID":"621f8959-1aca-4617-b324-f5a086e7617b","Type":"ContainerStarted","Data":"c271ee14bb4360beea2e897bdd5112127101952907a7a0b2933a588babce5e6b"}
Jul 07 17:52:50.104534 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:50.104482    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn" podStartSLOduration=2.573846651 podStartE2EDuration="3.10446448s" totalImagesPullingTime="530.617829ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:52:50.103762151 +0000 UTC m=+1499.867222003" watchObservedRunningTime="2026-07-07 17:52:50.10446448 +0000 UTC m=+1499.867924327"
Jul 07 17:52:51.089767 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:51.089733    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:52.906933 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:52.906895    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"]
Jul 07 17:52:52.907453 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:52.907100    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w" podUID="7f4b52fb-a21b-472b-b51e-39bc7775721d" containerName="istio-proxy" containerID="cri-o://104aee8dc9cd9ab67e81ad24d8303576d665da3c8d2e92912d62f8c9576d4ae2" gracePeriod=30
Jul 07 17:52:53.156701 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:53.156660    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"]
Jul 07 17:52:53.156931 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:53.156877    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn" podUID="621f8959-1aca-4617-b324-f5a086e7617b" containerName="maas-api" containerID="cri-o://c271ee14bb4360beea2e897bdd5112127101952907a7a0b2933a588babce5e6b" gracePeriod=30
Jul 07 17:52:53.406833 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:53.406806    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:53.466721 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:53.466615    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9dpv\" (UniqueName: \"kubernetes.io/projected/621f8959-1aca-4617-b324-f5a086e7617b-kube-api-access-v9dpv\") pod \"621f8959-1aca-4617-b324-f5a086e7617b\" (UID: \"621f8959-1aca-4617-b324-f5a086e7617b\") "
Jul 07 17:52:53.466721 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:53.466684    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/621f8959-1aca-4617-b324-f5a086e7617b-openshift-service-ca\") pod \"621f8959-1aca-4617-b324-f5a086e7617b\" (UID: \"621f8959-1aca-4617-b324-f5a086e7617b\") "
Jul 07 17:52:53.466935 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:53.466778    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/621f8959-1aca-4617-b324-f5a086e7617b-maas-api-tls\") pod \"621f8959-1aca-4617-b324-f5a086e7617b\" (UID: \"621f8959-1aca-4617-b324-f5a086e7617b\") "
Jul 07 17:52:53.467154 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:53.467128    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/621f8959-1aca-4617-b324-f5a086e7617b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "621f8959-1aca-4617-b324-f5a086e7617b" (UID: "621f8959-1aca-4617-b324-f5a086e7617b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:52:53.469119 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:53.469089    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/621f8959-1aca-4617-b324-f5a086e7617b-kube-api-access-v9dpv" (OuterVolumeSpecName: "kube-api-access-v9dpv") pod "621f8959-1aca-4617-b324-f5a086e7617b" (UID: "621f8959-1aca-4617-b324-f5a086e7617b"). InnerVolumeSpecName "kube-api-access-v9dpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:52:53.469119 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:53.469099    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/621f8959-1aca-4617-b324-f5a086e7617b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "621f8959-1aca-4617-b324-f5a086e7617b" (UID: "621f8959-1aca-4617-b324-f5a086e7617b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:52:53.568427 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:53.568391    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/621f8959-1aca-4617-b324-f5a086e7617b-maas-api-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:52:53.568427 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:53.568424    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9dpv\" (UniqueName: \"kubernetes.io/projected/621f8959-1aca-4617-b324-f5a086e7617b-kube-api-access-v9dpv\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:52:53.568427 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:53.568433    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/621f8959-1aca-4617-b324-f5a086e7617b-openshift-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:52:54.106065 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:54.106034    2561 generic.go:356] "Generic (PLEG): container finished" podID="621f8959-1aca-4617-b324-f5a086e7617b" containerID="c271ee14bb4360beea2e897bdd5112127101952907a7a0b2933a588babce5e6b" exitCode=0
Jul 07 17:52:54.106532 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:54.106095    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"
Jul 07 17:52:54.106532 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:54.106101    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn" event={"ID":"621f8959-1aca-4617-b324-f5a086e7617b","Type":"ContainerDied","Data":"c271ee14bb4360beea2e897bdd5112127101952907a7a0b2933a588babce5e6b"}
Jul 07 17:52:54.106532 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:54.106213    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn" event={"ID":"621f8959-1aca-4617-b324-f5a086e7617b","Type":"ContainerDied","Data":"904484ea4735d9277651e47f561b9ca511f665bf818bab6f48a26404a12dcb0c"}
Jul 07 17:52:54.106532 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:54.106239    2561 scope.go:117] "RemoveContainer" containerID="c271ee14bb4360beea2e897bdd5112127101952907a7a0b2933a588babce5e6b"
Jul 07 17:52:54.115915 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:54.115895    2561 scope.go:117] "RemoveContainer" containerID="c271ee14bb4360beea2e897bdd5112127101952907a7a0b2933a588babce5e6b"
Jul 07 17:52:54.116249 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:52:54.116226    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c271ee14bb4360beea2e897bdd5112127101952907a7a0b2933a588babce5e6b\": container with ID starting with c271ee14bb4360beea2e897bdd5112127101952907a7a0b2933a588babce5e6b not found: ID does not exist" containerID="c271ee14bb4360beea2e897bdd5112127101952907a7a0b2933a588babce5e6b"
Jul 07 17:52:54.116342 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:54.116256    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c271ee14bb4360beea2e897bdd5112127101952907a7a0b2933a588babce5e6b"} err="failed to get container status \"c271ee14bb4360beea2e897bdd5112127101952907a7a0b2933a588babce5e6b\": rpc error: code = NotFound desc = could not find container \"c271ee14bb4360beea2e897bdd5112127101952907a7a0b2933a588babce5e6b\": container with ID starting with c271ee14bb4360beea2e897bdd5112127101952907a7a0b2933a588babce5e6b not found: ID does not exist"
Jul 07 17:52:54.130654 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:54.130628    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"]
Jul 07 17:52:54.135280 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:54.135258    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-a41f21f0-649d694f4-8s2pn"]
Jul 07 17:52:54.809568 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:54.809533    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="621f8959-1aca-4617-b324-f5a086e7617b" path="/var/lib/kubelet/pods/621f8959-1aca-4617-b324-f5a086e7617b/volumes"
Jul 07 17:52:58.130685 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.130651    2561 generic.go:356] "Generic (PLEG): container finished" podID="7f4b52fb-a21b-472b-b51e-39bc7775721d" containerID="104aee8dc9cd9ab67e81ad24d8303576d665da3c8d2e92912d62f8c9576d4ae2" exitCode=0
Jul 07 17:52:58.131116 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.130723    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w" event={"ID":"7f4b52fb-a21b-472b-b51e-39bc7775721d","Type":"ContainerDied","Data":"104aee8dc9cd9ab67e81ad24d8303576d665da3c8d2e92912d62f8c9576d4ae2"}
Jul 07 17:52:58.176148 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.176076    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:58.314811 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.314772    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mqbs\" (UniqueName: \"kubernetes.io/projected/7f4b52fb-a21b-472b-b51e-39bc7775721d-kube-api-access-2mqbs\") pod \"7f4b52fb-a21b-472b-b51e-39bc7775721d\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") "
Jul 07 17:52:58.314811 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.314814    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-token\") pod \"7f4b52fb-a21b-472b-b51e-39bc7775721d\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") "
Jul 07 17:52:58.315085 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.314837    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-data\") pod \"7f4b52fb-a21b-472b-b51e-39bc7775721d\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") "
Jul 07 17:52:58.315085 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.314867    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f4b52fb-a21b-472b-b51e-39bc7775721d-istiod-ca-cert\") pod \"7f4b52fb-a21b-472b-b51e-39bc7775721d\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") "
Jul 07 17:52:58.315085 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.314943    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-workload-certs\") pod \"7f4b52fb-a21b-472b-b51e-39bc7775721d\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") "
Jul 07 17:52:58.315085 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.315020    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-podinfo\") pod \"7f4b52fb-a21b-472b-b51e-39bc7775721d\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") "
Jul 07 17:52:58.315085 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.315065    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-credential-socket\") pod \"7f4b52fb-a21b-472b-b51e-39bc7775721d\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") "
Jul 07 17:52:58.315327 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.315143    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-workload-socket\") pod \"7f4b52fb-a21b-472b-b51e-39bc7775721d\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") "
Jul 07 17:52:58.315327 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.315181    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-envoy\") pod \"7f4b52fb-a21b-472b-b51e-39bc7775721d\" (UID: \"7f4b52fb-a21b-472b-b51e-39bc7775721d\") "
Jul 07 17:52:58.315327 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.315235    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f4b52fb-a21b-472b-b51e-39bc7775721d" (UID: "7f4b52fb-a21b-472b-b51e-39bc7775721d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:52:58.315480 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.315325    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f4b52fb-a21b-472b-b51e-39bc7775721d" (UID: "7f4b52fb-a21b-472b-b51e-39bc7775721d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:52:58.315480 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.315389    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f4b52fb-a21b-472b-b51e-39bc7775721d" (UID: "7f4b52fb-a21b-472b-b51e-39bc7775721d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:52:58.315480 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.315429    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f4b52fb-a21b-472b-b51e-39bc7775721d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f4b52fb-a21b-472b-b51e-39bc7775721d" (UID: "7f4b52fb-a21b-472b-b51e-39bc7775721d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:52:58.315480 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.315459    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f4b52fb-a21b-472b-b51e-39bc7775721d" (UID: "7f4b52fb-a21b-472b-b51e-39bc7775721d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:52:58.315651 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.315567    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:52:58.315651 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.315586    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f4b52fb-a21b-472b-b51e-39bc7775721d-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:52:58.315651 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.315599    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:52:58.315651 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.315608    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:52:58.315651 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.315616    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:52:58.317461 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.317433    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f4b52fb-a21b-472b-b51e-39bc7775721d-kube-api-access-2mqbs" (OuterVolumeSpecName: "kube-api-access-2mqbs") pod "7f4b52fb-a21b-472b-b51e-39bc7775721d" (UID: "7f4b52fb-a21b-472b-b51e-39bc7775721d"). InnerVolumeSpecName "kube-api-access-2mqbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:52:58.317589 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.317479    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f4b52fb-a21b-472b-b51e-39bc7775721d" (UID: "7f4b52fb-a21b-472b-b51e-39bc7775721d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:52:58.317639 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.317608    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f4b52fb-a21b-472b-b51e-39bc7775721d" (UID: "7f4b52fb-a21b-472b-b51e-39bc7775721d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 17:52:58.317677 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.317661    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f4b52fb-a21b-472b-b51e-39bc7775721d" (UID: "7f4b52fb-a21b-472b-b51e-39bc7775721d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:52:58.416495 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.416458    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:52:58.416495 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.416489    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mqbs\" (UniqueName: \"kubernetes.io/projected/7f4b52fb-a21b-472b-b51e-39bc7775721d-kube-api-access-2mqbs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:52:58.416495 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.416498    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:52:58.416495 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:58.416507    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f4b52fb-a21b-472b-b51e-39bc7775721d-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:52:59.137026 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.136926    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w" event={"ID":"7f4b52fb-a21b-472b-b51e-39bc7775721d","Type":"ContainerDied","Data":"2ea0351120132372108cb95995c1ac1b59debb4bc50bb4e523e138df005537a7"}
Jul 07 17:52:59.137026 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.136948    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"
Jul 07 17:52:59.137026 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.137013    2561 scope.go:117] "RemoveContainer" containerID="104aee8dc9cd9ab67e81ad24d8303576d665da3c8d2e92912d62f8c9576d4ae2"
Jul 07 17:52:59.157295 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.157254    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"]
Jul 07 17:52:59.163476 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.163445    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a41f21f0-openshift-default-9655f7c5c-b4x7w"]
Jul 07 17:52:59.498813 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.498734    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"]
Jul 07 17:52:59.499181 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.499166    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f4b52fb-a21b-472b-b51e-39bc7775721d" containerName="istio-proxy"
Jul 07 17:52:59.499225 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.499185    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f4b52fb-a21b-472b-b51e-39bc7775721d" containerName="istio-proxy"
Jul 07 17:52:59.499225 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.499199    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="621f8959-1aca-4617-b324-f5a086e7617b" containerName="maas-api"
Jul 07 17:52:59.499225 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.499204    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="621f8959-1aca-4617-b324-f5a086e7617b" containerName="maas-api"
Jul 07 17:52:59.499332 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.499262    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="621f8959-1aca-4617-b324-f5a086e7617b" containerName="maas-api"
Jul 07 17:52:59.499332 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.499271    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f4b52fb-a21b-472b-b51e-39bc7775721d" containerName="istio-proxy"
Jul 07 17:52:59.503640 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.503619    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.506281 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.506258    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-330f7a71-openshift-default-dockercfg-k68xs\""
Jul 07 17:52:59.518036 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.518003    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"]
Jul 07 17:52:59.629597 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.629556    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-workload-certs\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.629812 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.629608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-workload-socket\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.629812 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.629705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-credential-socket\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.629812 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.629746    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-token\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.629812 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.629804    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-envoy\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.630013 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.629859    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-data\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.630013 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.629881    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8vn7\" (UniqueName: \"kubernetes.io/projected/7f0930cc-ef4e-45db-b53a-f3052354ec35-kube-api-access-m8vn7\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.630013 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.629911    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f0930cc-ef4e-45db-b53a-f3052354ec35-istiod-ca-cert\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.630013 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.629991    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-podinfo\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.730780 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.730739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-podinfo\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.730996 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.730807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-workload-certs\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.730996 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.730848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-workload-socket\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.730996 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.730903    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-credential-socket\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.731531 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.731060    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-token\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.731531 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.731107    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-envoy\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.731531 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.731164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-data\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.731531 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.731199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vn7\" (UniqueName: \"kubernetes.io/projected/7f0930cc-ef4e-45db-b53a-f3052354ec35-kube-api-access-m8vn7\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.731531 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.731266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f0930cc-ef4e-45db-b53a-f3052354ec35-istiod-ca-cert\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.731531 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.731293    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-workload-socket\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.731531 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.731372    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-credential-socket\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.731919 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.731539    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-data\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.731919 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.731643    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-workload-certs\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.732077 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.732058    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f0930cc-ef4e-45db-b53a-f3052354ec35-istiod-ca-cert\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.733373 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.733336    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-envoy\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.733484 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.733467    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-podinfo\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.740279 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.740253    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-token\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.740944 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.740917    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8vn7\" (UniqueName: \"kubernetes.io/projected/7f0930cc-ef4e-45db-b53a-f3052354ec35-kube-api-access-m8vn7\") pod \"e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") " pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.816418 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.816379    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:52:59.963031 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.962951    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"]
Jul 07 17:52:59.966064 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:52:59.966028    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f0930cc_ef4e_45db_b53a_f3052354ec35.slice/crio-16a68c97bae181c88ee83285e0f2bbfeaaf95c51f6e5ce45cc55e8eda22bd956 WatchSource:0}: Error finding container 16a68c97bae181c88ee83285e0f2bbfeaaf95c51f6e5ce45cc55e8eda22bd956: Status 404 returned error can't find the container with id 16a68c97bae181c88ee83285e0f2bbfeaaf95c51f6e5ce45cc55e8eda22bd956
Jul 07 17:52:59.968228 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.968193    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:52:59.968317 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.968266    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:52:59.968317 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:52:59.968294    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:53:00.146922 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:00.146812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz" event={"ID":"7f0930cc-ef4e-45db-b53a-f3052354ec35","Type":"ContainerStarted","Data":"f86fe76bb97f7350d6893d5f1bbe5c084e6e674e691c6ac2b6f1d0a3be9f0076"}
Jul 07 17:53:00.146922 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:00.146867    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz" event={"ID":"7f0930cc-ef4e-45db-b53a-f3052354ec35","Type":"ContainerStarted","Data":"16a68c97bae181c88ee83285e0f2bbfeaaf95c51f6e5ce45cc55e8eda22bd956"}
Jul 07 17:53:00.175764 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:00.175694    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz" podStartSLOduration=1.175678512 podStartE2EDuration="1.175678512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:52:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:00.17290729 +0000 UTC m=+1509.936367138" watchObservedRunningTime="2026-07-07 17:53:00.175678512 +0000 UTC m=+1509.939138357"
Jul 07 17:53:00.771371 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:00.771330    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"]
Jul 07 17:53:00.777251 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:00.777218    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:00.779856 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:00.779826    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-q97km\""
Jul 07 17:53:00.780239 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:00.780222    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-330f7a71-serving-cert\""
Jul 07 17:53:00.788136 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:00.788108    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"]
Jul 07 17:53:00.811246 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:00.811211    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f4b52fb-a21b-472b-b51e-39bc7775721d" path="/var/lib/kubelet/pods/7f4b52fb-a21b-472b-b51e-39bc7775721d/volumes"
Jul 07 17:53:00.817053 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:00.817028    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:53:00.944151 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:00.944109    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcd3f870-b56f-4b13-bcb4-0998cbabc270-maas-api-tls\") pod \"maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s\" (UID: \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\") " pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:00.944312 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:00.944169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qbbl\" (UniqueName: \"kubernetes.io/projected/fcd3f870-b56f-4b13-bcb4-0998cbabc270-kube-api-access-6qbbl\") pod \"maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s\" (UID: \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\") " pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:00.944312 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:00.944193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcd3f870-b56f-4b13-bcb4-0998cbabc270-openshift-service-ca\") pod \"maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s\" (UID: \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\") " pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:01.045265 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:01.045171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qbbl\" (UniqueName: \"kubernetes.io/projected/fcd3f870-b56f-4b13-bcb4-0998cbabc270-kube-api-access-6qbbl\") pod \"maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s\" (UID: \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\") " pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:01.045265 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:01.045217    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcd3f870-b56f-4b13-bcb4-0998cbabc270-openshift-service-ca\") pod \"maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s\" (UID: \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\") " pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:01.045463 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:01.045299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcd3f870-b56f-4b13-bcb4-0998cbabc270-maas-api-tls\") pod \"maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s\" (UID: \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\") " pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:01.046019 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:01.045961    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcd3f870-b56f-4b13-bcb4-0998cbabc270-openshift-service-ca\") pod \"maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s\" (UID: \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\") " pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:01.047828 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:01.047810    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcd3f870-b56f-4b13-bcb4-0998cbabc270-maas-api-tls\") pod \"maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s\" (UID: \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\") " pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:01.058248 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:01.058217    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qbbl\" (UniqueName: \"kubernetes.io/projected/fcd3f870-b56f-4b13-bcb4-0998cbabc270-kube-api-access-6qbbl\") pod \"maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s\" (UID: \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\") " pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:01.093119 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:01.093079    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:01.251116 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:01.251092    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"]
Jul 07 17:53:01.252291 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:53:01.252266    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd3f870_b56f_4b13_bcb4_0998cbabc270.slice/crio-3092dcd8c82ad09c0feae72652e07613cf8125498a4cb1ad4e99a2d98a644e2c WatchSource:0}: Error finding container 3092dcd8c82ad09c0feae72652e07613cf8125498a4cb1ad4e99a2d98a644e2c: Status 404 returned error can't find the container with id 3092dcd8c82ad09c0feae72652e07613cf8125498a4cb1ad4e99a2d98a644e2c
Jul 07 17:53:01.822097 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:01.822062    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:53:02.161709 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:02.161667    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s" event={"ID":"fcd3f870-b56f-4b13-bcb4-0998cbabc270","Type":"ContainerStarted","Data":"54d4664985e8da5ff687006b02c6a823521d695b1372bc10c70620ef05b2e5fd"}
Jul 07 17:53:02.161894 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:02.161726    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s" event={"ID":"fcd3f870-b56f-4b13-bcb4-0998cbabc270","Type":"ContainerStarted","Data":"3092dcd8c82ad09c0feae72652e07613cf8125498a4cb1ad4e99a2d98a644e2c"}
Jul 07 17:53:02.161894 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:02.161773    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:53:02.161894 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:02.161820    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:02.162994 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:02.162958    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:53:02.182060 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:02.182006    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s" podStartSLOduration=1.769440906 podStartE2EDuration="2.181988316s" totalImagesPullingTime="412.54741ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:53:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:02.17960994 +0000 UTC m=+1511.943069787" watchObservedRunningTime="2026-07-07 17:53:02.181988316 +0000 UTC m=+1511.945448153"
Jul 07 17:53:06.366560 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:06.366522    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"]
Jul 07 17:53:06.367112 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:06.366728    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s" podUID="fcd3f870-b56f-4b13-bcb4-0998cbabc270" containerName="maas-api" containerID="cri-o://54d4664985e8da5ff687006b02c6a823521d695b1372bc10c70620ef05b2e5fd" gracePeriod=30
Jul 07 17:53:06.371807 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:06.371782    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:06.619778 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:06.619705    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:06.701853 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:06.701809    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qbbl\" (UniqueName: \"kubernetes.io/projected/fcd3f870-b56f-4b13-bcb4-0998cbabc270-kube-api-access-6qbbl\") pod \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\" (UID: \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\") "
Jul 07 17:53:06.702098 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:06.701940    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcd3f870-b56f-4b13-bcb4-0998cbabc270-maas-api-tls\") pod \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\" (UID: \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\") "
Jul 07 17:53:06.702098 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:06.702043    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcd3f870-b56f-4b13-bcb4-0998cbabc270-openshift-service-ca\") pod \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\" (UID: \"fcd3f870-b56f-4b13-bcb4-0998cbabc270\") "
Jul 07 17:53:06.702378 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:06.702350    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcd3f870-b56f-4b13-bcb4-0998cbabc270-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fcd3f870-b56f-4b13-bcb4-0998cbabc270" (UID: "fcd3f870-b56f-4b13-bcb4-0998cbabc270"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:53:06.704221 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:06.704195    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcd3f870-b56f-4b13-bcb4-0998cbabc270-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fcd3f870-b56f-4b13-bcb4-0998cbabc270" (UID: "fcd3f870-b56f-4b13-bcb4-0998cbabc270"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:53:06.704292 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:06.704257    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcd3f870-b56f-4b13-bcb4-0998cbabc270-kube-api-access-6qbbl" (OuterVolumeSpecName: "kube-api-access-6qbbl") pod "fcd3f870-b56f-4b13-bcb4-0998cbabc270" (UID: "fcd3f870-b56f-4b13-bcb4-0998cbabc270"). InnerVolumeSpecName "kube-api-access-6qbbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:53:06.803520 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:06.803475    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcd3f870-b56f-4b13-bcb4-0998cbabc270-maas-api-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:06.803520 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:06.803512    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcd3f870-b56f-4b13-bcb4-0998cbabc270-openshift-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:06.803520 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:06.803526    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qbbl\" (UniqueName: \"kubernetes.io/projected/fcd3f870-b56f-4b13-bcb4-0998cbabc270-kube-api-access-6qbbl\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:07.189611 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:07.189570    2561 generic.go:356] "Generic (PLEG): container finished" podID="fcd3f870-b56f-4b13-bcb4-0998cbabc270" containerID="54d4664985e8da5ff687006b02c6a823521d695b1372bc10c70620ef05b2e5fd" exitCode=0
Jul 07 17:53:07.189611 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:07.189613    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s" event={"ID":"fcd3f870-b56f-4b13-bcb4-0998cbabc270","Type":"ContainerDied","Data":"54d4664985e8da5ff687006b02c6a823521d695b1372bc10c70620ef05b2e5fd"}
Jul 07 17:53:07.189889 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:07.189636    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"
Jul 07 17:53:07.189889 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:07.189667    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s" event={"ID":"fcd3f870-b56f-4b13-bcb4-0998cbabc270","Type":"ContainerDied","Data":"3092dcd8c82ad09c0feae72652e07613cf8125498a4cb1ad4e99a2d98a644e2c"}
Jul 07 17:53:07.189889 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:07.189692    2561 scope.go:117] "RemoveContainer" containerID="54d4664985e8da5ff687006b02c6a823521d695b1372bc10c70620ef05b2e5fd"
Jul 07 17:53:07.198600 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:07.198579    2561 scope.go:117] "RemoveContainer" containerID="54d4664985e8da5ff687006b02c6a823521d695b1372bc10c70620ef05b2e5fd"
Jul 07 17:53:07.198918 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:53:07.198888    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54d4664985e8da5ff687006b02c6a823521d695b1372bc10c70620ef05b2e5fd\": container with ID starting with 54d4664985e8da5ff687006b02c6a823521d695b1372bc10c70620ef05b2e5fd not found: ID does not exist" containerID="54d4664985e8da5ff687006b02c6a823521d695b1372bc10c70620ef05b2e5fd"
Jul 07 17:53:07.199025 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:07.198927    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54d4664985e8da5ff687006b02c6a823521d695b1372bc10c70620ef05b2e5fd"} err="failed to get container status \"54d4664985e8da5ff687006b02c6a823521d695b1372bc10c70620ef05b2e5fd\": rpc error: code = NotFound desc = could not find container \"54d4664985e8da5ff687006b02c6a823521d695b1372bc10c70620ef05b2e5fd\": container with ID starting with 54d4664985e8da5ff687006b02c6a823521d695b1372bc10c70620ef05b2e5fd not found: ID does not exist"
Jul 07 17:53:07.209738 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:07.209709    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"]
Jul 07 17:53:07.215557 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:07.215531    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-330f7a71-6776bc8f7-2ph5s"]
Jul 07 17:53:08.810045 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:08.810009    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcd3f870-b56f-4b13-bcb4-0998cbabc270" path="/var/lib/kubelet/pods/fcd3f870-b56f-4b13-bcb4-0998cbabc270/volumes"
Jul 07 17:53:12.258052 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:12.257948    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"]
Jul 07 17:53:12.258436 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:12.258188    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz" podUID="7f0930cc-ef4e-45db-b53a-f3052354ec35" containerName="istio-proxy" containerID="cri-o://f86fe76bb97f7350d6893d5f1bbe5c084e6e674e691c6ac2b6f1d0a3be9f0076" gracePeriod=30
Jul 07 17:53:17.164046 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.164007    2561 patch_prober.go:28] interesting pod/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 17:53:17.164424 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.164069    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz" podUID="7f0930cc-ef4e-45db-b53a-f3052354ec35" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 17:53:17.516333 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.516306    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:53:17.614528 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.614487    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-podinfo\") pod \"7f0930cc-ef4e-45db-b53a-f3052354ec35\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") "
Jul 07 17:53:17.614740 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.614548    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-workload-certs\") pod \"7f0930cc-ef4e-45db-b53a-f3052354ec35\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") "
Jul 07 17:53:17.614740 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.614568    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8vn7\" (UniqueName: \"kubernetes.io/projected/7f0930cc-ef4e-45db-b53a-f3052354ec35-kube-api-access-m8vn7\") pod \"7f0930cc-ef4e-45db-b53a-f3052354ec35\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") "
Jul 07 17:53:17.614740 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.614621    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-envoy\") pod \"7f0930cc-ef4e-45db-b53a-f3052354ec35\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") "
Jul 07 17:53:17.614740 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.614671    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f0930cc-ef4e-45db-b53a-f3052354ec35-istiod-ca-cert\") pod \"7f0930cc-ef4e-45db-b53a-f3052354ec35\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") "
Jul 07 17:53:17.614740 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.614710    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-workload-socket\") pod \"7f0930cc-ef4e-45db-b53a-f3052354ec35\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") "
Jul 07 17:53:17.615054 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.614758    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-token\") pod \"7f0930cc-ef4e-45db-b53a-f3052354ec35\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") "
Jul 07 17:53:17.615054 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.614778    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-data\") pod \"7f0930cc-ef4e-45db-b53a-f3052354ec35\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") "
Jul 07 17:53:17.615054 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.614810    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-credential-socket\") pod \"7f0930cc-ef4e-45db-b53a-f3052354ec35\" (UID: \"7f0930cc-ef4e-45db-b53a-f3052354ec35\") "
Jul 07 17:53:17.615054 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.614873    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f0930cc-ef4e-45db-b53a-f3052354ec35" (UID: "7f0930cc-ef4e-45db-b53a-f3052354ec35"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:53:17.615253 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.615086    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f0930cc-ef4e-45db-b53a-f3052354ec35" (UID: "7f0930cc-ef4e-45db-b53a-f3052354ec35"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:53:17.615253 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.615106    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f0930cc-ef4e-45db-b53a-f3052354ec35-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f0930cc-ef4e-45db-b53a-f3052354ec35" (UID: "7f0930cc-ef4e-45db-b53a-f3052354ec35"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:53:17.615253 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.615109    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f0930cc-ef4e-45db-b53a-f3052354ec35" (UID: "7f0930cc-ef4e-45db-b53a-f3052354ec35"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:53:17.615573 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.615317    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f0930cc-ef4e-45db-b53a-f3052354ec35" (UID: "7f0930cc-ef4e-45db-b53a-f3052354ec35"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:53:17.615631 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.615567    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f0930cc-ef4e-45db-b53a-f3052354ec35-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:17.615631 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.615589    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:17.615631 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.615605    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:17.615631 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.615619    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:17.615846 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.615653    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:17.617202 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.617162    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f0930cc-ef4e-45db-b53a-f3052354ec35" (UID: "7f0930cc-ef4e-45db-b53a-f3052354ec35"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:53:17.617202 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.617194    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f0930cc-ef4e-45db-b53a-f3052354ec35-kube-api-access-m8vn7" (OuterVolumeSpecName: "kube-api-access-m8vn7") pod "7f0930cc-ef4e-45db-b53a-f3052354ec35" (UID: "7f0930cc-ef4e-45db-b53a-f3052354ec35"). InnerVolumeSpecName "kube-api-access-m8vn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:53:17.617402 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.617207    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f0930cc-ef4e-45db-b53a-f3052354ec35" (UID: "7f0930cc-ef4e-45db-b53a-f3052354ec35"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 17:53:17.617461 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.617429    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f0930cc-ef4e-45db-b53a-f3052354ec35" (UID: "7f0930cc-ef4e-45db-b53a-f3052354ec35"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:53:17.717068 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.716958    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:17.717068 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.717011    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:17.717068 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.717024    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8vn7\" (UniqueName: \"kubernetes.io/projected/7f0930cc-ef4e-45db-b53a-f3052354ec35-kube-api-access-m8vn7\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:17.717068 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:17.717039    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f0930cc-ef4e-45db-b53a-f3052354ec35-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:18.246457 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.246419    2561 generic.go:356] "Generic (PLEG): container finished" podID="7f0930cc-ef4e-45db-b53a-f3052354ec35" containerID="f86fe76bb97f7350d6893d5f1bbe5c084e6e674e691c6ac2b6f1d0a3be9f0076" exitCode=0
Jul 07 17:53:18.246952 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.246479    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"
Jul 07 17:53:18.246952 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.246491    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz" event={"ID":"7f0930cc-ef4e-45db-b53a-f3052354ec35","Type":"ContainerDied","Data":"f86fe76bb97f7350d6893d5f1bbe5c084e6e674e691c6ac2b6f1d0a3be9f0076"}
Jul 07 17:53:18.246952 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.246539    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz" event={"ID":"7f0930cc-ef4e-45db-b53a-f3052354ec35","Type":"ContainerDied","Data":"16a68c97bae181c88ee83285e0f2bbfeaaf95c51f6e5ce45cc55e8eda22bd956"}
Jul 07 17:53:18.246952 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.246560    2561 scope.go:117] "RemoveContainer" containerID="f86fe76bb97f7350d6893d5f1bbe5c084e6e674e691c6ac2b6f1d0a3be9f0076"
Jul 07 17:53:18.256523 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.256497    2561 scope.go:117] "RemoveContainer" containerID="f86fe76bb97f7350d6893d5f1bbe5c084e6e674e691c6ac2b6f1d0a3be9f0076"
Jul 07 17:53:18.256830 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:53:18.256811    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f86fe76bb97f7350d6893d5f1bbe5c084e6e674e691c6ac2b6f1d0a3be9f0076\": container with ID starting with f86fe76bb97f7350d6893d5f1bbe5c084e6e674e691c6ac2b6f1d0a3be9f0076 not found: ID does not exist" containerID="f86fe76bb97f7350d6893d5f1bbe5c084e6e674e691c6ac2b6f1d0a3be9f0076"
Jul 07 17:53:18.256896 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.256841    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f86fe76bb97f7350d6893d5f1bbe5c084e6e674e691c6ac2b6f1d0a3be9f0076"} err="failed to get container status \"f86fe76bb97f7350d6893d5f1bbe5c084e6e674e691c6ac2b6f1d0a3be9f0076\": rpc error: code = NotFound desc = could not find container \"f86fe76bb97f7350d6893d5f1bbe5c084e6e674e691c6ac2b6f1d0a3be9f0076\": container with ID starting with f86fe76bb97f7350d6893d5f1bbe5c084e6e674e691c6ac2b6f1d0a3be9f0076 not found: ID does not exist"
Jul 07 17:53:18.271528 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.271496    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"]
Jul 07 17:53:18.276438 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.276411    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-330f7a71-openshift-default-6fdd9954c-cgrrz"]
Jul 07 17:53:18.809519 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.809481    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f0930cc-ef4e-45db-b53a-f3052354ec35" path="/var/lib/kubelet/pods/7f0930cc-ef4e-45db-b53a-f3052354ec35/volumes"
Jul 07 17:53:18.987248 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.987215    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"]
Jul 07 17:53:18.987745 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.987720    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd3f870-b56f-4b13-bcb4-0998cbabc270" containerName="maas-api"
Jul 07 17:53:18.987863 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.987760    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd3f870-b56f-4b13-bcb4-0998cbabc270" containerName="maas-api"
Jul 07 17:53:18.987863 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.987775    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f0930cc-ef4e-45db-b53a-f3052354ec35" containerName="istio-proxy"
Jul 07 17:53:18.987863 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.987781    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f0930cc-ef4e-45db-b53a-f3052354ec35" containerName="istio-proxy"
Jul 07 17:53:18.988028 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.987884    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f0930cc-ef4e-45db-b53a-f3052354ec35" containerName="istio-proxy"
Jul 07 17:53:18.988028 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.987896    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcd3f870-b56f-4b13-bcb4-0998cbabc270" containerName="maas-api"
Jul 07 17:53:18.991361 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.991338    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:18.994017 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:18.993996    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-4540e23c-openshift-default-dockercfg-svlf6\""
Jul 07 17:53:19.005263 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.005237    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"]
Jul 07 17:53:19.029885 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.029846    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-workload-certs\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.030087 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.029895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-credential-socket\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.030087 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.029913    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-envoy\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.030087 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.029993    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsg7g\" (UniqueName: \"kubernetes.io/projected/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-kube-api-access-vsg7g\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.030087 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.030029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-podinfo\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.030087 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.030060    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istiod-ca-cert\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.030340 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.030111    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-token\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.030340 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.030205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-workload-socket\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.030340 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.030285    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-data\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.131789 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.131693    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-workload-socket\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.131789 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.131745    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-data\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.131789 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.131778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-workload-certs\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.132112 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.131805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-credential-socket\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.132112 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.131824    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-envoy\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.132112 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.131845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsg7g\" (UniqueName: \"kubernetes.io/projected/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-kube-api-access-vsg7g\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.132112 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.132036    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-podinfo\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.132112 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.132089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istiod-ca-cert\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.132368 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.132139    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-token\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.132368 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.132208    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-workload-socket\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.132368 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.132226    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-workload-certs\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.132368 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.132331    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-data\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.132533 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.132401    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-credential-socket\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.132741 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.132723    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istiod-ca-cert\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.134520 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.134498    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-envoy\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.134730 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.134704    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-podinfo\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.141773 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.141746    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-token\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.142162 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.142138    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsg7g\" (UniqueName: \"kubernetes.io/projected/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-kube-api-access-vsg7g\") pod \"e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") " pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.302111 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.302073    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:19.471165 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.471133    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"]
Jul 07 17:53:19.472646 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:53:19.472614    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10e538a_64bb_473e_91bc_09aaf4bf5fa3.slice/crio-9e23a0f123d676c1f9aff9600d208dbdc278eeec5cf2cba9ded9dd67aead47c3 WatchSource:0}: Error finding container 9e23a0f123d676c1f9aff9600d208dbdc278eeec5cf2cba9ded9dd67aead47c3: Status 404 returned error can't find the container with id 9e23a0f123d676c1f9aff9600d208dbdc278eeec5cf2cba9ded9dd67aead47c3
Jul 07 17:53:19.474892 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.474852    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:53:19.475004 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.474952    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:53:19.475055 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:19.475042    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:53:20.259683 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.259641    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l" event={"ID":"e10e538a-64bb-473e-91bc-09aaf4bf5fa3","Type":"ContainerStarted","Data":"7e5f8f35099a6bd22e8945a1dfd14a04e39e765d87245ffc57da791d5000c933"}
Jul 07 17:53:20.259889 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.259704    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l" event={"ID":"e10e538a-64bb-473e-91bc-09aaf4bf5fa3","Type":"ContainerStarted","Data":"9e23a0f123d676c1f9aff9600d208dbdc278eeec5cf2cba9ded9dd67aead47c3"}
Jul 07 17:53:20.289273 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.289221    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l" podStartSLOduration=2.289202828 podStartE2EDuration="2.289202828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:53:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:20.286550816 +0000 UTC m=+1530.050010655" watchObservedRunningTime="2026-07-07 17:53:20.289202828 +0000 UTC m=+1530.052662674"
Jul 07 17:53:20.300286 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.300240    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"]
Jul 07 17:53:20.303932 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.303907    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:20.304396 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.304033    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"
Jul 07 17:53:20.306686 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.306660    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-4540e23c-serving-cert\""
Jul 07 17:53:20.306686 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.306674    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-q97km\""
Jul 07 17:53:20.308236 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.308217    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:20.315326 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.315295    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"]
Jul 07 17:53:20.344120 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.344077    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76a0afa2-296c-4e69-83d0-80b9e3fac139-openshift-service-ca\") pod \"maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4\" (UID: \"76a0afa2-296c-4e69-83d0-80b9e3fac139\") " pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"
Jul 07 17:53:20.344338 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.344129    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76a0afa2-296c-4e69-83d0-80b9e3fac139-maas-api-tls\") pod \"maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4\" (UID: \"76a0afa2-296c-4e69-83d0-80b9e3fac139\") " pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"
Jul 07 17:53:20.344409 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.344334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzbdz\" (UniqueName: \"kubernetes.io/projected/76a0afa2-296c-4e69-83d0-80b9e3fac139-kube-api-access-hzbdz\") pod \"maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4\" (UID: \"76a0afa2-296c-4e69-83d0-80b9e3fac139\") " pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"
Jul 07 17:53:20.445178 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.445142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbdz\" (UniqueName: \"kubernetes.io/projected/76a0afa2-296c-4e69-83d0-80b9e3fac139-kube-api-access-hzbdz\") pod \"maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4\" (UID: \"76a0afa2-296c-4e69-83d0-80b9e3fac139\") " pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"
Jul 07 17:53:20.445178 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.445178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76a0afa2-296c-4e69-83d0-80b9e3fac139-openshift-service-ca\") pod \"maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4\" (UID: \"76a0afa2-296c-4e69-83d0-80b9e3fac139\") " pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"
Jul 07 17:53:20.445442 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.445308    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76a0afa2-296c-4e69-83d0-80b9e3fac139-maas-api-tls\") pod \"maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4\" (UID: \"76a0afa2-296c-4e69-83d0-80b9e3fac139\") " pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"
Jul 07 17:53:20.445842 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.445820    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76a0afa2-296c-4e69-83d0-80b9e3fac139-openshift-service-ca\") pod \"maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4\" (UID: \"76a0afa2-296c-4e69-83d0-80b9e3fac139\") " pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"
Jul 07 17:53:20.448062 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.448038    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76a0afa2-296c-4e69-83d0-80b9e3fac139-maas-api-tls\") pod \"maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4\" (UID: \"76a0afa2-296c-4e69-83d0-80b9e3fac139\") " pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"
Jul 07 17:53:20.460821 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.460791    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzbdz\" (UniqueName: \"kubernetes.io/projected/76a0afa2-296c-4e69-83d0-80b9e3fac139-kube-api-access-hzbdz\") pod \"maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4\" (UID: \"76a0afa2-296c-4e69-83d0-80b9e3fac139\") " pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"
Jul 07 17:53:20.617258 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.617221    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"
Jul 07 17:53:20.766620 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:20.766592    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"]
Jul 07 17:53:20.768790 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:53:20.768761    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a0afa2_296c_4e69_83d0_80b9e3fac139.slice/crio-5f9e4011f32c9c222bfe3d0d335fc9a398c07d06768ca1e42fa7313e6772f29e WatchSource:0}: Error finding container 5f9e4011f32c9c222bfe3d0d335fc9a398c07d06768ca1e42fa7313e6772f29e: Status 404 returned error can't find the container with id 5f9e4011f32c9c222bfe3d0d335fc9a398c07d06768ca1e42fa7313e6772f29e
Jul 07 17:53:21.266689 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:21.266650    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4" event={"ID":"76a0afa2-296c-4e69-83d0-80b9e3fac139","Type":"ContainerStarted","Data":"292b869b952f8f82db523162959b54de5cd3cba311a6cf4c8f1ec14be01b6cea"}
Jul 07 17:53:21.266882 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:21.266704    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4" event={"ID":"76a0afa2-296c-4e69-83d0-80b9e3fac139","Type":"ContainerStarted","Data":"5f9e4011f32c9c222bfe3d0d335fc9a398c07d06768ca1e42fa7313e6772f29e"}
Jul 07 17:53:21.266953 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:21.266927    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"
Jul 07 17:53:21.267030 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:21.266982    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:21.267960 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:21.267946    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:21.286994 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:21.286916    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4" podStartSLOduration=0.927437324 podStartE2EDuration="1.286897862s" totalImagesPullingTime="359.460538ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:53:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:21.28521483 +0000 UTC m=+1531.048674677" watchObservedRunningTime="2026-07-07 17:53:21.286897862 +0000 UTC m=+1531.050357707"
Jul 07 17:53:24.759013 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:24.758978    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"]
Jul 07 17:53:24.759492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:24.759193    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l" podUID="e10e538a-64bb-473e-91bc-09aaf4bf5fa3" containerName="istio-proxy" containerID="cri-o://7e5f8f35099a6bd22e8945a1dfd14a04e39e765d87245ffc57da791d5000c933" gracePeriod=30
Jul 07 17:53:24.989016 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:24.988957    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"]
Jul 07 17:53:24.989337 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:24.989265    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4" podUID="76a0afa2-296c-4e69-83d0-80b9e3fac139" containerName="maas-api" containerID="cri-o://292b869b952f8f82db523162959b54de5cd3cba311a6cf4c8f1ec14be01b6cea" gracePeriod=30
Jul 07 17:53:25.242248 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.242219    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"
Jul 07 17:53:25.288840 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.288808    2561 generic.go:356] "Generic (PLEG): container finished" podID="76a0afa2-296c-4e69-83d0-80b9e3fac139" containerID="292b869b952f8f82db523162959b54de5cd3cba311a6cf4c8f1ec14be01b6cea" exitCode=0
Jul 07 17:53:25.289019 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.288852    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"
Jul 07 17:53:25.289019 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.288879    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4" event={"ID":"76a0afa2-296c-4e69-83d0-80b9e3fac139","Type":"ContainerDied","Data":"292b869b952f8f82db523162959b54de5cd3cba311a6cf4c8f1ec14be01b6cea"}
Jul 07 17:53:25.289019 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.288923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4" event={"ID":"76a0afa2-296c-4e69-83d0-80b9e3fac139","Type":"ContainerDied","Data":"5f9e4011f32c9c222bfe3d0d335fc9a398c07d06768ca1e42fa7313e6772f29e"}
Jul 07 17:53:25.289019 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.288945    2561 scope.go:117] "RemoveContainer" containerID="292b869b952f8f82db523162959b54de5cd3cba311a6cf4c8f1ec14be01b6cea"
Jul 07 17:53:25.292331 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.292308    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76a0afa2-296c-4e69-83d0-80b9e3fac139-openshift-service-ca\") pod \"76a0afa2-296c-4e69-83d0-80b9e3fac139\" (UID: \"76a0afa2-296c-4e69-83d0-80b9e3fac139\") "
Jul 07 17:53:25.292461 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.292347    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzbdz\" (UniqueName: \"kubernetes.io/projected/76a0afa2-296c-4e69-83d0-80b9e3fac139-kube-api-access-hzbdz\") pod \"76a0afa2-296c-4e69-83d0-80b9e3fac139\" (UID: \"76a0afa2-296c-4e69-83d0-80b9e3fac139\") "
Jul 07 17:53:25.292527 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.292486    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76a0afa2-296c-4e69-83d0-80b9e3fac139-maas-api-tls\") pod \"76a0afa2-296c-4e69-83d0-80b9e3fac139\" (UID: \"76a0afa2-296c-4e69-83d0-80b9e3fac139\") "
Jul 07 17:53:25.292673 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.292646    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76a0afa2-296c-4e69-83d0-80b9e3fac139-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "76a0afa2-296c-4e69-83d0-80b9e3fac139" (UID: "76a0afa2-296c-4e69-83d0-80b9e3fac139"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:53:25.292886 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.292856    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76a0afa2-296c-4e69-83d0-80b9e3fac139-openshift-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:25.295315 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.295286    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76a0afa2-296c-4e69-83d0-80b9e3fac139-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "76a0afa2-296c-4e69-83d0-80b9e3fac139" (UID: "76a0afa2-296c-4e69-83d0-80b9e3fac139"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:53:25.295423 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.295328    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a0afa2-296c-4e69-83d0-80b9e3fac139-kube-api-access-hzbdz" (OuterVolumeSpecName: "kube-api-access-hzbdz") pod "76a0afa2-296c-4e69-83d0-80b9e3fac139" (UID: "76a0afa2-296c-4e69-83d0-80b9e3fac139"). InnerVolumeSpecName "kube-api-access-hzbdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:53:25.298462 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.298439    2561 scope.go:117] "RemoveContainer" containerID="292b869b952f8f82db523162959b54de5cd3cba311a6cf4c8f1ec14be01b6cea"
Jul 07 17:53:25.298813 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:53:25.298785    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"292b869b952f8f82db523162959b54de5cd3cba311a6cf4c8f1ec14be01b6cea\": container with ID starting with 292b869b952f8f82db523162959b54de5cd3cba311a6cf4c8f1ec14be01b6cea not found: ID does not exist" containerID="292b869b952f8f82db523162959b54de5cd3cba311a6cf4c8f1ec14be01b6cea"
Jul 07 17:53:25.298865 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.298822    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"292b869b952f8f82db523162959b54de5cd3cba311a6cf4c8f1ec14be01b6cea"} err="failed to get container status \"292b869b952f8f82db523162959b54de5cd3cba311a6cf4c8f1ec14be01b6cea\": rpc error: code = NotFound desc = could not find container \"292b869b952f8f82db523162959b54de5cd3cba311a6cf4c8f1ec14be01b6cea\": container with ID starting with 292b869b952f8f82db523162959b54de5cd3cba311a6cf4c8f1ec14be01b6cea not found: ID does not exist"
Jul 07 17:53:25.393563 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.393475    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76a0afa2-296c-4e69-83d0-80b9e3fac139-maas-api-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:25.393563 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.393503    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzbdz\" (UniqueName: \"kubernetes.io/projected/76a0afa2-296c-4e69-83d0-80b9e3fac139-kube-api-access-hzbdz\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:25.616366 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.616333    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"]
Jul 07 17:53:25.623374 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:25.623345    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-4540e23c-ff6f885b6-lggj4"]
Jul 07 17:53:26.809643 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:26.809606    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76a0afa2-296c-4e69-83d0-80b9e3fac139" path="/var/lib/kubelet/pods/76a0afa2-296c-4e69-83d0-80b9e3fac139/volumes"
Jul 07 17:53:30.019313 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.019286    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:30.145650 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.145610    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsg7g\" (UniqueName: \"kubernetes.io/projected/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-kube-api-access-vsg7g\") pod \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") "
Jul 07 17:53:30.145897 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.145681    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-token\") pod \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") "
Jul 07 17:53:30.145897 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.145706    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-workload-certs\") pod \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") "
Jul 07 17:53:30.145897 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.145737    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-podinfo\") pod \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") "
Jul 07 17:53:30.145897 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.145761    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-envoy\") pod \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") "
Jul 07 17:53:30.145897 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.145792    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-data\") pod \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") "
Jul 07 17:53:30.145897 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.145859    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istiod-ca-cert\") pod \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") "
Jul 07 17:53:30.145897 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.145890    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-workload-socket\") pod \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") "
Jul 07 17:53:30.146306 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.145953    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-credential-socket\") pod \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\" (UID: \"e10e538a-64bb-473e-91bc-09aaf4bf5fa3\") "
Jul 07 17:53:30.146306 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.146190    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e10e538a-64bb-473e-91bc-09aaf4bf5fa3" (UID: "e10e538a-64bb-473e-91bc-09aaf4bf5fa3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:53:30.146410 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.146360    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:30.146410 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.146398    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e10e538a-64bb-473e-91bc-09aaf4bf5fa3" (UID: "e10e538a-64bb-473e-91bc-09aaf4bf5fa3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:53:30.146519 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.146406    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e10e538a-64bb-473e-91bc-09aaf4bf5fa3" (UID: "e10e538a-64bb-473e-91bc-09aaf4bf5fa3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:53:30.146642 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.146621    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-data" (OuterVolumeSpecName: "istio-data") pod "e10e538a-64bb-473e-91bc-09aaf4bf5fa3" (UID: "e10e538a-64bb-473e-91bc-09aaf4bf5fa3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:53:30.146740 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.146721    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e10e538a-64bb-473e-91bc-09aaf4bf5fa3" (UID: "e10e538a-64bb-473e-91bc-09aaf4bf5fa3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:53:30.148126 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.148104    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e10e538a-64bb-473e-91bc-09aaf4bf5fa3" (UID: "e10e538a-64bb-473e-91bc-09aaf4bf5fa3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:53:30.148322 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.148308    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-token" (OuterVolumeSpecName: "istio-token") pod "e10e538a-64bb-473e-91bc-09aaf4bf5fa3" (UID: "e10e538a-64bb-473e-91bc-09aaf4bf5fa3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:53:30.148446 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.148423    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e10e538a-64bb-473e-91bc-09aaf4bf5fa3" (UID: "e10e538a-64bb-473e-91bc-09aaf4bf5fa3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 17:53:30.148524 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.148502    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-kube-api-access-vsg7g" (OuterVolumeSpecName: "kube-api-access-vsg7g") pod "e10e538a-64bb-473e-91bc-09aaf4bf5fa3" (UID: "e10e538a-64bb-473e-91bc-09aaf4bf5fa3"). InnerVolumeSpecName "kube-api-access-vsg7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:53:30.247179 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.247148    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:30.247179 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.247174    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:30.247179 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.247184    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:30.247423 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.247194    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:30.247423 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.247202    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:30.247423 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.247210    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:30.247423 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.247217    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:30.247423 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.247227    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsg7g\" (UniqueName: \"kubernetes.io/projected/e10e538a-64bb-473e-91bc-09aaf4bf5fa3-kube-api-access-vsg7g\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:53:30.318958 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.318917    2561 generic.go:356] "Generic (PLEG): container finished" podID="e10e538a-64bb-473e-91bc-09aaf4bf5fa3" containerID="7e5f8f35099a6bd22e8945a1dfd14a04e39e765d87245ffc57da791d5000c933" exitCode=0
Jul 07 17:53:30.319122 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.318993    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"
Jul 07 17:53:30.319122 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.319007    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l" event={"ID":"e10e538a-64bb-473e-91bc-09aaf4bf5fa3","Type":"ContainerDied","Data":"7e5f8f35099a6bd22e8945a1dfd14a04e39e765d87245ffc57da791d5000c933"}
Jul 07 17:53:30.319122 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.319066    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l" event={"ID":"e10e538a-64bb-473e-91bc-09aaf4bf5fa3","Type":"ContainerDied","Data":"9e23a0f123d676c1f9aff9600d208dbdc278eeec5cf2cba9ded9dd67aead47c3"}
Jul 07 17:53:30.319122 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.319088    2561 scope.go:117] "RemoveContainer" containerID="7e5f8f35099a6bd22e8945a1dfd14a04e39e765d87245ffc57da791d5000c933"
Jul 07 17:53:30.328634 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.328610    2561 scope.go:117] "RemoveContainer" containerID="7e5f8f35099a6bd22e8945a1dfd14a04e39e765d87245ffc57da791d5000c933"
Jul 07 17:53:30.328907 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:53:30.328888    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e5f8f35099a6bd22e8945a1dfd14a04e39e765d87245ffc57da791d5000c933\": container with ID starting with 7e5f8f35099a6bd22e8945a1dfd14a04e39e765d87245ffc57da791d5000c933 not found: ID does not exist" containerID="7e5f8f35099a6bd22e8945a1dfd14a04e39e765d87245ffc57da791d5000c933"
Jul 07 17:53:30.328994 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.328914    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e5f8f35099a6bd22e8945a1dfd14a04e39e765d87245ffc57da791d5000c933"} err="failed to get container status \"7e5f8f35099a6bd22e8945a1dfd14a04e39e765d87245ffc57da791d5000c933\": rpc error: code = NotFound desc = could not find container \"7e5f8f35099a6bd22e8945a1dfd14a04e39e765d87245ffc57da791d5000c933\": container with ID starting with 7e5f8f35099a6bd22e8945a1dfd14a04e39e765d87245ffc57da791d5000c933 not found: ID does not exist"
Jul 07 17:53:30.345412 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.345385    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"]
Jul 07 17:53:30.353222 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.353195    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-4540e23c-openshift-default-7b555f6899-tg62l"]
Jul 07 17:53:30.809950 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:53:30.809918    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e10e538a-64bb-473e-91bc-09aaf4bf5fa3" path="/var/lib/kubelet/pods/e10e538a-64bb-473e-91bc-09aaf4bf5fa3/volumes"
Jul 07 17:55:12.122910 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.122872    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"]
Jul 07 17:55:12.123355 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.123271    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a0afa2-296c-4e69-83d0-80b9e3fac139" containerName="maas-api"
Jul 07 17:55:12.123355 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.123283    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a0afa2-296c-4e69-83d0-80b9e3fac139" containerName="maas-api"
Jul 07 17:55:12.123355 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.123303    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e10e538a-64bb-473e-91bc-09aaf4bf5fa3" containerName="istio-proxy"
Jul 07 17:55:12.123355 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.123309    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e10e538a-64bb-473e-91bc-09aaf4bf5fa3" containerName="istio-proxy"
Jul 07 17:55:12.123490 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.123369    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e10e538a-64bb-473e-91bc-09aaf4bf5fa3" containerName="istio-proxy"
Jul 07 17:55:12.123490 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.123379    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="76a0afa2-296c-4e69-83d0-80b9e3fac139" containerName="maas-api"
Jul 07 17:55:12.126540 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.126522    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.129109 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.129086    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-04dfba68-openshift-default-dockercfg-f7lbv\""
Jul 07 17:55:12.151772 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.151741    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"]
Jul 07 17:55:12.248386 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.248339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-workload-certs\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.248386 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.248396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-podinfo\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.248613 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.248473    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-token\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.248613 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.248535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr74k\" (UniqueName: \"kubernetes.io/projected/43aefe02-ef73-4d1e-8075-00af38a1dd15-kube-api-access-fr74k\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.248613 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.248584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-credential-socket\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.248719 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.248617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-workload-socket\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.248719 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.248648    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43aefe02-ef73-4d1e-8075-00af38a1dd15-istiod-ca-cert\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.248719 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.248678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-envoy\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.248719 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.248706    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-data\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.349854 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.349805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-credential-socket\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.350075 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.349868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-workload-socket\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.350075 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.349894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43aefe02-ef73-4d1e-8075-00af38a1dd15-istiod-ca-cert\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.350075 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.349930    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-envoy\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.350075 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.350002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-data\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.350075 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.350067    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-workload-certs\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.350347 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.350112    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-podinfo\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.350347 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.350156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-token\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.350347 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.350214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr74k\" (UniqueName: \"kubernetes.io/projected/43aefe02-ef73-4d1e-8075-00af38a1dd15-kube-api-access-fr74k\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.350347 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.350306    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-workload-socket\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.350573 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.350552    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-credential-socket\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.350639 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.350600    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-workload-certs\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.350751 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.350723    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-data\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.350814 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.350797    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43aefe02-ef73-4d1e-8075-00af38a1dd15-istiod-ca-cert\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.352480 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.352460    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-envoy\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.352716 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.352698    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-podinfo\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.361401 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.361370    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-token\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.361688 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.361664    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr74k\" (UniqueName: \"kubernetes.io/projected/43aefe02-ef73-4d1e-8075-00af38a1dd15-kube-api-access-fr74k\") pod \"e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") " pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.437265 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.437172    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:12.585454 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.585426    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"]
Jul 07 17:55:12.587494 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:55:12.587457    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43aefe02_ef73_4d1e_8075_00af38a1dd15.slice/crio-e63d37ad2312fe968723d0ce21587653032530f6360a6a580e3ec5db398b9c63 WatchSource:0}: Error finding container e63d37ad2312fe968723d0ce21587653032530f6360a6a580e3ec5db398b9c63: Status 404 returned error can't find the container with id e63d37ad2312fe968723d0ce21587653032530f6360a6a580e3ec5db398b9c63
Jul 07 17:55:12.589701 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.589666    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:55:12.589834 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.589751    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:55:12.589834 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.589797    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:55:12.824465 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.824429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx" event={"ID":"43aefe02-ef73-4d1e-8075-00af38a1dd15","Type":"ContainerStarted","Data":"511dec9073269ef1e15ab2b276866f9acc36800df57f2f7efec9bb693b8a26f3"}
Jul 07 17:55:12.824677 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.824486    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx" event={"ID":"43aefe02-ef73-4d1e-8075-00af38a1dd15","Type":"ContainerStarted","Data":"e63d37ad2312fe968723d0ce21587653032530f6360a6a580e3ec5db398b9c63"}
Jul 07 17:55:12.847884 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:12.847821    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx" podStartSLOduration=0.84779696 podStartE2EDuration="847.79696ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:55:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:12.845561998 +0000 UTC m=+1642.609021845" watchObservedRunningTime="2026-07-07 17:55:12.84779696 +0000 UTC m=+1642.611256808"
Jul 07 17:55:13.438148 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:13.438108    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:13.443102 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:13.443073    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:13.830049 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:13.830021    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:13.830955 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:13.830936    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:15.548858 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:15.548821    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"]
Jul 07 17:55:15.552750 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:15.552731    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:15.555067 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:15.555039    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-04dfba68-serving-cert\""
Jul 07 17:55:15.555217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:15.555130    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-q97km\""
Jul 07 17:55:15.561933 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:15.561904    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"]
Jul 07 17:55:15.685202 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:15.685165    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d149457b-3d5a-439a-be70-3e2a78c94be5-openshift-service-ca\") pod \"maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28\" (UID: \"d149457b-3d5a-439a-be70-3e2a78c94be5\") " pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:15.685402 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:15.685277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfn7g\" (UniqueName: \"kubernetes.io/projected/d149457b-3d5a-439a-be70-3e2a78c94be5-kube-api-access-gfn7g\") pod \"maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28\" (UID: \"d149457b-3d5a-439a-be70-3e2a78c94be5\") " pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:15.685402 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:15.685305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d149457b-3d5a-439a-be70-3e2a78c94be5-maas-api-tls\") pod \"maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28\" (UID: \"d149457b-3d5a-439a-be70-3e2a78c94be5\") " pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:15.786691 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:15.786654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfn7g\" (UniqueName: \"kubernetes.io/projected/d149457b-3d5a-439a-be70-3e2a78c94be5-kube-api-access-gfn7g\") pod \"maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28\" (UID: \"d149457b-3d5a-439a-be70-3e2a78c94be5\") " pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:15.786691 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:15.786709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d149457b-3d5a-439a-be70-3e2a78c94be5-maas-api-tls\") pod \"maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28\" (UID: \"d149457b-3d5a-439a-be70-3e2a78c94be5\") " pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:15.787014 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:15.786778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d149457b-3d5a-439a-be70-3e2a78c94be5-openshift-service-ca\") pod \"maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28\" (UID: \"d149457b-3d5a-439a-be70-3e2a78c94be5\") " pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:15.787014 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:55:15.786887    2561 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-04dfba68-serving-cert: secret "maas-api-e2e-mt-04dfba68-serving-cert" not found
Jul 07 17:55:15.787014 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:55:15.786999    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d149457b-3d5a-439a-be70-3e2a78c94be5-maas-api-tls podName:d149457b-3d5a-439a-be70-3e2a78c94be5 nodeName:}" failed. No retries permitted until 2026-07-07 17:55:16.286951642 +0000 UTC m=+1646.050411473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d149457b-3d5a-439a-be70-3e2a78c94be5-maas-api-tls") pod "maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28" (UID: "d149457b-3d5a-439a-be70-3e2a78c94be5") : secret "maas-api-e2e-mt-04dfba68-serving-cert" not found
Jul 07 17:55:15.787524 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:15.787501    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d149457b-3d5a-439a-be70-3e2a78c94be5-openshift-service-ca\") pod \"maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28\" (UID: \"d149457b-3d5a-439a-be70-3e2a78c94be5\") " pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:15.796559 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:15.796533    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfn7g\" (UniqueName: \"kubernetes.io/projected/d149457b-3d5a-439a-be70-3e2a78c94be5-kube-api-access-gfn7g\") pod \"maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28\" (UID: \"d149457b-3d5a-439a-be70-3e2a78c94be5\") " pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:16.292255 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:16.292219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d149457b-3d5a-439a-be70-3e2a78c94be5-maas-api-tls\") pod \"maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28\" (UID: \"d149457b-3d5a-439a-be70-3e2a78c94be5\") " pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:16.294889 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:16.294865    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d149457b-3d5a-439a-be70-3e2a78c94be5-maas-api-tls\") pod \"maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28\" (UID: \"d149457b-3d5a-439a-be70-3e2a78c94be5\") " pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:16.469303 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:16.469263    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:16.618168 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:16.618144    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"]
Jul 07 17:55:16.620081 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:55:16.620050    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd149457b_3d5a_439a_be70_3e2a78c94be5.slice/crio-e56d1019dfa949a58dd57cc8c308749d0f405d125164fc1f76e9ef6eba9a1d54 WatchSource:0}: Error finding container e56d1019dfa949a58dd57cc8c308749d0f405d125164fc1f76e9ef6eba9a1d54: Status 404 returned error can't find the container with id e56d1019dfa949a58dd57cc8c308749d0f405d125164fc1f76e9ef6eba9a1d54
Jul 07 17:55:16.846237 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:16.846139    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28" event={"ID":"d149457b-3d5a-439a-be70-3e2a78c94be5","Type":"ContainerStarted","Data":"e56d1019dfa949a58dd57cc8c308749d0f405d125164fc1f76e9ef6eba9a1d54"}
Jul 07 17:55:17.852772 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:17.852734    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28" event={"ID":"d149457b-3d5a-439a-be70-3e2a78c94be5","Type":"ContainerStarted","Data":"db6762cf2c8a06d2e514d03888c0dfedaee15095ceff37503022202ad8cabe82"}
Jul 07 17:55:17.853284 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:17.852864    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:17.872317 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:17.872258    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28" podStartSLOduration=2.497181519 podStartE2EDuration="2.872235403s" totalImagesPullingTime="375.053884ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:17.870255425 +0000 UTC m=+1647.633715272" watchObservedRunningTime="2026-07-07 17:55:17.872235403 +0000 UTC m=+1647.635695252"
Jul 07 17:55:23.864220 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:23.864186    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:28.710202 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:28.710165    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"]
Jul 07 17:55:28.710663 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:28.710394    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28" podUID="d149457b-3d5a-439a-be70-3e2a78c94be5" containerName="maas-api" containerID="cri-o://db6762cf2c8a06d2e514d03888c0dfedaee15095ceff37503022202ad8cabe82" gracePeriod=30
Jul 07 17:55:28.831393 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:28.831362    2561 patch_prober.go:28] interesting pod/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 07 17:55:28.831513 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:28.831434    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx" podUID="43aefe02-ef73-4d1e-8075-00af38a1dd15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 07 17:55:28.859305 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:28.859259    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28" podUID="d149457b-3d5a-439a-be70-3e2a78c94be5" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.48:8443/health\": dial tcp 10.134.0.48:8443: connect: connection refused"
Jul 07 17:55:28.918457 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:28.918427    2561 generic.go:356] "Generic (PLEG): container finished" podID="d149457b-3d5a-439a-be70-3e2a78c94be5" containerID="db6762cf2c8a06d2e514d03888c0dfedaee15095ceff37503022202ad8cabe82" exitCode=0
Jul 07 17:55:28.918622 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:28.918499    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28" event={"ID":"d149457b-3d5a-439a-be70-3e2a78c94be5","Type":"ContainerDied","Data":"db6762cf2c8a06d2e514d03888c0dfedaee15095ceff37503022202ad8cabe82"}
Jul 07 17:55:28.920259 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:28.920234    2561 generic.go:356] "Generic (PLEG): container finished" podID="43aefe02-ef73-4d1e-8075-00af38a1dd15" containerID="511dec9073269ef1e15ab2b276866f9acc36800df57f2f7efec9bb693b8a26f3" exitCode=0
Jul 07 17:55:28.920378 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:28.920285    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx" event={"ID":"43aefe02-ef73-4d1e-8075-00af38a1dd15","Type":"ContainerDied","Data":"511dec9073269ef1e15ab2b276866f9acc36800df57f2f7efec9bb693b8a26f3"}
Jul 07 17:55:28.920665 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:28.920651    2561 scope.go:117] "RemoveContainer" containerID="511dec9073269ef1e15ab2b276866f9acc36800df57f2f7efec9bb693b8a26f3"
Jul 07 17:55:28.921761 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:28.921729    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:55:28.921849 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:28.921817    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:55:28.921888 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:28.921860    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:55:28.983708 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:28.983681    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:29.136212 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.136183    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfn7g\" (UniqueName: \"kubernetes.io/projected/d149457b-3d5a-439a-be70-3e2a78c94be5-kube-api-access-gfn7g\") pod \"d149457b-3d5a-439a-be70-3e2a78c94be5\" (UID: \"d149457b-3d5a-439a-be70-3e2a78c94be5\") "
Jul 07 17:55:29.136425 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.136253    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d149457b-3d5a-439a-be70-3e2a78c94be5-maas-api-tls\") pod \"d149457b-3d5a-439a-be70-3e2a78c94be5\" (UID: \"d149457b-3d5a-439a-be70-3e2a78c94be5\") "
Jul 07 17:55:29.136425 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.136324    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d149457b-3d5a-439a-be70-3e2a78c94be5-openshift-service-ca\") pod \"d149457b-3d5a-439a-be70-3e2a78c94be5\" (UID: \"d149457b-3d5a-439a-be70-3e2a78c94be5\") "
Jul 07 17:55:29.136705 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.136669    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d149457b-3d5a-439a-be70-3e2a78c94be5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d149457b-3d5a-439a-be70-3e2a78c94be5" (UID: "d149457b-3d5a-439a-be70-3e2a78c94be5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:55:29.138726 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.138697    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d149457b-3d5a-439a-be70-3e2a78c94be5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d149457b-3d5a-439a-be70-3e2a78c94be5" (UID: "d149457b-3d5a-439a-be70-3e2a78c94be5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:55:29.138726 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.138716    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d149457b-3d5a-439a-be70-3e2a78c94be5-kube-api-access-gfn7g" (OuterVolumeSpecName: "kube-api-access-gfn7g") pod "d149457b-3d5a-439a-be70-3e2a78c94be5" (UID: "d149457b-3d5a-439a-be70-3e2a78c94be5"). InnerVolumeSpecName "kube-api-access-gfn7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:55:29.237693 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.237592    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d149457b-3d5a-439a-be70-3e2a78c94be5-maas-api-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:55:29.237693 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.237627    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d149457b-3d5a-439a-be70-3e2a78c94be5-openshift-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:55:29.237693 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.237644    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfn7g\" (UniqueName: \"kubernetes.io/projected/d149457b-3d5a-439a-be70-3e2a78c94be5-kube-api-access-gfn7g\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:55:29.926668 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.926637    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"
Jul 07 17:55:29.926668 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.926659    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28" event={"ID":"d149457b-3d5a-439a-be70-3e2a78c94be5","Type":"ContainerDied","Data":"e56d1019dfa949a58dd57cc8c308749d0f405d125164fc1f76e9ef6eba9a1d54"}
Jul 07 17:55:29.927215 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.926725    2561 scope.go:117] "RemoveContainer" containerID="db6762cf2c8a06d2e514d03888c0dfedaee15095ceff37503022202ad8cabe82"
Jul 07 17:55:29.928782 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.928755    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx" event={"ID":"43aefe02-ef73-4d1e-8075-00af38a1dd15","Type":"ContainerStarted","Data":"16f6eed7ab40a71ad85beafb083e1590f3c35e6d3d3c8c79c26c44355f225f50"}
Jul 07 17:55:29.968626 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.968595    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"]
Jul 07 17:55:29.993648 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:29.993603    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-04dfba68-79fc8bd49-pkb28"]
Jul 07 17:55:30.437880 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:30.437840    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:30.438115 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:30.438090    2561 patch_prober.go:28] interesting pod/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 07 17:55:30.438217 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:30.438151    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx" podUID="43aefe02-ef73-4d1e-8075-00af38a1dd15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 07 17:55:30.812008 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:30.811951    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d149457b-3d5a-439a-be70-3e2a78c94be5" path="/var/lib/kubelet/pods/d149457b-3d5a-439a-be70-3e2a78c94be5/volumes"
Jul 07 17:55:31.437959 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:31.437923    2561 patch_prober.go:28] interesting pod/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 07 17:55:31.438377 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:31.438011    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx" podUID="43aefe02-ef73-4d1e-8075-00af38a1dd15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 07 17:55:32.437812 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:32.437775    2561 patch_prober.go:28] interesting pod/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 07 17:55:32.437998 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:32.437829    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx" podUID="43aefe02-ef73-4d1e-8075-00af38a1dd15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 07 17:55:33.437854 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:33.437805    2561 patch_prober.go:28] interesting pod/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 07 17:55:33.438292 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:33.437876    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx" podUID="43aefe02-ef73-4d1e-8075-00af38a1dd15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 07 17:55:34.442240 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:34.442211    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:34.442628 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:34.442587    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:34.443305 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:34.443282    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:35.462285 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:35.462251    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"]
Jul 07 17:55:35.959563 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:35.959532    2561 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx" secret="" err="secret \"e2e-mt-04dfba68-openshift-default-dockercfg-f7lbv\" not found"
Jul 07 17:55:36.964735 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:36.964678    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx" podUID="43aefe02-ef73-4d1e-8075-00af38a1dd15" containerName="istio-proxy" containerID="cri-o://16f6eed7ab40a71ad85beafb083e1590f3c35e6d3d3c8c79c26c44355f225f50" gracePeriod=30
Jul 07 17:55:42.217108 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.217081    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:42.262803 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.262715    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-token\") pod \"43aefe02-ef73-4d1e-8075-00af38a1dd15\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") "
Jul 07 17:55:42.262803 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.262760    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-podinfo\") pod \"43aefe02-ef73-4d1e-8075-00af38a1dd15\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") "
Jul 07 17:55:42.262803 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.262799    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-envoy\") pod \"43aefe02-ef73-4d1e-8075-00af38a1dd15\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") "
Jul 07 17:55:42.263142 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.263013    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr74k\" (UniqueName: \"kubernetes.io/projected/43aefe02-ef73-4d1e-8075-00af38a1dd15-kube-api-access-fr74k\") pod \"43aefe02-ef73-4d1e-8075-00af38a1dd15\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") "
Jul 07 17:55:42.263142 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.263085    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-workload-certs\") pod \"43aefe02-ef73-4d1e-8075-00af38a1dd15\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") "
Jul 07 17:55:42.263142 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.263114    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43aefe02-ef73-4d1e-8075-00af38a1dd15-istiod-ca-cert\") pod \"43aefe02-ef73-4d1e-8075-00af38a1dd15\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") "
Jul 07 17:55:42.263317 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.263171    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-credential-socket\") pod \"43aefe02-ef73-4d1e-8075-00af38a1dd15\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") "
Jul 07 17:55:42.263317 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.263230    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-workload-socket\") pod \"43aefe02-ef73-4d1e-8075-00af38a1dd15\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") "
Jul 07 17:55:42.263317 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.263292    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-data\") pod \"43aefe02-ef73-4d1e-8075-00af38a1dd15\" (UID: \"43aefe02-ef73-4d1e-8075-00af38a1dd15\") "
Jul 07 17:55:42.264031 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.264000    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43aefe02-ef73-4d1e-8075-00af38a1dd15-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "43aefe02-ef73-4d1e-8075-00af38a1dd15" (UID: "43aefe02-ef73-4d1e-8075-00af38a1dd15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:55:42.264292 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.264269    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "43aefe02-ef73-4d1e-8075-00af38a1dd15" (UID: "43aefe02-ef73-4d1e-8075-00af38a1dd15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:55:42.264369 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.264354    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "43aefe02-ef73-4d1e-8075-00af38a1dd15" (UID: "43aefe02-ef73-4d1e-8075-00af38a1dd15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:55:42.264473 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.264453    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "43aefe02-ef73-4d1e-8075-00af38a1dd15" (UID: "43aefe02-ef73-4d1e-8075-00af38a1dd15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:55:42.264680 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.264654    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-data" (OuterVolumeSpecName: "istio-data") pod "43aefe02-ef73-4d1e-8075-00af38a1dd15" (UID: "43aefe02-ef73-4d1e-8075-00af38a1dd15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:55:42.265282 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.265255    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "43aefe02-ef73-4d1e-8075-00af38a1dd15" (UID: "43aefe02-ef73-4d1e-8075-00af38a1dd15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:55:42.265282 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.265255    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-token" (OuterVolumeSpecName: "istio-token") pod "43aefe02-ef73-4d1e-8075-00af38a1dd15" (UID: "43aefe02-ef73-4d1e-8075-00af38a1dd15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:55:42.265557 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.265542    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "43aefe02-ef73-4d1e-8075-00af38a1dd15" (UID: "43aefe02-ef73-4d1e-8075-00af38a1dd15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 17:55:42.265631 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.265610    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43aefe02-ef73-4d1e-8075-00af38a1dd15-kube-api-access-fr74k" (OuterVolumeSpecName: "kube-api-access-fr74k") pod "43aefe02-ef73-4d1e-8075-00af38a1dd15" (UID: "43aefe02-ef73-4d1e-8075-00af38a1dd15"). InnerVolumeSpecName "kube-api-access-fr74k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:55:42.364376 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.364340    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:55:42.364376 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.364370    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:55:42.364376 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.364380    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:55:42.364617 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.364390    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:55:42.364617 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.364399    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:55:42.364617 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.364408    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr74k\" (UniqueName: \"kubernetes.io/projected/43aefe02-ef73-4d1e-8075-00af38a1dd15-kube-api-access-fr74k\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:55:42.364617 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.364416    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:55:42.364617 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.364424    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43aefe02-ef73-4d1e-8075-00af38a1dd15-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:55:42.364617 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.364433    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43aefe02-ef73-4d1e-8075-00af38a1dd15-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:55:42.996875 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.996839    2561 generic.go:356] "Generic (PLEG): container finished" podID="43aefe02-ef73-4d1e-8075-00af38a1dd15" containerID="16f6eed7ab40a71ad85beafb083e1590f3c35e6d3d3c8c79c26c44355f225f50" exitCode=0
Jul 07 17:55:42.997097 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.996895    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"
Jul 07 17:55:42.997097 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.996925    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx" event={"ID":"43aefe02-ef73-4d1e-8075-00af38a1dd15","Type":"ContainerDied","Data":"16f6eed7ab40a71ad85beafb083e1590f3c35e6d3d3c8c79c26c44355f225f50"}
Jul 07 17:55:42.997097 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.997016    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx" event={"ID":"43aefe02-ef73-4d1e-8075-00af38a1dd15","Type":"ContainerDied","Data":"e63d37ad2312fe968723d0ce21587653032530f6360a6a580e3ec5db398b9c63"}
Jul 07 17:55:42.997097 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:42.997046    2561 scope.go:117] "RemoveContainer" containerID="16f6eed7ab40a71ad85beafb083e1590f3c35e6d3d3c8c79c26c44355f225f50"
Jul 07 17:55:43.006231 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:43.006213    2561 scope.go:117] "RemoveContainer" containerID="511dec9073269ef1e15ab2b276866f9acc36800df57f2f7efec9bb693b8a26f3"
Jul 07 17:55:43.014537 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:43.014516    2561 scope.go:117] "RemoveContainer" containerID="16f6eed7ab40a71ad85beafb083e1590f3c35e6d3d3c8c79c26c44355f225f50"
Jul 07 17:55:43.014832 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:55:43.014814    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16f6eed7ab40a71ad85beafb083e1590f3c35e6d3d3c8c79c26c44355f225f50\": container with ID starting with 16f6eed7ab40a71ad85beafb083e1590f3c35e6d3d3c8c79c26c44355f225f50 not found: ID does not exist" containerID="16f6eed7ab40a71ad85beafb083e1590f3c35e6d3d3c8c79c26c44355f225f50"
Jul 07 17:55:43.014885 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:43.014842    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f6eed7ab40a71ad85beafb083e1590f3c35e6d3d3c8c79c26c44355f225f50"} err="failed to get container status \"16f6eed7ab40a71ad85beafb083e1590f3c35e6d3d3c8c79c26c44355f225f50\": rpc error: code = NotFound desc = could not find container \"16f6eed7ab40a71ad85beafb083e1590f3c35e6d3d3c8c79c26c44355f225f50\": container with ID starting with 16f6eed7ab40a71ad85beafb083e1590f3c35e6d3d3c8c79c26c44355f225f50 not found: ID does not exist"
Jul 07 17:55:43.014885 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:43.014860    2561 scope.go:117] "RemoveContainer" containerID="511dec9073269ef1e15ab2b276866f9acc36800df57f2f7efec9bb693b8a26f3"
Jul 07 17:55:43.015139 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:55:43.015119    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"511dec9073269ef1e15ab2b276866f9acc36800df57f2f7efec9bb693b8a26f3\": container with ID starting with 511dec9073269ef1e15ab2b276866f9acc36800df57f2f7efec9bb693b8a26f3 not found: ID does not exist" containerID="511dec9073269ef1e15ab2b276866f9acc36800df57f2f7efec9bb693b8a26f3"
Jul 07 17:55:43.015189 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:43.015144    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"511dec9073269ef1e15ab2b276866f9acc36800df57f2f7efec9bb693b8a26f3"} err="failed to get container status \"511dec9073269ef1e15ab2b276866f9acc36800df57f2f7efec9bb693b8a26f3\": rpc error: code = NotFound desc = could not find container \"511dec9073269ef1e15ab2b276866f9acc36800df57f2f7efec9bb693b8a26f3\": container with ID starting with 511dec9073269ef1e15ab2b276866f9acc36800df57f2f7efec9bb693b8a26f3 not found: ID does not exist"
Jul 07 17:55:43.018585 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:43.018562    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"]
Jul 07 17:55:43.024104 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:43.024082    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-04dfba68-openshift-default-7878d4df5f-cg7sx"]
Jul 07 17:55:44.809811 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:44.809773    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43aefe02-ef73-4d1e-8075-00af38a1dd15" path="/var/lib/kubelet/pods/43aefe02-ef73-4d1e-8075-00af38a1dd15/volumes"
Jul 07 17:55:57.241680 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.241636    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"]
Jul 07 17:55:57.242119 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.242076    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d149457b-3d5a-439a-be70-3e2a78c94be5" containerName="maas-api"
Jul 07 17:55:57.242119 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.242089    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d149457b-3d5a-439a-be70-3e2a78c94be5" containerName="maas-api"
Jul 07 17:55:57.242119 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.242101    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43aefe02-ef73-4d1e-8075-00af38a1dd15" containerName="istio-proxy"
Jul 07 17:55:57.242119 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.242107    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="43aefe02-ef73-4d1e-8075-00af38a1dd15" containerName="istio-proxy"
Jul 07 17:55:57.242119 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.242114    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43aefe02-ef73-4d1e-8075-00af38a1dd15" containerName="istio-proxy"
Jul 07 17:55:57.242119 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.242122    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="43aefe02-ef73-4d1e-8075-00af38a1dd15" containerName="istio-proxy"
Jul 07 17:55:57.242448 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.242199    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="43aefe02-ef73-4d1e-8075-00af38a1dd15" containerName="istio-proxy"
Jul 07 17:55:57.242448 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.242209    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d149457b-3d5a-439a-be70-3e2a78c94be5" containerName="maas-api"
Jul 07 17:55:57.242448 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.242218    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="43aefe02-ef73-4d1e-8075-00af38a1dd15" containerName="istio-proxy"
Jul 07 17:55:57.245379 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.245351    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.250358 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.250335    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8a43fdf7-openshift-default-dockercfg-pdcxl\""
Jul 07 17:55:57.261820 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.261793    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"]
Jul 07 17:55:57.312760 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.312712    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-podinfo\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.312941 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.312786    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-token\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.312941 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.312827    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-workload-certs\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.312941 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.312910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-data\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.313066 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.312999    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-credential-socket\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.313066 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.313036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-workload-socket\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.313130 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.313079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh9c4\" (UniqueName: \"kubernetes.io/projected/0320a274-3a3b-4db2-828e-350bb6c9d836-kube-api-access-fh9c4\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.313163 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.313130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-envoy\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.313201 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.313164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0320a274-3a3b-4db2-828e-350bb6c9d836-istiod-ca-cert\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.413878 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.413830    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-token\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.414102 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.413896    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-workload-certs\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.414102 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.413948    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-data\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.414102 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.413995    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-credential-socket\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.414102 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.414029    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-workload-socket\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.414102 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.414059    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh9c4\" (UniqueName: \"kubernetes.io/projected/0320a274-3a3b-4db2-828e-350bb6c9d836-kube-api-access-fh9c4\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.414377 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.414097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-envoy\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.414377 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.414150    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0320a274-3a3b-4db2-828e-350bb6c9d836-istiod-ca-cert\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.414377 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.414233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-podinfo\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.415134 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.415103    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-credential-socket\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.415428 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.415394    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-workload-socket\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.415624 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.415599    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-workload-certs\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.415868 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.415844    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-data\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.416363 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.416292    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0320a274-3a3b-4db2-828e-350bb6c9d836-istiod-ca-cert\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.419001 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.418573    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-podinfo\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.419001 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.418749    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-envoy\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.426648 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.426588    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh9c4\" (UniqueName: \"kubernetes.io/projected/0320a274-3a3b-4db2-828e-350bb6c9d836-kube-api-access-fh9c4\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.427674 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.427652    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-token\") pod \"e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") " pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.556833 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.556800    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:57.707252 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.707214    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"]
Jul 07 17:55:57.710488 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:55:57.710457    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0320a274_3a3b_4db2_828e_350bb6c9d836.slice/crio-257f6de7716b11821c08086f794a9e178f9fffb6ae750d7f1c6bc2089b1787ba WatchSource:0}: Error finding container 257f6de7716b11821c08086f794a9e178f9fffb6ae750d7f1c6bc2089b1787ba: Status 404 returned error can't find the container with id 257f6de7716b11821c08086f794a9e178f9fffb6ae750d7f1c6bc2089b1787ba
Jul 07 17:55:57.712644 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.712614    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:55:57.712711 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.712680    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:55:57.712755 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:57.712710    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:55:58.069612 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:58.069576    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh" event={"ID":"0320a274-3a3b-4db2-828e-350bb6c9d836","Type":"ContainerStarted","Data":"32f34184408cef62a127e97b302abedab2837662711d72654806d48cf53e5592"}
Jul 07 17:55:58.069866 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:58.069659    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh" event={"ID":"0320a274-3a3b-4db2-828e-350bb6c9d836","Type":"ContainerStarted","Data":"257f6de7716b11821c08086f794a9e178f9fffb6ae750d7f1c6bc2089b1787ba"}
Jul 07 17:55:58.100060 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:58.100007    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh" podStartSLOduration=1.099989675 podStartE2EDuration="1.099989675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:58.098434541 +0000 UTC m=+1687.861894389" watchObservedRunningTime="2026-07-07 17:55:58.099989675 +0000 UTC m=+1687.863449521"
Jul 07 17:55:58.557039 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:58.557011    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:58.562081 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:58.562056    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:59.074214 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:59.074182    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:55:59.075189 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:55:59.075173    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:56:14.685705 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:14.685671    2561 patch_prober.go:28] interesting pod/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:55586->10.134.0.49:15021: read: connection reset by peer" start-of-body=
Jul 07 17:56:14.686162 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:14.685754    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh" podUID="0320a274-3a3b-4db2-828e-350bb6c9d836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:55586->10.134.0.49:15021: read: connection reset by peer"
Jul 07 17:56:15.155659 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:15.155627    2561 generic.go:356] "Generic (PLEG): container finished" podID="0320a274-3a3b-4db2-828e-350bb6c9d836" containerID="32f34184408cef62a127e97b302abedab2837662711d72654806d48cf53e5592" exitCode=0
Jul 07 17:56:15.155832 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:15.155678    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh" event={"ID":"0320a274-3a3b-4db2-828e-350bb6c9d836","Type":"ContainerDied","Data":"32f34184408cef62a127e97b302abedab2837662711d72654806d48cf53e5592"}
Jul 07 17:56:15.156099 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:15.156084    2561 scope.go:117] "RemoveContainer" containerID="32f34184408cef62a127e97b302abedab2837662711d72654806d48cf53e5592"
Jul 07 17:56:15.157266 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:15.157236    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:56:15.157629 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:15.157322    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:56:15.157629 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:15.157367    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:56:16.162429 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:16.162390    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh" event={"ID":"0320a274-3a3b-4db2-828e-350bb6c9d836","Type":"ContainerStarted","Data":"ffc8f6dd0ccb1d43d5c3f19ebfdcc74299c4208ce092334283f66055ed1bcf15"}
Jul 07 17:56:16.557975 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:16.557942    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:56:16.558213 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:16.558192    2561 patch_prober.go:28] interesting pod/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 07 17:56:16.558271 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:16.558252    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh" podUID="0320a274-3a3b-4db2-828e-350bb6c9d836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 07 17:56:17.557949 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:17.557908    2561 patch_prober.go:28] interesting pod/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 07 17:56:17.558388 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:17.558010    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh" podUID="0320a274-3a3b-4db2-828e-350bb6c9d836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 07 17:56:18.557714 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.557672    2561 patch_prober.go:28] interesting pod/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 07 17:56:18.557931 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.557741    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh" podUID="0320a274-3a3b-4db2-828e-350bb6c9d836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 07 17:56:18.618909 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.618867    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"]
Jul 07 17:56:18.621771 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.621751    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.625415 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.625393    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8a43fdf7\"/\"e2e-lifecycle-model-8a43fdf7-kserve-self-signed-certs\""
Jul 07 17:56:18.625533 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.625410    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8a43fdf7\"/\"openshift-service-ca.crt\""
Jul 07 17:56:18.625533 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.625398    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8a43fdf7\"/\"kube-root-ca.crt\""
Jul 07 17:56:18.625675 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.625398    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8a43fdf7\"/\"default-dockercfg-skcp6\""
Jul 07 17:56:18.632699 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.632674    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"]
Jul 07 17:56:18.728813 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.728756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/768315b8-17f2-42f7-8f7d-c660e9766c3c-tls-certs\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.728813 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.728815    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lkpl\" (UniqueName: \"kubernetes.io/projected/768315b8-17f2-42f7-8f7d-c660e9766c3c-kube-api-access-6lkpl\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.729139 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.728845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-model-cache\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.729139 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.728873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-dshm\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.729139 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.728915    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-tmp-dir\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.729139 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.728961    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-home\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.830209 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.830120    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/768315b8-17f2-42f7-8f7d-c660e9766c3c-tls-certs\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.830209 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.830158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lkpl\" (UniqueName: \"kubernetes.io/projected/768315b8-17f2-42f7-8f7d-c660e9766c3c-kube-api-access-6lkpl\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.830209 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.830188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-model-cache\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.830463 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.830213    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-dshm\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.830463 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.830244    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-tmp-dir\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.830463 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.830283    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-home\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.830603 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.830568    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-model-cache\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.830707 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.830686    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-home\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.830774 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.830736    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-tmp-dir\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.832625 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.832605    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-dshm\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.832858 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.832840    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/768315b8-17f2-42f7-8f7d-c660e9766c3c-tls-certs\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.840036 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.840016    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lkpl\" (UniqueName: \"kubernetes.io/projected/768315b8-17f2-42f7-8f7d-c660e9766c3c-kube-api-access-6lkpl\") pod \"e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") " pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:18.931630 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:18.931586    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:19.098890 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:19.095697    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"]
Jul 07 17:56:19.102090 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:56:19.102044    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod768315b8_17f2_42f7_8f7d_c660e9766c3c.slice/crio-228ed5e87fbaab050da2619fe5023f74dadbf895d83b7e9c01cf3e54dd75144d WatchSource:0}: Error finding container 228ed5e87fbaab050da2619fe5023f74dadbf895d83b7e9c01cf3e54dd75144d: Status 404 returned error can't find the container with id 228ed5e87fbaab050da2619fe5023f74dadbf895d83b7e9c01cf3e54dd75144d
Jul 07 17:56:19.201385 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:19.201329    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2" event={"ID":"768315b8-17f2-42f7-8f7d-c660e9766c3c","Type":"ContainerStarted","Data":"e63f99964533a110307e338306e9fa5a270c5481185d8d7ec8d75bee673accdb"}
Jul 07 17:56:19.201385 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:19.201385    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2" event={"ID":"768315b8-17f2-42f7-8f7d-c660e9766c3c","Type":"ContainerStarted","Data":"228ed5e87fbaab050da2619fe5023f74dadbf895d83b7e9c01cf3e54dd75144d"}
Jul 07 17:56:19.222464 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:19.222403    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2" podStartSLOduration=1.222385267 podStartE2EDuration="1.222385267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:56:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:56:19.220934158 +0000 UTC m=+1708.984394017" watchObservedRunningTime="2026-07-07 17:56:19.222385267 +0000 UTC m=+1708.985845114"
Jul 07 17:56:19.558114 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:19.558081    2561 patch_prober.go:28] interesting pod/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 07 17:56:19.558262 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:19.558138    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh" podUID="0320a274-3a3b-4db2-828e-350bb6c9d836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 07 17:56:20.560815 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:20.560783    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:56:20.561224 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:20.561174    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:56:20.561777 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:20.561762    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:56:28.932581 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:28.932544    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:28.933139 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:28.932594    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:28.945299 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:28.945272    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:29.264412 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:29.264319    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:56:53.649960 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:56:53.649920    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"]
Jul 07 17:57:08.671425 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:08.671362    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2" podUID="768315b8-17f2-42f7-8f7d-c660e9766c3c" containerName="main" containerID="cri-o://e63f99964533a110307e338306e9fa5a270c5481185d8d7ec8d75bee673accdb" gracePeriod=45
Jul 07 17:57:08.922312 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:08.922245    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:57:09.037287 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.037253    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-tmp-dir\") pod \"768315b8-17f2-42f7-8f7d-c660e9766c3c\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") "
Jul 07 17:57:09.037466 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.037322    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-home\") pod \"768315b8-17f2-42f7-8f7d-c660e9766c3c\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") "
Jul 07 17:57:09.037466 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.037350    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/768315b8-17f2-42f7-8f7d-c660e9766c3c-tls-certs\") pod \"768315b8-17f2-42f7-8f7d-c660e9766c3c\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") "
Jul 07 17:57:09.037466 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.037407    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-model-cache\") pod \"768315b8-17f2-42f7-8f7d-c660e9766c3c\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") "
Jul 07 17:57:09.037466 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.037436    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lkpl\" (UniqueName: \"kubernetes.io/projected/768315b8-17f2-42f7-8f7d-c660e9766c3c-kube-api-access-6lkpl\") pod \"768315b8-17f2-42f7-8f7d-c660e9766c3c\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") "
Jul 07 17:57:09.037466 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.037463    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-dshm\") pod \"768315b8-17f2-42f7-8f7d-c660e9766c3c\" (UID: \"768315b8-17f2-42f7-8f7d-c660e9766c3c\") "
Jul 07 17:57:09.037747 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.037587    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "768315b8-17f2-42f7-8f7d-c660e9766c3c" (UID: "768315b8-17f2-42f7-8f7d-c660e9766c3c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:57:09.037747 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.037595    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-home" (OuterVolumeSpecName: "home") pod "768315b8-17f2-42f7-8f7d-c660e9766c3c" (UID: "768315b8-17f2-42f7-8f7d-c660e9766c3c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:57:09.037747 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.037717    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-model-cache" (OuterVolumeSpecName: "model-cache") pod "768315b8-17f2-42f7-8f7d-c660e9766c3c" (UID: "768315b8-17f2-42f7-8f7d-c660e9766c3c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:57:09.037904 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.037812    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-home\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:09.037904 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.037829    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-model-cache\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:09.037904 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.037859    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-tmp-dir\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:09.039824 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.039793    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-dshm" (OuterVolumeSpecName: "dshm") pod "768315b8-17f2-42f7-8f7d-c660e9766c3c" (UID: "768315b8-17f2-42f7-8f7d-c660e9766c3c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:57:09.039944 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.039858    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/768315b8-17f2-42f7-8f7d-c660e9766c3c-kube-api-access-6lkpl" (OuterVolumeSpecName: "kube-api-access-6lkpl") pod "768315b8-17f2-42f7-8f7d-c660e9766c3c" (UID: "768315b8-17f2-42f7-8f7d-c660e9766c3c"). InnerVolumeSpecName "kube-api-access-6lkpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:57:09.039944 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.039866    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/768315b8-17f2-42f7-8f7d-c660e9766c3c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "768315b8-17f2-42f7-8f7d-c660e9766c3c" (UID: "768315b8-17f2-42f7-8f7d-c660e9766c3c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:57:09.138707 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.138668    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/768315b8-17f2-42f7-8f7d-c660e9766c3c-tls-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:09.138707 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.138701    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lkpl\" (UniqueName: \"kubernetes.io/projected/768315b8-17f2-42f7-8f7d-c660e9766c3c-kube-api-access-6lkpl\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:09.138707 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.138712    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/768315b8-17f2-42f7-8f7d-c660e9766c3c-dshm\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:09.452050 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.452005    2561 generic.go:356] "Generic (PLEG): container finished" podID="768315b8-17f2-42f7-8f7d-c660e9766c3c" containerID="e63f99964533a110307e338306e9fa5a270c5481185d8d7ec8d75bee673accdb" exitCode=0
Jul 07 17:57:09.452259 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.452165    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2" event={"ID":"768315b8-17f2-42f7-8f7d-c660e9766c3c","Type":"ContainerDied","Data":"e63f99964533a110307e338306e9fa5a270c5481185d8d7ec8d75bee673accdb"}
Jul 07 17:57:09.452259 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.452205    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2" event={"ID":"768315b8-17f2-42f7-8f7d-c660e9766c3c","Type":"ContainerDied","Data":"228ed5e87fbaab050da2619fe5023f74dadbf895d83b7e9c01cf3e54dd75144d"}
Jul 07 17:57:09.452259 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.452235    2561 scope.go:117] "RemoveContainer" containerID="e63f99964533a110307e338306e9fa5a270c5481185d8d7ec8d75bee673accdb"
Jul 07 17:57:09.452662 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.452442    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"
Jul 07 17:57:09.462605 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.462579    2561 scope.go:117] "RemoveContainer" containerID="e63f99964533a110307e338306e9fa5a270c5481185d8d7ec8d75bee673accdb"
Jul 07 17:57:09.462884 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:57:09.462861    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e63f99964533a110307e338306e9fa5a270c5481185d8d7ec8d75bee673accdb\": container with ID starting with e63f99964533a110307e338306e9fa5a270c5481185d8d7ec8d75bee673accdb not found: ID does not exist" containerID="e63f99964533a110307e338306e9fa5a270c5481185d8d7ec8d75bee673accdb"
Jul 07 17:57:09.462929 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.462894    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e63f99964533a110307e338306e9fa5a270c5481185d8d7ec8d75bee673accdb"} err="failed to get container status \"e63f99964533a110307e338306e9fa5a270c5481185d8d7ec8d75bee673accdb\": rpc error: code = NotFound desc = could not find container \"e63f99964533a110307e338306e9fa5a270c5481185d8d7ec8d75bee673accdb\": container with ID starting with e63f99964533a110307e338306e9fa5a270c5481185d8d7ec8d75bee673accdb not found: ID does not exist"
Jul 07 17:57:09.478768 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.478734    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"]
Jul 07 17:57:09.482735 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:09.482708    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-8a43fdf7/e2e-lifecycle-model-8a43fdf7-kserve-565fb9874c-mh6j2"]
Jul 07 17:57:10.810821 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:10.810786    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="768315b8-17f2-42f7-8f7d-c660e9766c3c" path="/var/lib/kubelet/pods/768315b8-17f2-42f7-8f7d-c660e9766c3c/volumes"
Jul 07 17:57:37.869875 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:37.869828    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"]
Jul 07 17:57:37.870492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:37.870095    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh" podUID="0320a274-3a3b-4db2-828e-350bb6c9d836" containerName="istio-proxy" containerID="cri-o://ffc8f6dd0ccb1d43d5c3f19ebfdcc74299c4208ce092334283f66055ed1bcf15" gracePeriod=30
Jul 07 17:57:43.160516 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.160487    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:57:43.267872 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.267833    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-credential-socket\") pod \"0320a274-3a3b-4db2-828e-350bb6c9d836\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") "
Jul 07 17:57:43.268097 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.267889    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-data\") pod \"0320a274-3a3b-4db2-828e-350bb6c9d836\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") "
Jul 07 17:57:43.268097 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.267932    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-envoy\") pod \"0320a274-3a3b-4db2-828e-350bb6c9d836\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") "
Jul 07 17:57:43.268097 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.267995    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh9c4\" (UniqueName: \"kubernetes.io/projected/0320a274-3a3b-4db2-828e-350bb6c9d836-kube-api-access-fh9c4\") pod \"0320a274-3a3b-4db2-828e-350bb6c9d836\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") "
Jul 07 17:57:43.268097 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.268030    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-workload-socket\") pod \"0320a274-3a3b-4db2-828e-350bb6c9d836\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") "
Jul 07 17:57:43.268097 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.268089    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-token\") pod \"0320a274-3a3b-4db2-828e-350bb6c9d836\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") "
Jul 07 17:57:43.268380 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.268124    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-workload-certs\") pod \"0320a274-3a3b-4db2-828e-350bb6c9d836\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") "
Jul 07 17:57:43.268380 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.268144    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0320a274-3a3b-4db2-828e-350bb6c9d836" (UID: "0320a274-3a3b-4db2-828e-350bb6c9d836"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:57:43.268380 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.268159    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0320a274-3a3b-4db2-828e-350bb6c9d836-istiod-ca-cert\") pod \"0320a274-3a3b-4db2-828e-350bb6c9d836\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") "
Jul 07 17:57:43.268380 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.268226    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-podinfo\") pod \"0320a274-3a3b-4db2-828e-350bb6c9d836\" (UID: \"0320a274-3a3b-4db2-828e-350bb6c9d836\") "
Jul 07 17:57:43.268380 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.268335    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0320a274-3a3b-4db2-828e-350bb6c9d836" (UID: "0320a274-3a3b-4db2-828e-350bb6c9d836"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:57:43.268633 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.268475    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0320a274-3a3b-4db2-828e-350bb6c9d836-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0320a274-3a3b-4db2-828e-350bb6c9d836" (UID: "0320a274-3a3b-4db2-828e-350bb6c9d836"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:57:43.268633 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.268621    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0320a274-3a3b-4db2-828e-350bb6c9d836-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:43.268745 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.268668    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:43.268745 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.268683    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:43.268745 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.268612    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0320a274-3a3b-4db2-828e-350bb6c9d836" (UID: "0320a274-3a3b-4db2-828e-350bb6c9d836"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:57:43.269072 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.269033    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-data" (OuterVolumeSpecName: "istio-data") pod "0320a274-3a3b-4db2-828e-350bb6c9d836" (UID: "0320a274-3a3b-4db2-828e-350bb6c9d836"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:57:43.270537 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.270508    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0320a274-3a3b-4db2-828e-350bb6c9d836-kube-api-access-fh9c4" (OuterVolumeSpecName: "kube-api-access-fh9c4") pod "0320a274-3a3b-4db2-828e-350bb6c9d836" (UID: "0320a274-3a3b-4db2-828e-350bb6c9d836"). InnerVolumeSpecName "kube-api-access-fh9c4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:57:43.270817 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.270799    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-token" (OuterVolumeSpecName: "istio-token") pod "0320a274-3a3b-4db2-828e-350bb6c9d836" (UID: "0320a274-3a3b-4db2-828e-350bb6c9d836"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:57:43.270951 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.270934    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0320a274-3a3b-4db2-828e-350bb6c9d836" (UID: "0320a274-3a3b-4db2-828e-350bb6c9d836"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:57:43.271128 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.271112    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0320a274-3a3b-4db2-828e-350bb6c9d836" (UID: "0320a274-3a3b-4db2-828e-350bb6c9d836"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 17:57:43.370320 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.370275    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:43.370320 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.370317    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:43.370603 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.370331    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:43.370603 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.370344    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:43.370603 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.370357    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0320a274-3a3b-4db2-828e-350bb6c9d836-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:43.370603 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.370370    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh9c4\" (UniqueName: \"kubernetes.io/projected/0320a274-3a3b-4db2-828e-350bb6c9d836-kube-api-access-fh9c4\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 17:57:43.628177 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.628144    2561 generic.go:356] "Generic (PLEG): container finished" podID="0320a274-3a3b-4db2-828e-350bb6c9d836" containerID="ffc8f6dd0ccb1d43d5c3f19ebfdcc74299c4208ce092334283f66055ed1bcf15" exitCode=0
Jul 07 17:57:43.628386 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.628205    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh" event={"ID":"0320a274-3a3b-4db2-828e-350bb6c9d836","Type":"ContainerDied","Data":"ffc8f6dd0ccb1d43d5c3f19ebfdcc74299c4208ce092334283f66055ed1bcf15"}
Jul 07 17:57:43.628386 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.628218    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"
Jul 07 17:57:43.628386 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.628260    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh" event={"ID":"0320a274-3a3b-4db2-828e-350bb6c9d836","Type":"ContainerDied","Data":"257f6de7716b11821c08086f794a9e178f9fffb6ae750d7f1c6bc2089b1787ba"}
Jul 07 17:57:43.628386 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.628290    2561 scope.go:117] "RemoveContainer" containerID="ffc8f6dd0ccb1d43d5c3f19ebfdcc74299c4208ce092334283f66055ed1bcf15"
Jul 07 17:57:43.638072 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.637998    2561 scope.go:117] "RemoveContainer" containerID="32f34184408cef62a127e97b302abedab2837662711d72654806d48cf53e5592"
Jul 07 17:57:43.647323 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.647302    2561 scope.go:117] "RemoveContainer" containerID="ffc8f6dd0ccb1d43d5c3f19ebfdcc74299c4208ce092334283f66055ed1bcf15"
Jul 07 17:57:43.647648 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:57:43.647628    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffc8f6dd0ccb1d43d5c3f19ebfdcc74299c4208ce092334283f66055ed1bcf15\": container with ID starting with ffc8f6dd0ccb1d43d5c3f19ebfdcc74299c4208ce092334283f66055ed1bcf15 not found: ID does not exist" containerID="ffc8f6dd0ccb1d43d5c3f19ebfdcc74299c4208ce092334283f66055ed1bcf15"
Jul 07 17:57:43.647718 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.647659    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc8f6dd0ccb1d43d5c3f19ebfdcc74299c4208ce092334283f66055ed1bcf15"} err="failed to get container status \"ffc8f6dd0ccb1d43d5c3f19ebfdcc74299c4208ce092334283f66055ed1bcf15\": rpc error: code = NotFound desc = could not find container \"ffc8f6dd0ccb1d43d5c3f19ebfdcc74299c4208ce092334283f66055ed1bcf15\": container with ID starting with ffc8f6dd0ccb1d43d5c3f19ebfdcc74299c4208ce092334283f66055ed1bcf15 not found: ID does not exist"
Jul 07 17:57:43.647718 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.647680    2561 scope.go:117] "RemoveContainer" containerID="32f34184408cef62a127e97b302abedab2837662711d72654806d48cf53e5592"
Jul 07 17:57:43.647941 ip-10-0-136-242 kubenswrapper[2561]: E0707 17:57:43.647926    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32f34184408cef62a127e97b302abedab2837662711d72654806d48cf53e5592\": container with ID starting with 32f34184408cef62a127e97b302abedab2837662711d72654806d48cf53e5592 not found: ID does not exist" containerID="32f34184408cef62a127e97b302abedab2837662711d72654806d48cf53e5592"
Jul 07 17:57:43.648019 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.647942    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32f34184408cef62a127e97b302abedab2837662711d72654806d48cf53e5592"} err="failed to get container status \"32f34184408cef62a127e97b302abedab2837662711d72654806d48cf53e5592\": rpc error: code = NotFound desc = could not find container \"32f34184408cef62a127e97b302abedab2837662711d72654806d48cf53e5592\": container with ID starting with 32f34184408cef62a127e97b302abedab2837662711d72654806d48cf53e5592 not found: ID does not exist"
Jul 07 17:57:43.668833 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.668796    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"]
Jul 07 17:57:43.673055 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:43.673026    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8a43fdf7-openshift-default-697776b899-bq7xh"]
Jul 07 17:57:44.810451 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:57:44.810414    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0320a274-3a3b-4db2-828e-350bb6c9d836" path="/var/lib/kubelet/pods/0320a274-3a3b-4db2-828e-350bb6c9d836/volumes"
Jul 07 17:58:35.445807 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.445768    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"]
Jul 07 17:58:35.446567 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.446231    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="768315b8-17f2-42f7-8f7d-c660e9766c3c" containerName="main"
Jul 07 17:58:35.446567 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.446249    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="768315b8-17f2-42f7-8f7d-c660e9766c3c" containerName="main"
Jul 07 17:58:35.446567 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.446270    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0320a274-3a3b-4db2-828e-350bb6c9d836" containerName="istio-proxy"
Jul 07 17:58:35.446567 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.446276    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0320a274-3a3b-4db2-828e-350bb6c9d836" containerName="istio-proxy"
Jul 07 17:58:35.446567 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.446285    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0320a274-3a3b-4db2-828e-350bb6c9d836" containerName="istio-proxy"
Jul 07 17:58:35.446567 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.446293    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0320a274-3a3b-4db2-828e-350bb6c9d836" containerName="istio-proxy"
Jul 07 17:58:35.446567 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.446379    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="768315b8-17f2-42f7-8f7d-c660e9766c3c" containerName="main"
Jul 07 17:58:35.446567 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.446398    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0320a274-3a3b-4db2-828e-350bb6c9d836" containerName="istio-proxy"
Jul 07 17:58:35.446567 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.446407    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0320a274-3a3b-4db2-828e-350bb6c9d836" containerName="istio-proxy"
Jul 07 17:58:35.450229 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.450079    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.453107 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.453079    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c65a1b-openshift-default-dockercfg-npz7k\""
Jul 07 17:58:35.465565 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.465534    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"]
Jul 07 17:58:35.491838 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.491795    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xxzv\" (UniqueName: \"kubernetes.io/projected/9ba2d987-ec69-4ce1-9124-578ec7d0a636-kube-api-access-9xxzv\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.492083 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.491855    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istiod-ca-cert\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.492083 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.491927    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-envoy\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.492083 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.492007    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-credential-socket\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.492083 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.492071    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-podinfo\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.492279 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.492111    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-data\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.492279 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.492142    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-token\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.492279 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.492199    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-workload-socket\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.492279 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.492226    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-workload-certs\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.593665 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.593620    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istiod-ca-cert\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.593895 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.593681    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-envoy\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.593895 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.593701    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-credential-socket\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.593895 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.593729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-podinfo\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.593895 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.593765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-data\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.593895 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.593828    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-token\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.594213 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.593896    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-workload-socket\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.594213 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.593926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-workload-certs\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.594213 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.593952    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xxzv\" (UniqueName: \"kubernetes.io/projected/9ba2d987-ec69-4ce1-9124-578ec7d0a636-kube-api-access-9xxzv\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.594376 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.594268    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-data\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.594376 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.594330    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-credential-socket\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.594595 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.594574    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istiod-ca-cert\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.594675 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.594610    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-workload-certs\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.594747 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.594718    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-workload-socket\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.596332 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.596301    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-envoy\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.596536 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.596518    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-podinfo\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.604134 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.604107    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xxzv\" (UniqueName: \"kubernetes.io/projected/9ba2d987-ec69-4ce1-9124-578ec7d0a636-kube-api-access-9xxzv\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.604241 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.604111    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-token\") pod \"e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") " pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.762043 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.761943    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:35.914189 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.914164    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"]
Jul 07 17:58:35.916394 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:58:35.916365    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba2d987_ec69_4ce1_9124_578ec7d0a636.slice/crio-c8c70e06664c24783e38da85bd0d4d4d3c98d3e9781adcca4b095ddadaccb990 WatchSource:0}: Error finding container c8c70e06664c24783e38da85bd0d4d4d3c98d3e9781adcca4b095ddadaccb990: Status 404 returned error can't find the container with id c8c70e06664c24783e38da85bd0d4d4d3c98d3e9781adcca4b095ddadaccb990
Jul 07 17:58:35.918805 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.918764    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:58:35.918881 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.918860    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:58:35.918920 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:35.918909    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:58:36.899276 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:36.899238    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v" event={"ID":"9ba2d987-ec69-4ce1-9124-578ec7d0a636","Type":"ContainerStarted","Data":"5a36024fdaa134f127bff5b9a1cbc901934fba8efb7ff61174120458b54c5d32"}
Jul 07 17:58:36.899692 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:36.899302    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v" event={"ID":"9ba2d987-ec69-4ce1-9124-578ec7d0a636","Type":"ContainerStarted","Data":"c8c70e06664c24783e38da85bd0d4d4d3c98d3e9781adcca4b095ddadaccb990"}
Jul 07 17:58:36.921667 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:36.921597    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v" podStartSLOduration=1.921577048 podStartE2EDuration="1.921577048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:58:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:58:36.920175878 +0000 UTC m=+1846.683635730" watchObservedRunningTime="2026-07-07 17:58:36.921577048 +0000 UTC m=+1846.685036899"
Jul 07 17:58:37.762935 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:37.762893    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:37.768244 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:37.768218    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:37.903711 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:37.903676    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:37.904718 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:37.904698    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:44.361000 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.360945    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"]
Jul 07 17:58:44.365878 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.365852    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.369540 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.369515    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-28127c-openshift-default-dockercfg-whz5m\""
Jul 07 17:58:44.380476 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.380443    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"]
Jul 07 17:58:44.482385 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.482349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istiod-ca-cert\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.482385 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.482395    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxpf5\" (UniqueName: \"kubernetes.io/projected/5a091005-8fde-4c3a-9109-e0861dbd0c2b-kube-api-access-nxpf5\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.482710 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.482448    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-token\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.482710 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.482468    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-credential-socket\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.482710 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.482489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-podinfo\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.482710 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.482553    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-envoy\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.482710 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.482586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-workload-certs\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.482710 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.482641    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-workload-socket\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.482710 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.482668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-data\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.583775 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.583737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-workload-socket\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.583775 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.583784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-data\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.584052 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.583861    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istiod-ca-cert\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.584052 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.583881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxpf5\" (UniqueName: \"kubernetes.io/projected/5a091005-8fde-4c3a-9109-e0861dbd0c2b-kube-api-access-nxpf5\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.584052 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.583915    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-token\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.584052 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.583960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-credential-socket\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.584052 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.584019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-podinfo\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.584052 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.584049    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-envoy\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.584361 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.584218    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-workload-certs\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.584361 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.584264    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-workload-socket\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.584361 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.584288    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-data\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.584623 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.584599    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-credential-socket\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.584748 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.584732    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-workload-certs\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.584875 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.584849    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istiod-ca-cert\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.587091 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.587064    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-envoy\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.587230 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.587210    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-podinfo\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.593421 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.593397    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-token\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.593675 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.593659    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxpf5\" (UniqueName: \"kubernetes.io/projected/5a091005-8fde-4c3a-9109-e0861dbd0c2b-kube-api-access-nxpf5\") pod \"e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") " pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.679782 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.679698    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:44.832979 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.832936    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"]
Jul 07 17:58:44.836193 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:58:44.836157    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a091005_8fde_4c3a_9109_e0861dbd0c2b.slice/crio-35871f8da86ed169a6b12025302438c992ce89254c9a9e6aa56e8ceed923e2b2 WatchSource:0}: Error finding container 35871f8da86ed169a6b12025302438c992ce89254c9a9e6aa56e8ceed923e2b2: Status 404 returned error can't find the container with id 35871f8da86ed169a6b12025302438c992ce89254c9a9e6aa56e8ceed923e2b2
Jul 07 17:58:44.838567 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.838526    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:58:44.838659 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.838622    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:58:44.838704 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.838664    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:58:44.940495 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.940402    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx" event={"ID":"5a091005-8fde-4c3a-9109-e0861dbd0c2b","Type":"ContainerStarted","Data":"5b49860da6b425263925a6b9f268c617c762e12e89c1303bf4fc7bc08fc67338"}
Jul 07 17:58:44.940495 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.940465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx" event={"ID":"5a091005-8fde-4c3a-9109-e0861dbd0c2b","Type":"ContainerStarted","Data":"35871f8da86ed169a6b12025302438c992ce89254c9a9e6aa56e8ceed923e2b2"}
Jul 07 17:58:44.962018 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:44.961942    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx" podStartSLOduration=0.961919572 podStartE2EDuration="961.919572ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:58:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:58:44.960411838 +0000 UTC m=+1854.723871683" watchObservedRunningTime="2026-07-07 17:58:44.961919572 +0000 UTC m=+1854.725379417"
Jul 07 17:58:45.680881 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:45.680842    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:45.685844 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:45.685821    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:45.952121 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:45.952026    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:45.953186 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:45.953166    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:58:53.945153 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:53.945105    2561 patch_prober.go:28] interesting pod/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 17:58:53.945672 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:53.945170    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v" podUID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 17:58:55.008414 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:55.008322    2561 generic.go:356] "Generic (PLEG): container finished" podID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerID="5a36024fdaa134f127bff5b9a1cbc901934fba8efb7ff61174120458b54c5d32" exitCode=0
Jul 07 17:58:55.008414 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:55.008375    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v" event={"ID":"9ba2d987-ec69-4ce1-9124-578ec7d0a636","Type":"ContainerDied","Data":"5a36024fdaa134f127bff5b9a1cbc901934fba8efb7ff61174120458b54c5d32"}
Jul 07 17:58:55.008836 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:55.008793    2561 scope.go:117] "RemoveContainer" containerID="5a36024fdaa134f127bff5b9a1cbc901934fba8efb7ff61174120458b54c5d32"
Jul 07 17:58:55.009870 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:55.009843    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:58:55.009929 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:55.009912    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:58:55.009984 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:55.009942    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:58:56.018731 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:56.018684    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v" event={"ID":"9ba2d987-ec69-4ce1-9124-578ec7d0a636","Type":"ContainerStarted","Data":"df71d45da4712d5fb2d9c0b22c15e49e4bc938d550b49f037b0bd37d947f66cf"}
Jul 07 17:58:56.762675 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:56.762637    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:58:56.762848 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:56.762743    2561 patch_prober.go:28] interesting pod/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 07 17:58:56.762848 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:56.762778    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v" podUID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 07 17:58:57.763241 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:57.763200    2561 patch_prober.go:28] interesting pod/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 07 17:58:57.763651 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:57.763254    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v" podUID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 07 17:58:58.763122 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:58.763069    2561 patch_prober.go:28] interesting pod/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 07 17:58:58.763339 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:58.763137    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v" podUID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 07 17:58:59.763078 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:59.763039    2561 patch_prober.go:28] interesting pod/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 07 17:58:59.763269 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:58:59.763103    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v" podUID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 07 17:59:00.766617 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:00.766587    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:59:00.767061 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:00.767011    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:59:00.767883 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:00.767863    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 17:59:01.599319 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:01.597734    2561 patch_prober.go:28] interesting pod/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:48262->10.134.0.52:15021: read: connection reset by peer" start-of-body=
Jul 07 17:59:01.599319 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:01.597799    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx" podUID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:48262->10.134.0.52:15021: read: connection reset by peer"
Jul 07 17:59:02.052695 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:02.052601    2561 generic.go:356] "Generic (PLEG): container finished" podID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerID="5b49860da6b425263925a6b9f268c617c762e12e89c1303bf4fc7bc08fc67338" exitCode=0
Jul 07 17:59:02.052695 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:02.052677    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx" event={"ID":"5a091005-8fde-4c3a-9109-e0861dbd0c2b","Type":"ContainerDied","Data":"5b49860da6b425263925a6b9f268c617c762e12e89c1303bf4fc7bc08fc67338"}
Jul 07 17:59:02.053209 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:02.053194    2561 scope.go:117] "RemoveContainer" containerID="5b49860da6b425263925a6b9f268c617c762e12e89c1303bf4fc7bc08fc67338"
Jul 07 17:59:02.054251 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:02.054218    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:59:02.054360 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:02.054338    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:59:02.054403 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:02.054374    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 17:59:03.060716 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:03.060681    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx" event={"ID":"5a091005-8fde-4c3a-9109-e0861dbd0c2b","Type":"ContainerStarted","Data":"f3d988fe77241989aa3a976be3ae2cbf7e9795a674f1420d583997628926923d"}
Jul 07 17:59:03.680265 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:03.680217    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:59:03.680736 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:03.680706    2561 patch_prober.go:28] interesting pod/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 07 17:59:03.680955 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:03.680928    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx" podUID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 07 17:59:04.680775 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:04.680724    2561 patch_prober.go:28] interesting pod/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 07 17:59:04.681341 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:04.680800    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx" podUID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 07 17:59:05.680923 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:05.680882    2561 patch_prober.go:28] interesting pod/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 07 17:59:05.681612 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:05.681576    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx" podUID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 07 17:59:06.681019 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:06.680955    2561 patch_prober.go:28] interesting pod/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 07 17:59:06.681658 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:06.681624    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx" podUID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 07 17:59:07.684188 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:07.684157    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:59:07.684668 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:07.684441    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:59:07.685279 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:07.685263    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 17:59:15.315474 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.315382    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"]
Jul 07 17:59:15.319174 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.319154    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.321601 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.321582    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c65a1b\"/\"openshift-service-ca.crt\""
Jul 07 17:59:15.322700 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.322677    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c65a1b\"/\"kube-root-ca.crt\""
Jul 07 17:59:15.322853 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.322770    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c65a1b\"/\"test-model-c65a1b-kserve-self-signed-certs\""
Jul 07 17:59:15.322853 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.322843    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c65a1b\"/\"default-dockercfg-54wqs\""
Jul 07 17:59:15.326373 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.326346    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"]
Jul 07 17:59:15.406141 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.406105    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-tmp-dir\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.406342 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.406158    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-model-cache\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.406342 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.406230    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-tls-certs\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.406342 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.406299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-home\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.406530 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.406376    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-dshm\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.406530 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.406436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl25l\" (UniqueName: \"kubernetes.io/projected/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-kube-api-access-rl25l\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.507886 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.507845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-dshm\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.508187 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.507908    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl25l\" (UniqueName: \"kubernetes.io/projected/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-kube-api-access-rl25l\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.508187 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.507927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-tmp-dir\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.508187 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.507957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-model-cache\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.508187 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.508035    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-tls-certs\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.508187 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.508068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-home\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.508464 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.508415    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-tmp-dir\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.508501 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.508462    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-model-cache\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.508501 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.508478    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-home\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.510439 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.510413    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-dshm\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.510670 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.510653    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-tls-certs\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.518198 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.518158    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl25l\" (UniqueName: \"kubernetes.io/projected/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-kube-api-access-rl25l\") pod \"test-model-c65a1b-kserve-6968f6dbdf-hfld9\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") " pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.630301 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.630202    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:15.777412 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:15.777369    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"]
Jul 07 17:59:15.780693 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:59:15.780663    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88b7eec4_ff82_487f_a462_f1c1bbc7a4ad.slice/crio-a4aa9b02013b9c368701f9468c6d96e4ed25904128891812866ab9baf69a791c WatchSource:0}: Error finding container a4aa9b02013b9c368701f9468c6d96e4ed25904128891812866ab9baf69a791c: Status 404 returned error can't find the container with id a4aa9b02013b9c368701f9468c6d96e4ed25904128891812866ab9baf69a791c
Jul 07 17:59:16.125761 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:16.125723    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9" event={"ID":"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad","Type":"ContainerStarted","Data":"bcd2a474d8b67f41dd7335ed372ed092baff1b5f562f51d29f013606a0f343eb"}
Jul 07 17:59:16.125761 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:16.125765    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9" event={"ID":"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad","Type":"ContainerStarted","Data":"a4aa9b02013b9c368701f9468c6d96e4ed25904128891812866ab9baf69a791c"}
Jul 07 17:59:16.146088 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:16.146031    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9" podStartSLOduration=1.146012468 podStartE2EDuration="1.146012468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:59:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:59:16.143422844 +0000 UTC m=+1885.906882701" watchObservedRunningTime="2026-07-07 17:59:16.146012468 +0000 UTC m=+1885.909472332"
Jul 07 17:59:25.630612 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:25.630564    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:25.630612 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:25.630631    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:25.643371 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:25.643345    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:26.187066 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:26.187031    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 17:59:53.148657 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.148617    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"]
Jul 07 17:59:53.152270 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.152250    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.156401 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.156374    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-28127c\"/\"openshift-service-ca.crt\""
Jul 07 17:59:53.156552 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.156405    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-28127c\"/\"default-dockercfg-tsch6\""
Jul 07 17:59:53.156552 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.156442    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-28127c\"/\"kube-root-ca.crt\""
Jul 07 17:59:53.156552 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.156447    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-28127c\"/\"test-model-28127c-kserve-self-signed-certs\""
Jul 07 17:59:53.165028 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.165000    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"]
Jul 07 17:59:53.195637 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.195604    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-tmp-dir\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.195798 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.195655    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-dshm\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.195798 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.195738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-model-cache\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.195798 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.195789    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-home\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.195905 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.195818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgssp\" (UniqueName: \"kubernetes.io/projected/53df1f26-6a94-40ed-9559-421d952f2482-kube-api-access-qgssp\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.195905 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.195850    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53df1f26-6a94-40ed-9559-421d952f2482-tls-certs\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.296661 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.296622    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-dshm\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.296862 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.296694    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-model-cache\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.296862 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.296798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-home\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.296862 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.296851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgssp\" (UniqueName: \"kubernetes.io/projected/53df1f26-6a94-40ed-9559-421d952f2482-kube-api-access-qgssp\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.297051 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.296897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53df1f26-6a94-40ed-9559-421d952f2482-tls-certs\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.297051 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.296941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-tmp-dir\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.297164 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.297092    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-model-cache\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.297240 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.297221    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-home\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.297300 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.297269    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-tmp-dir\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.299194 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.299175    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-dshm\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.299568 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.299549    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53df1f26-6a94-40ed-9559-421d952f2482-tls-certs\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.309736 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.309713    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgssp\" (UniqueName: \"kubernetes.io/projected/53df1f26-6a94-40ed-9559-421d952f2482-kube-api-access-qgssp\") pod \"test-model-28127c-kserve-54fc7d9967-78mfk\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") " pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.463039 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.462893    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 17:59:53.616075 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:53.616047    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"]
Jul 07 17:59:53.617816 ip-10-0-136-242 kubenswrapper[2561]: W0707 17:59:53.617789    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53df1f26_6a94_40ed_9559_421d952f2482.slice/crio-374e9052690a83786de6be9d9df55cbf4af99d81549b7fe703a6f5fd05c571e3 WatchSource:0}: Error finding container 374e9052690a83786de6be9d9df55cbf4af99d81549b7fe703a6f5fd05c571e3: Status 404 returned error can't find the container with id 374e9052690a83786de6be9d9df55cbf4af99d81549b7fe703a6f5fd05c571e3
Jul 07 17:59:54.318133 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:54.318099    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk" event={"ID":"53df1f26-6a94-40ed-9559-421d952f2482","Type":"ContainerStarted","Data":"703ab07f83b43082b41a1487b9d3319ef3cd68bbe17412521a098d8b9e23092b"}
Jul 07 17:59:54.318133 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:54.318141    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk" event={"ID":"53df1f26-6a94-40ed-9559-421d952f2482","Type":"ContainerStarted","Data":"374e9052690a83786de6be9d9df55cbf4af99d81549b7fe703a6f5fd05c571e3"}
Jul 07 17:59:54.340492 ip-10-0-136-242 kubenswrapper[2561]: I0707 17:59:54.340434    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk" podStartSLOduration=1.340419631 podStartE2EDuration="1.340419631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:59:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:59:54.340384365 +0000 UTC m=+1924.103844211" watchObservedRunningTime="2026-07-07 17:59:54.340419631 +0000 UTC m=+1924.103879476"
Jul 07 18:00:03.463754 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:03.463712    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 18:00:03.463754 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:03.463765    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 18:00:03.476842 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:03.476810    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 18:00:04.381415 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:04.381376    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 18:00:11.663205 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:11.663169    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"]
Jul 07 18:00:12.618208 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:12.618176    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"]
Jul 07 18:00:26.684339 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:26.684257    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9" podUID="88b7eec4-ff82-487f-a462-f1c1bbc7a4ad" containerName="main" containerID="cri-o://bcd2a474d8b67f41dd7335ed372ed092baff1b5f562f51d29f013606a0f343eb" gracePeriod=45
Jul 07 18:00:26.947732 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:26.947661    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 18:00:27.047393 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.047363    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-home\") pod \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") "
Jul 07 18:00:27.047560 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.047423    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl25l\" (UniqueName: \"kubernetes.io/projected/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-kube-api-access-rl25l\") pod \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") "
Jul 07 18:00:27.047560 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.047466    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-tls-certs\") pod \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") "
Jul 07 18:00:27.047560 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.047530    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-tmp-dir\") pod \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") "
Jul 07 18:00:27.047695 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.047594    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-model-cache\") pod \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") "
Jul 07 18:00:27.047695 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.047672    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-dshm\") pod \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\" (UID: \"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad\") "
Jul 07 18:00:27.047695 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.047678    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-home" (OuterVolumeSpecName: "home") pod "88b7eec4-ff82-487f-a462-f1c1bbc7a4ad" (UID: "88b7eec4-ff82-487f-a462-f1c1bbc7a4ad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:27.047869 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.047834    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "88b7eec4-ff82-487f-a462-f1c1bbc7a4ad" (UID: "88b7eec4-ff82-487f-a462-f1c1bbc7a4ad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:27.047958 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.047929    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-model-cache" (OuterVolumeSpecName: "model-cache") pod "88b7eec4-ff82-487f-a462-f1c1bbc7a4ad" (UID: "88b7eec4-ff82-487f-a462-f1c1bbc7a4ad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:27.048151 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.048133    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-tmp-dir\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:00:27.048209 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.048157    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-model-cache\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:00:27.048209 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.048170    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-home\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:00:27.049936 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.049909    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-dshm" (OuterVolumeSpecName: "dshm") pod "88b7eec4-ff82-487f-a462-f1c1bbc7a4ad" (UID: "88b7eec4-ff82-487f-a462-f1c1bbc7a4ad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:27.050063 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.049937    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "88b7eec4-ff82-487f-a462-f1c1bbc7a4ad" (UID: "88b7eec4-ff82-487f-a462-f1c1bbc7a4ad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:00:27.050063 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.049961    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-kube-api-access-rl25l" (OuterVolumeSpecName: "kube-api-access-rl25l") pod "88b7eec4-ff82-487f-a462-f1c1bbc7a4ad" (UID: "88b7eec4-ff82-487f-a462-f1c1bbc7a4ad"). InnerVolumeSpecName "kube-api-access-rl25l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:00:27.149644 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.149603    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-dshm\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:00:27.149644 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.149635    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl25l\" (UniqueName: \"kubernetes.io/projected/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-kube-api-access-rl25l\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:00:27.149644 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.149646    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad-tls-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:00:27.492568 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.492535    2561 generic.go:356] "Generic (PLEG): container finished" podID="88b7eec4-ff82-487f-a462-f1c1bbc7a4ad" containerID="bcd2a474d8b67f41dd7335ed372ed092baff1b5f562f51d29f013606a0f343eb" exitCode=0
Jul 07 18:00:27.492766 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.492580    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"
Jul 07 18:00:27.492766 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.492628    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9" event={"ID":"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad","Type":"ContainerDied","Data":"bcd2a474d8b67f41dd7335ed372ed092baff1b5f562f51d29f013606a0f343eb"}
Jul 07 18:00:27.492766 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.492670    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9" event={"ID":"88b7eec4-ff82-487f-a462-f1c1bbc7a4ad","Type":"ContainerDied","Data":"a4aa9b02013b9c368701f9468c6d96e4ed25904128891812866ab9baf69a791c"}
Jul 07 18:00:27.492766 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.492687    2561 scope.go:117] "RemoveContainer" containerID="bcd2a474d8b67f41dd7335ed372ed092baff1b5f562f51d29f013606a0f343eb"
Jul 07 18:00:27.502120 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.502102    2561 scope.go:117] "RemoveContainer" containerID="bcd2a474d8b67f41dd7335ed372ed092baff1b5f562f51d29f013606a0f343eb"
Jul 07 18:00:27.502381 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:00:27.502362    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcd2a474d8b67f41dd7335ed372ed092baff1b5f562f51d29f013606a0f343eb\": container with ID starting with bcd2a474d8b67f41dd7335ed372ed092baff1b5f562f51d29f013606a0f343eb not found: ID does not exist" containerID="bcd2a474d8b67f41dd7335ed372ed092baff1b5f562f51d29f013606a0f343eb"
Jul 07 18:00:27.502452 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.502389    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcd2a474d8b67f41dd7335ed372ed092baff1b5f562f51d29f013606a0f343eb"} err="failed to get container status \"bcd2a474d8b67f41dd7335ed372ed092baff1b5f562f51d29f013606a0f343eb\": rpc error: code = NotFound desc = could not find container \"bcd2a474d8b67f41dd7335ed372ed092baff1b5f562f51d29f013606a0f343eb\": container with ID starting with bcd2a474d8b67f41dd7335ed372ed092baff1b5f562f51d29f013606a0f343eb not found: ID does not exist"
Jul 07 18:00:27.516618 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.516581    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"]
Jul 07 18:00:27.521705 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.521679    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-c65a1b/test-model-c65a1b-kserve-6968f6dbdf-hfld9"]
Jul 07 18:00:27.640261 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.640206    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk" podUID="53df1f26-6a94-40ed-9559-421d952f2482" containerName="main" containerID="cri-o://703ab07f83b43082b41a1487b9d3319ef3cd68bbe17412521a098d8b9e23092b" gracePeriod=45
Jul 07 18:00:27.904223 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.904193    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 18:00:27.959941 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.959904    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-model-cache\") pod \"53df1f26-6a94-40ed-9559-421d952f2482\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") "
Jul 07 18:00:27.960155 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.960012    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgssp\" (UniqueName: \"kubernetes.io/projected/53df1f26-6a94-40ed-9559-421d952f2482-kube-api-access-qgssp\") pod \"53df1f26-6a94-40ed-9559-421d952f2482\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") "
Jul 07 18:00:27.960155 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.960049    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-dshm\") pod \"53df1f26-6a94-40ed-9559-421d952f2482\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") "
Jul 07 18:00:27.960155 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.960070    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53df1f26-6a94-40ed-9559-421d952f2482-tls-certs\") pod \"53df1f26-6a94-40ed-9559-421d952f2482\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") "
Jul 07 18:00:27.960155 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.960095    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-home\") pod \"53df1f26-6a94-40ed-9559-421d952f2482\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") "
Jul 07 18:00:27.960376 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.960197    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-tmp-dir\") pod \"53df1f26-6a94-40ed-9559-421d952f2482\" (UID: \"53df1f26-6a94-40ed-9559-421d952f2482\") "
Jul 07 18:00:27.960376 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.960223    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-model-cache" (OuterVolumeSpecName: "model-cache") pod "53df1f26-6a94-40ed-9559-421d952f2482" (UID: "53df1f26-6a94-40ed-9559-421d952f2482"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:27.960610 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.960586    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "53df1f26-6a94-40ed-9559-421d952f2482" (UID: "53df1f26-6a94-40ed-9559-421d952f2482"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:27.960610 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.960595    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-home" (OuterVolumeSpecName: "home") pod "53df1f26-6a94-40ed-9559-421d952f2482" (UID: "53df1f26-6a94-40ed-9559-421d952f2482"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:27.960774 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.960604    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-model-cache\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:00:27.962588 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.962565    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53df1f26-6a94-40ed-9559-421d952f2482-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "53df1f26-6a94-40ed-9559-421d952f2482" (UID: "53df1f26-6a94-40ed-9559-421d952f2482"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:00:27.962734 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.962717    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53df1f26-6a94-40ed-9559-421d952f2482-kube-api-access-qgssp" (OuterVolumeSpecName: "kube-api-access-qgssp") pod "53df1f26-6a94-40ed-9559-421d952f2482" (UID: "53df1f26-6a94-40ed-9559-421d952f2482"). InnerVolumeSpecName "kube-api-access-qgssp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:00:27.962734 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:27.962720    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-dshm" (OuterVolumeSpecName: "dshm") pod "53df1f26-6a94-40ed-9559-421d952f2482" (UID: "53df1f26-6a94-40ed-9559-421d952f2482"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:28.061630 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.061600    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgssp\" (UniqueName: \"kubernetes.io/projected/53df1f26-6a94-40ed-9559-421d952f2482-kube-api-access-qgssp\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:00:28.061630 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.061629    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-dshm\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:00:28.061817 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.061639    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53df1f26-6a94-40ed-9559-421d952f2482-tls-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:00:28.061817 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.061648    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-home\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:00:28.061817 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.061656    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53df1f26-6a94-40ed-9559-421d952f2482-tmp-dir\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:00:28.499755 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.499664    2561 generic.go:356] "Generic (PLEG): container finished" podID="53df1f26-6a94-40ed-9559-421d952f2482" containerID="703ab07f83b43082b41a1487b9d3319ef3cd68bbe17412521a098d8b9e23092b" exitCode=0
Jul 07 18:00:28.499755 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.499724    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"
Jul 07 18:00:28.500022 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.499746    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk" event={"ID":"53df1f26-6a94-40ed-9559-421d952f2482","Type":"ContainerDied","Data":"703ab07f83b43082b41a1487b9d3319ef3cd68bbe17412521a098d8b9e23092b"}
Jul 07 18:00:28.500022 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.499792    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk" event={"ID":"53df1f26-6a94-40ed-9559-421d952f2482","Type":"ContainerDied","Data":"374e9052690a83786de6be9d9df55cbf4af99d81549b7fe703a6f5fd05c571e3"}
Jul 07 18:00:28.500022 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.499813    2561 scope.go:117] "RemoveContainer" containerID="703ab07f83b43082b41a1487b9d3319ef3cd68bbe17412521a098d8b9e23092b"
Jul 07 18:00:28.509134 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.509115    2561 scope.go:117] "RemoveContainer" containerID="703ab07f83b43082b41a1487b9d3319ef3cd68bbe17412521a098d8b9e23092b"
Jul 07 18:00:28.509409 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:00:28.509390    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"703ab07f83b43082b41a1487b9d3319ef3cd68bbe17412521a098d8b9e23092b\": container with ID starting with 703ab07f83b43082b41a1487b9d3319ef3cd68bbe17412521a098d8b9e23092b not found: ID does not exist" containerID="703ab07f83b43082b41a1487b9d3319ef3cd68bbe17412521a098d8b9e23092b"
Jul 07 18:00:28.509473 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.509427    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"703ab07f83b43082b41a1487b9d3319ef3cd68bbe17412521a098d8b9e23092b"} err="failed to get container status \"703ab07f83b43082b41a1487b9d3319ef3cd68bbe17412521a098d8b9e23092b\": rpc error: code = NotFound desc = could not find container \"703ab07f83b43082b41a1487b9d3319ef3cd68bbe17412521a098d8b9e23092b\": container with ID starting with 703ab07f83b43082b41a1487b9d3319ef3cd68bbe17412521a098d8b9e23092b not found: ID does not exist"
Jul 07 18:00:28.524678 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.524650    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"]
Jul 07 18:00:28.531449 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.531425    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-28127c/test-model-28127c-kserve-54fc7d9967-78mfk"]
Jul 07 18:00:28.810719 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.810686    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53df1f26-6a94-40ed-9559-421d952f2482" path="/var/lib/kubelet/pods/53df1f26-6a94-40ed-9559-421d952f2482/volumes"
Jul 07 18:00:28.811136 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:28.811108    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88b7eec4-ff82-487f-a462-f1c1bbc7a4ad" path="/var/lib/kubelet/pods/88b7eec4-ff82-487f-a462-f1c1bbc7a4ad/volumes"
Jul 07 18:00:56.362274 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:56.362237    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"]
Jul 07 18:00:56.362862 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:00:56.362471    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v" podUID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerName="istio-proxy" containerID="cri-o://df71d45da4712d5fb2d9c0b22c15e49e4bc938d550b49f037b0bd37d947f66cf" gracePeriod=30
Jul 07 18:01:00.769423 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:00.769370    2561 patch_prober.go:28] interesting pod/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 18:01:00.769836 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:00.769519    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v" podUID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 18:01:01.627750 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.627673    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 18:01:01.668436 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.668396    2561 generic.go:356] "Generic (PLEG): container finished" podID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerID="df71d45da4712d5fb2d9c0b22c15e49e4bc938d550b49f037b0bd37d947f66cf" exitCode=0
Jul 07 18:01:01.668436 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.668442    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"
Jul 07 18:01:01.668680 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.668479    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v" event={"ID":"9ba2d987-ec69-4ce1-9124-578ec7d0a636","Type":"ContainerDied","Data":"df71d45da4712d5fb2d9c0b22c15e49e4bc938d550b49f037b0bd37d947f66cf"}
Jul 07 18:01:01.668680 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.668547    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v" event={"ID":"9ba2d987-ec69-4ce1-9124-578ec7d0a636","Type":"ContainerDied","Data":"c8c70e06664c24783e38da85bd0d4d4d3c98d3e9781adcca4b095ddadaccb990"}
Jul 07 18:01:01.668680 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.668583    2561 scope.go:117] "RemoveContainer" containerID="df71d45da4712d5fb2d9c0b22c15e49e4bc938d550b49f037b0bd37d947f66cf"
Jul 07 18:01:01.680681 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.680654    2561 scope.go:117] "RemoveContainer" containerID="5a36024fdaa134f127bff5b9a1cbc901934fba8efb7ff61174120458b54c5d32"
Jul 07 18:01:01.689913 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.689888    2561 scope.go:117] "RemoveContainer" containerID="df71d45da4712d5fb2d9c0b22c15e49e4bc938d550b49f037b0bd37d947f66cf"
Jul 07 18:01:01.690267 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:01:01.690243    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df71d45da4712d5fb2d9c0b22c15e49e4bc938d550b49f037b0bd37d947f66cf\": container with ID starting with df71d45da4712d5fb2d9c0b22c15e49e4bc938d550b49f037b0bd37d947f66cf not found: ID does not exist" containerID="df71d45da4712d5fb2d9c0b22c15e49e4bc938d550b49f037b0bd37d947f66cf"
Jul 07 18:01:01.690387 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.690273    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df71d45da4712d5fb2d9c0b22c15e49e4bc938d550b49f037b0bd37d947f66cf"} err="failed to get container status \"df71d45da4712d5fb2d9c0b22c15e49e4bc938d550b49f037b0bd37d947f66cf\": rpc error: code = NotFound desc = could not find container \"df71d45da4712d5fb2d9c0b22c15e49e4bc938d550b49f037b0bd37d947f66cf\": container with ID starting with df71d45da4712d5fb2d9c0b22c15e49e4bc938d550b49f037b0bd37d947f66cf not found: ID does not exist"
Jul 07 18:01:01.690387 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.690293    2561 scope.go:117] "RemoveContainer" containerID="5a36024fdaa134f127bff5b9a1cbc901934fba8efb7ff61174120458b54c5d32"
Jul 07 18:01:01.690592 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:01:01.690574    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a36024fdaa134f127bff5b9a1cbc901934fba8efb7ff61174120458b54c5d32\": container with ID starting with 5a36024fdaa134f127bff5b9a1cbc901934fba8efb7ff61174120458b54c5d32 not found: ID does not exist" containerID="5a36024fdaa134f127bff5b9a1cbc901934fba8efb7ff61174120458b54c5d32"
Jul 07 18:01:01.690634 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.690598    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a36024fdaa134f127bff5b9a1cbc901934fba8efb7ff61174120458b54c5d32"} err="failed to get container status \"5a36024fdaa134f127bff5b9a1cbc901934fba8efb7ff61174120458b54c5d32\": rpc error: code = NotFound desc = could not find container \"5a36024fdaa134f127bff5b9a1cbc901934fba8efb7ff61174120458b54c5d32\": container with ID starting with 5a36024fdaa134f127bff5b9a1cbc901934fba8efb7ff61174120458b54c5d32 not found: ID does not exist"
Jul 07 18:01:01.715742 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.715707    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istiod-ca-cert\") pod \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") "
Jul 07 18:01:01.715927 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.715755    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-workload-certs\") pod \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") "
Jul 07 18:01:01.715927 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.715774    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-workload-socket\") pod \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") "
Jul 07 18:01:01.715927 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.715819    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-data\") pod \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") "
Jul 07 18:01:01.715927 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.715862    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-token\") pod \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") "
Jul 07 18:01:01.715927 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.715907    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-credential-socket\") pod \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") "
Jul 07 18:01:01.716217 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.715945    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xxzv\" (UniqueName: \"kubernetes.io/projected/9ba2d987-ec69-4ce1-9124-578ec7d0a636-kube-api-access-9xxzv\") pod \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") "
Jul 07 18:01:01.716217 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.716012    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-podinfo\") pod \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") "
Jul 07 18:01:01.716217 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.716054    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-envoy\") pod \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\" (UID: \"9ba2d987-ec69-4ce1-9124-578ec7d0a636\") "
Jul 07 18:01:01.716217 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.716116    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ba2d987-ec69-4ce1-9124-578ec7d0a636" (UID: "9ba2d987-ec69-4ce1-9124-578ec7d0a636"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:01.716217 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.716206    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ba2d987-ec69-4ce1-9124-578ec7d0a636" (UID: "9ba2d987-ec69-4ce1-9124-578ec7d0a636"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:01.716480 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.716235    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ba2d987-ec69-4ce1-9124-578ec7d0a636" (UID: "9ba2d987-ec69-4ce1-9124-578ec7d0a636"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:01.716480 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.716303    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ba2d987-ec69-4ce1-9124-578ec7d0a636" (UID: "9ba2d987-ec69-4ce1-9124-578ec7d0a636"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:01:01.716480 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.716453    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:01.716480 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.716471    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:01.716642 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.716488    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:01.716642 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.716505    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:01.717057 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.717032    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ba2d987-ec69-4ce1-9124-578ec7d0a636" (UID: "9ba2d987-ec69-4ce1-9124-578ec7d0a636"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:01.718471 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.718439    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ba2d987-ec69-4ce1-9124-578ec7d0a636" (UID: "9ba2d987-ec69-4ce1-9124-578ec7d0a636"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:01:01.718573 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.718445    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ba2d987-ec69-4ce1-9124-578ec7d0a636" (UID: "9ba2d987-ec69-4ce1-9124-578ec7d0a636"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:01:01.718836 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.718810    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ba2d987-ec69-4ce1-9124-578ec7d0a636" (UID: "9ba2d987-ec69-4ce1-9124-578ec7d0a636"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:01.718836 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.718822    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ba2d987-ec69-4ce1-9124-578ec7d0a636-kube-api-access-9xxzv" (OuterVolumeSpecName: "kube-api-access-9xxzv") pod "9ba2d987-ec69-4ce1-9124-578ec7d0a636" (UID: "9ba2d987-ec69-4ce1-9124-578ec7d0a636"). InnerVolumeSpecName "kube-api-access-9xxzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:01:01.817644 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.817602    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:01.817644 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.817636    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:01.817644 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.817645    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xxzv\" (UniqueName: \"kubernetes.io/projected/9ba2d987-ec69-4ce1-9124-578ec7d0a636-kube-api-access-9xxzv\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:01.817644 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.817655    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:01.818191 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.817665    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ba2d987-ec69-4ce1-9124-578ec7d0a636-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:01.995150 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.995059    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"]
Jul 07 18:01:01.997446 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:01.997406    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c65a1b-openshift-default-5d5c564d57-95v6v"]
Jul 07 18:01:02.810557 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:02.810523    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" path="/var/lib/kubelet/pods/9ba2d987-ec69-4ce1-9124-578ec7d0a636/volumes"
Jul 07 18:01:03.938690 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:03.938658    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"]
Jul 07 18:01:03.939147 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:03.938931    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx" podUID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerName="istio-proxy" containerID="cri-o://f3d988fe77241989aa3a976be3ae2cbf7e9795a674f1420d583997628926923d" gracePeriod=30
Jul 07 18:01:04.889372 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.889335    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"]
Jul 07 18:01:04.889743 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.889729    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerName="istio-proxy"
Jul 07 18:01:04.889814 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.889744    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerName="istio-proxy"
Jul 07 18:01:04.889814 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.889768    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerName="istio-proxy"
Jul 07 18:01:04.889814 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.889773    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerName="istio-proxy"
Jul 07 18:01:04.889814 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.889784    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88b7eec4-ff82-487f-a462-f1c1bbc7a4ad" containerName="main"
Jul 07 18:01:04.889814 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.889789    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="88b7eec4-ff82-487f-a462-f1c1bbc7a4ad" containerName="main"
Jul 07 18:01:04.889814 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.889798    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53df1f26-6a94-40ed-9559-421d952f2482" containerName="main"
Jul 07 18:01:04.889814 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.889803    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="53df1f26-6a94-40ed-9559-421d952f2482" containerName="main"
Jul 07 18:01:04.890053 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.889863    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerName="istio-proxy"
Jul 07 18:01:04.890053 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.889871    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="88b7eec4-ff82-487f-a462-f1c1bbc7a4ad" containerName="main"
Jul 07 18:01:04.890053 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.889877    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="53df1f26-6a94-40ed-9559-421d952f2482" containerName="main"
Jul 07 18:01:04.894630 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.894608    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:04.897525 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.897502    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1e4fca-openshift-default-dockercfg-9fwh7\""
Jul 07 18:01:04.907743 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:04.907716    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"]
Jul 07 18:01:05.050844 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.050800    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-workload-certs\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.051343 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.051031    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6wnw\" (UniqueName: \"kubernetes.io/projected/5f282c5a-6338-40f4-94ef-0c45c9c79286-kube-api-access-b6wnw\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.051343 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.051083    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-workload-socket\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.051343 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.051181    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-credential-socket\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.051343 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.051224    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-token\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.051343 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.051250    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f282c5a-6338-40f4-94ef-0c45c9c79286-istiod-ca-cert\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.051343 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.051290    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-podinfo\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.051343 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.051315    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-envoy\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.051620 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.051357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-data\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.152839 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.152745    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-workload-certs\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.152839 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.152790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6wnw\" (UniqueName: \"kubernetes.io/projected/5f282c5a-6338-40f4-94ef-0c45c9c79286-kube-api-access-b6wnw\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.152839 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.152814    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-workload-socket\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.153170 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.152855    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-credential-socket\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.153170 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.152879    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-token\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.153170 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.152897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f282c5a-6338-40f4-94ef-0c45c9c79286-istiod-ca-cert\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.153170 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.153002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-podinfo\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.153170 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.153046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-envoy\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.153170 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.153073    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-data\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.153536 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.153217    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-workload-certs\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.153536 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.153281    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-credential-socket\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.153536 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.153292    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-workload-socket\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.153536 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.153486    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-data\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.153689 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.153634    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f282c5a-6338-40f4-94ef-0c45c9c79286-istiod-ca-cert\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.155684 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.155661    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-envoy\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.155774 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.155759    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-podinfo\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.166547 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.166516    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-token\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.167174 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.167154    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6wnw\" (UniqueName: \"kubernetes.io/projected/5f282c5a-6338-40f4-94ef-0c45c9c79286-kube-api-access-b6wnw\") pod \"e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") " pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.205307 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.205265    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:05.358890 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.358862    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"]
Jul 07 18:01:05.361569 ip-10-0-136-242 kubenswrapper[2561]: W0707 18:01:05.361543    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f282c5a_6338_40f4_94ef_0c45c9c79286.slice/crio-320e7cb6efd122163b1b95713f69ea23ade2c5bf5dacaab3642f007f027e0f6e WatchSource:0}: Error finding container 320e7cb6efd122163b1b95713f69ea23ade2c5bf5dacaab3642f007f027e0f6e: Status 404 returned error can't find the container with id 320e7cb6efd122163b1b95713f69ea23ade2c5bf5dacaab3642f007f027e0f6e
Jul 07 18:01:05.363698 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.363666    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:05.363772 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.363735    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:05.363772 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.363765    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:05.691434 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.691337    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t" event={"ID":"5f282c5a-6338-40f4-94ef-0c45c9c79286","Type":"ContainerStarted","Data":"4d7c53ac674d2a0470d9acf4a47682831e14a75c947f66d8c2ea32326488c358"}
Jul 07 18:01:05.691434 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.691388    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t" event={"ID":"5f282c5a-6338-40f4-94ef-0c45c9c79286","Type":"ContainerStarted","Data":"320e7cb6efd122163b1b95713f69ea23ade2c5bf5dacaab3642f007f027e0f6e"}
Jul 07 18:01:05.715867 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:05.715812    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t" podStartSLOduration=1.7157935549999999 podStartE2EDuration="1.715793555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:01:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:01:05.713235699 +0000 UTC m=+1995.476695544" watchObservedRunningTime="2026-07-07 18:01:05.715793555 +0000 UTC m=+1995.479253401"
Jul 07 18:01:06.206403 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:06.206366    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:06.211336 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:06.211311    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:06.696503 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:06.696468    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:06.697587 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:06.697566    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:07.687067 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:07.687024    2561 patch_prober.go:28] interesting pod/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 18:01:07.687449 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:07.687094    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx" podUID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 18:01:09.194871 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.194841    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 18:01:09.294572 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.294483    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-envoy\") pod \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") "
Jul 07 18:01:09.294572 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.294522    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-credential-socket\") pod \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") "
Jul 07 18:01:09.294572 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.294562    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-workload-socket\") pod \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") "
Jul 07 18:01:09.294913 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.294593    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-data\") pod \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") "
Jul 07 18:01:09.294913 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.294635    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-workload-certs\") pod \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") "
Jul 07 18:01:09.294913 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.294699    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-token\") pod \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") "
Jul 07 18:01:09.294913 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.294736    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxpf5\" (UniqueName: \"kubernetes.io/projected/5a091005-8fde-4c3a-9109-e0861dbd0c2b-kube-api-access-nxpf5\") pod \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") "
Jul 07 18:01:09.294913 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.294881    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istiod-ca-cert\") pod \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") "
Jul 07 18:01:09.295231 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.294920    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-podinfo\") pod \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\" (UID: \"5a091005-8fde-4c3a-9109-e0861dbd0c2b\") "
Jul 07 18:01:09.295231 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.294921    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a091005-8fde-4c3a-9109-e0861dbd0c2b" (UID: "5a091005-8fde-4c3a-9109-e0861dbd0c2b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:09.295231 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.294959    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a091005-8fde-4c3a-9109-e0861dbd0c2b" (UID: "5a091005-8fde-4c3a-9109-e0861dbd0c2b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:09.295231 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.295089    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a091005-8fde-4c3a-9109-e0861dbd0c2b" (UID: "5a091005-8fde-4c3a-9109-e0861dbd0c2b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:09.295464 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.295319    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a091005-8fde-4c3a-9109-e0861dbd0c2b" (UID: "5a091005-8fde-4c3a-9109-e0861dbd0c2b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:01:09.295464 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.295388    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a091005-8fde-4c3a-9109-e0861dbd0c2b" (UID: "5a091005-8fde-4c3a-9109-e0861dbd0c2b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:09.295464 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.295410    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:09.295464 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.295429    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:09.295464 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.295443    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:09.295464 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.295456    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:09.297280 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.297231    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a091005-8fde-4c3a-9109-e0861dbd0c2b" (UID: "5a091005-8fde-4c3a-9109-e0861dbd0c2b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:01:09.297406 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.297351    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a091005-8fde-4c3a-9109-e0861dbd0c2b-kube-api-access-nxpf5" (OuterVolumeSpecName: "kube-api-access-nxpf5") pod "5a091005-8fde-4c3a-9109-e0861dbd0c2b" (UID: "5a091005-8fde-4c3a-9109-e0861dbd0c2b"). InnerVolumeSpecName "kube-api-access-nxpf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:01:09.297497 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.297474    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a091005-8fde-4c3a-9109-e0861dbd0c2b" (UID: "5a091005-8fde-4c3a-9109-e0861dbd0c2b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:01:09.297568 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.297486    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a091005-8fde-4c3a-9109-e0861dbd0c2b" (UID: "5a091005-8fde-4c3a-9109-e0861dbd0c2b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:09.396448 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.396407    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:09.396448 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.396441    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:09.396448 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.396454    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:09.396448 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.396461    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a091005-8fde-4c3a-9109-e0861dbd0c2b-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:09.396723 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.396470    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxpf5\" (UniqueName: \"kubernetes.io/projected/5a091005-8fde-4c3a-9109-e0861dbd0c2b-kube-api-access-nxpf5\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:09.712770 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.712731    2561 generic.go:356] "Generic (PLEG): container finished" podID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerID="f3d988fe77241989aa3a976be3ae2cbf7e9795a674f1420d583997628926923d" exitCode=0
Jul 07 18:01:09.713018 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.712778    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"
Jul 07 18:01:09.713018 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.712816    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx" event={"ID":"5a091005-8fde-4c3a-9109-e0861dbd0c2b","Type":"ContainerDied","Data":"f3d988fe77241989aa3a976be3ae2cbf7e9795a674f1420d583997628926923d"}
Jul 07 18:01:09.713018 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.712898    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx" event={"ID":"5a091005-8fde-4c3a-9109-e0861dbd0c2b","Type":"ContainerDied","Data":"35871f8da86ed169a6b12025302438c992ce89254c9a9e6aa56e8ceed923e2b2"}
Jul 07 18:01:09.713018 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.712922    2561 scope.go:117] "RemoveContainer" containerID="f3d988fe77241989aa3a976be3ae2cbf7e9795a674f1420d583997628926923d"
Jul 07 18:01:09.722630 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.722610    2561 scope.go:117] "RemoveContainer" containerID="5b49860da6b425263925a6b9f268c617c762e12e89c1303bf4fc7bc08fc67338"
Jul 07 18:01:09.731125 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.731098    2561 scope.go:117] "RemoveContainer" containerID="f3d988fe77241989aa3a976be3ae2cbf7e9795a674f1420d583997628926923d"
Jul 07 18:01:09.731385 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:01:09.731368    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3d988fe77241989aa3a976be3ae2cbf7e9795a674f1420d583997628926923d\": container with ID starting with f3d988fe77241989aa3a976be3ae2cbf7e9795a674f1420d583997628926923d not found: ID does not exist" containerID="f3d988fe77241989aa3a976be3ae2cbf7e9795a674f1420d583997628926923d"
Jul 07 18:01:09.731451 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.731392    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3d988fe77241989aa3a976be3ae2cbf7e9795a674f1420d583997628926923d"} err="failed to get container status \"f3d988fe77241989aa3a976be3ae2cbf7e9795a674f1420d583997628926923d\": rpc error: code = NotFound desc = could not find container \"f3d988fe77241989aa3a976be3ae2cbf7e9795a674f1420d583997628926923d\": container with ID starting with f3d988fe77241989aa3a976be3ae2cbf7e9795a674f1420d583997628926923d not found: ID does not exist"
Jul 07 18:01:09.731451 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.731409    2561 scope.go:117] "RemoveContainer" containerID="5b49860da6b425263925a6b9f268c617c762e12e89c1303bf4fc7bc08fc67338"
Jul 07 18:01:09.731670 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:01:09.731650    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b49860da6b425263925a6b9f268c617c762e12e89c1303bf4fc7bc08fc67338\": container with ID starting with 5b49860da6b425263925a6b9f268c617c762e12e89c1303bf4fc7bc08fc67338 not found: ID does not exist" containerID="5b49860da6b425263925a6b9f268c617c762e12e89c1303bf4fc7bc08fc67338"
Jul 07 18:01:09.731712 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.731677    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b49860da6b425263925a6b9f268c617c762e12e89c1303bf4fc7bc08fc67338"} err="failed to get container status \"5b49860da6b425263925a6b9f268c617c762e12e89c1303bf4fc7bc08fc67338\": rpc error: code = NotFound desc = could not find container \"5b49860da6b425263925a6b9f268c617c762e12e89c1303bf4fc7bc08fc67338\": container with ID starting with 5b49860da6b425263925a6b9f268c617c762e12e89c1303bf4fc7bc08fc67338 not found: ID does not exist"
Jul 07 18:01:09.737407 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.737379    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"]
Jul 07 18:01:09.742312 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:09.742288    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-28127c-openshift-default-5f77c755b9-h6mrx"]
Jul 07 18:01:10.810188 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:10.810154    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" path="/var/lib/kubelet/pods/5a091005-8fde-4c3a-9109-e0861dbd0c2b/volumes"
Jul 07 18:01:13.076015 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.075944    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"]
Jul 07 18:01:13.076400 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.076385    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerName="istio-proxy"
Jul 07 18:01:13.076441 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.076402    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerName="istio-proxy"
Jul 07 18:01:13.076441 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.076418    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerName="istio-proxy"
Jul 07 18:01:13.076441 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.076424    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerName="istio-proxy"
Jul 07 18:01:13.076551 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.076500    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerName="istio-proxy"
Jul 07 18:01:13.076551 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.076509    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ba2d987-ec69-4ce1-9124-578ec7d0a636" containerName="istio-proxy"
Jul 07 18:01:13.076551 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.076515    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a091005-8fde-4c3a-9109-e0861dbd0c2b" containerName="istio-proxy"
Jul 07 18:01:13.081188 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.081164    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.083729 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.083703    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b93a8f-openshift-default-dockercfg-9lbrm\""
Jul 07 18:01:13.092523 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.092495    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"]
Jul 07 18:01:13.235248 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.235215    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-credential-socket\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.235248 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.235252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-data\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.235480 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.235277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-workload-certs\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.235480 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.235313    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istiod-ca-cert\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.235480 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.235367    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm6rp\" (UniqueName: \"kubernetes.io/projected/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-kube-api-access-jm6rp\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.235480 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.235402    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-workload-socket\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.235480 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.235426    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-token\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.235647 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.235521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-envoy\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.235647 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.235559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-podinfo\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.336875 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.336776    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-data\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.336875 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.336824    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-workload-certs\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.336875 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.336857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istiod-ca-cert\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.337179 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.336885    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm6rp\" (UniqueName: \"kubernetes.io/projected/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-kube-api-access-jm6rp\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.337179 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.336910    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-workload-socket\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.337179 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.336937    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-token\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.337179 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.337037    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-envoy\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.337179 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.337085    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-podinfo\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.337179 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.337155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-credential-socket\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.337501 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.337339    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-data\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.337560 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.337513    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-credential-socket\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.337616 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.337568    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-workload-socket\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.337616 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.337582    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-workload-certs\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.337828 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.337811    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istiod-ca-cert\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.339522 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.339495    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-envoy\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.339778 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.339758    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-podinfo\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.347880 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.347849    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-token\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.348057 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.348026    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm6rp\" (UniqueName: \"kubernetes.io/projected/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-kube-api-access-jm6rp\") pod \"e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") " pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.392189 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.392152    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:13.542756 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.542731    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"]
Jul 07 18:01:13.544679 ip-10-0-136-242 kubenswrapper[2561]: W0707 18:01:13.544641    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a429065_1ee1_47d1_b5f7_6cf508ef1d1d.slice/crio-7090ca2e7ea0992250e4ddaafb2949f0f35a3a197aa38bc22779db1d02dce887 WatchSource:0}: Error finding container 7090ca2e7ea0992250e4ddaafb2949f0f35a3a197aa38bc22779db1d02dce887: Status 404 returned error can't find the container with id 7090ca2e7ea0992250e4ddaafb2949f0f35a3a197aa38bc22779db1d02dce887
Jul 07 18:01:13.546836 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.546806    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:13.546921 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.546871    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:13.546921 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.546899    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:13.736719 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.736667    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx" event={"ID":"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d","Type":"ContainerStarted","Data":"6270ebcec3c3f6998792621f6c9960c4e00c95cbf20e520d1217f6bfdb7ef911"}
Jul 07 18:01:13.736923 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.736748    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx" event={"ID":"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d","Type":"ContainerStarted","Data":"7090ca2e7ea0992250e4ddaafb2949f0f35a3a197aa38bc22779db1d02dce887"}
Jul 07 18:01:13.758583 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:13.758532    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx" podStartSLOduration=0.758515211 podStartE2EDuration="758.515211ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:01:13.75668201 +0000 UTC m=+2003.520141855" watchObservedRunningTime="2026-07-07 18:01:13.758515211 +0000 UTC m=+2003.521975057"
Jul 07 18:01:14.395216 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:14.395162    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:14.400847 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:14.400808    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:14.741996 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:14.741881    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:14.742952 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:14.742935    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:21.698330 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:21.698223    2561 patch_prober.go:28] interesting pod/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 07 18:01:21.698330 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:21.698294    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t" podUID="5f282c5a-6338-40f4-94ef-0c45c9c79286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 07 18:01:21.783204 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:21.783156    2561 generic.go:356] "Generic (PLEG): container finished" podID="5f282c5a-6338-40f4-94ef-0c45c9c79286" containerID="4d7c53ac674d2a0470d9acf4a47682831e14a75c947f66d8c2ea32326488c358" exitCode=0
Jul 07 18:01:21.783417 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:21.783240    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t" event={"ID":"5f282c5a-6338-40f4-94ef-0c45c9c79286","Type":"ContainerDied","Data":"4d7c53ac674d2a0470d9acf4a47682831e14a75c947f66d8c2ea32326488c358"}
Jul 07 18:01:21.783774 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:21.783748    2561 scope.go:117] "RemoveContainer" containerID="4d7c53ac674d2a0470d9acf4a47682831e14a75c947f66d8c2ea32326488c358"
Jul 07 18:01:21.785898 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:21.785863    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:21.786134 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:21.786111    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:21.786290 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:21.786271    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:22.793805 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:22.793758    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t" event={"ID":"5f282c5a-6338-40f4-94ef-0c45c9c79286","Type":"ContainerStarted","Data":"63126d2ed0636d3d8e0496be1689bd698d05647b8322f6b98a603d8e6f47daf1"}
Jul 07 18:01:23.205819 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:23.205782    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:23.206257 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:23.206232    2561 patch_prober.go:28] interesting pod/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 07 18:01:23.206416 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:23.206388    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t" podUID="5f282c5a-6338-40f4-94ef-0c45c9c79286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 07 18:01:24.205744 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:24.205706    2561 patch_prober.go:28] interesting pod/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 07 18:01:24.206169 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:24.205766    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t" podUID="5f282c5a-6338-40f4-94ef-0c45c9c79286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 07 18:01:25.206315 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:25.206272    2561 patch_prober.go:28] interesting pod/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 07 18:01:25.206739 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:25.206329    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t" podUID="5f282c5a-6338-40f4-94ef-0c45c9c79286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 07 18:01:26.206446 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:26.206391    2561 patch_prober.go:28] interesting pod/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 07 18:01:26.206995 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:26.206464    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t" podUID="5f282c5a-6338-40f4-94ef-0c45c9c79286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 07 18:01:27.210161 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:27.210125    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:27.210720 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:27.210419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:27.211245 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:27.211224    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:27.862034 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:27.862002    2561 generic.go:356] "Generic (PLEG): container finished" podID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" containerID="6270ebcec3c3f6998792621f6c9960c4e00c95cbf20e520d1217f6bfdb7ef911" exitCode=0
Jul 07 18:01:27.862271 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:27.862081    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx" event={"ID":"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d","Type":"ContainerDied","Data":"6270ebcec3c3f6998792621f6c9960c4e00c95cbf20e520d1217f6bfdb7ef911"}
Jul 07 18:01:27.862704 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:27.862678    2561 scope.go:117] "RemoveContainer" containerID="6270ebcec3c3f6998792621f6c9960c4e00c95cbf20e520d1217f6bfdb7ef911"
Jul 07 18:01:27.863657 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:27.863632    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:27.863720 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:27.863700    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:27.863759 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:27.863740    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:28.869368 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:28.869320    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx" event={"ID":"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d","Type":"ContainerStarted","Data":"036af91a9bc6157aa870f436ef7fc13a47ea8793e406efa54930fa8cfad3d176"}
Jul 07 18:01:29.393218 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:29.393124    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:29.394687 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:29.394653    2561 patch_prober.go:28] interesting pod/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 07 18:01:29.394923 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:29.394892    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx" podUID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 07 18:01:29.742726 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:29.742621    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:30.393349 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:30.393304    2561 patch_prober.go:28] interesting pod/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 07 18:01:30.393905 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:30.393373    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx" podUID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 07 18:01:31.393196 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:31.393151    2561 patch_prober.go:28] interesting pod/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 07 18:01:31.393459 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:31.393218    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx" podUID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 07 18:01:32.393314 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:32.393267    2561 patch_prober.go:28] interesting pod/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 07 18:01:32.393547 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:32.393351    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx" podUID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 07 18:01:33.397845 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:33.397816    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:33.398988 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:33.398948    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:36.091628 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:36.091595    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"]
Jul 07 18:01:36.092093 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:36.091816    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t" podUID="5f282c5a-6338-40f4-94ef-0c45c9c79286" containerName="istio-proxy" containerID="cri-o://63126d2ed0636d3d8e0496be1689bd698d05647b8322f6b98a603d8e6f47daf1" gracePeriod=30
Jul 07 18:01:41.360397 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.360323    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:41.440131 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.440092    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-workload-certs\") pod \"5f282c5a-6338-40f4-94ef-0c45c9c79286\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") "
Jul 07 18:01:41.440322 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.440159    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-envoy\") pod \"5f282c5a-6338-40f4-94ef-0c45c9c79286\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") "
Jul 07 18:01:41.440322 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.440189    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f282c5a-6338-40f4-94ef-0c45c9c79286-istiod-ca-cert\") pod \"5f282c5a-6338-40f4-94ef-0c45c9c79286\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") "
Jul 07 18:01:41.440322 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.440212    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-token\") pod \"5f282c5a-6338-40f4-94ef-0c45c9c79286\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") "
Jul 07 18:01:41.440322 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.440248    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f282c5a-6338-40f4-94ef-0c45c9c79286" (UID: "5f282c5a-6338-40f4-94ef-0c45c9c79286"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:41.440322 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.440305    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6wnw\" (UniqueName: \"kubernetes.io/projected/5f282c5a-6338-40f4-94ef-0c45c9c79286-kube-api-access-b6wnw\") pod \"5f282c5a-6338-40f4-94ef-0c45c9c79286\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") "
Jul 07 18:01:41.440605 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.440341    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-credential-socket\") pod \"5f282c5a-6338-40f4-94ef-0c45c9c79286\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") "
Jul 07 18:01:41.440605 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.440468    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-data\") pod \"5f282c5a-6338-40f4-94ef-0c45c9c79286\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") "
Jul 07 18:01:41.440605 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.440525    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-workload-socket\") pod \"5f282c5a-6338-40f4-94ef-0c45c9c79286\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") "
Jul 07 18:01:41.440605 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.440568    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-podinfo\") pod \"5f282c5a-6338-40f4-94ef-0c45c9c79286\" (UID: \"5f282c5a-6338-40f4-94ef-0c45c9c79286\") "
Jul 07 18:01:41.440605 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.440571    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f282c5a-6338-40f4-94ef-0c45c9c79286-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f282c5a-6338-40f4-94ef-0c45c9c79286" (UID: "5f282c5a-6338-40f4-94ef-0c45c9c79286"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:01:41.440605 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.440580    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f282c5a-6338-40f4-94ef-0c45c9c79286" (UID: "5f282c5a-6338-40f4-94ef-0c45c9c79286"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:41.440867 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.440716    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f282c5a-6338-40f4-94ef-0c45c9c79286" (UID: "5f282c5a-6338-40f4-94ef-0c45c9c79286"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:41.441083 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.441057    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:41.441449 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.441426    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f282c5a-6338-40f4-94ef-0c45c9c79286-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:41.441563 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.441452    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:41.441563 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.441246    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f282c5a-6338-40f4-94ef-0c45c9c79286" (UID: "5f282c5a-6338-40f4-94ef-0c45c9c79286"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:41.441563 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.441468    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:41.442845 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.442822    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f282c5a-6338-40f4-94ef-0c45c9c79286" (UID: "5f282c5a-6338-40f4-94ef-0c45c9c79286"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:01:41.442845 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.442827    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f282c5a-6338-40f4-94ef-0c45c9c79286-kube-api-access-b6wnw" (OuterVolumeSpecName: "kube-api-access-b6wnw") pod "5f282c5a-6338-40f4-94ef-0c45c9c79286" (UID: "5f282c5a-6338-40f4-94ef-0c45c9c79286"). InnerVolumeSpecName "kube-api-access-b6wnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:01:41.443037 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.443016    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f282c5a-6338-40f4-94ef-0c45c9c79286" (UID: "5f282c5a-6338-40f4-94ef-0c45c9c79286"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:01:41.443037 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.443025    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f282c5a-6338-40f4-94ef-0c45c9c79286" (UID: "5f282c5a-6338-40f4-94ef-0c45c9c79286"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:41.542569 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.542530    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:41.542569 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.542562    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:41.542569 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.542571    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6wnw\" (UniqueName: \"kubernetes.io/projected/5f282c5a-6338-40f4-94ef-0c45c9c79286-kube-api-access-b6wnw\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:41.542569 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.542579    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:41.542848 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.542588    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f282c5a-6338-40f4-94ef-0c45c9c79286-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:41.950616 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.950581    2561 generic.go:356] "Generic (PLEG): container finished" podID="5f282c5a-6338-40f4-94ef-0c45c9c79286" containerID="63126d2ed0636d3d8e0496be1689bd698d05647b8322f6b98a603d8e6f47daf1" exitCode=0
Jul 07 18:01:41.950817 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.950630    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"
Jul 07 18:01:41.950817 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.950657    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t" event={"ID":"5f282c5a-6338-40f4-94ef-0c45c9c79286","Type":"ContainerDied","Data":"63126d2ed0636d3d8e0496be1689bd698d05647b8322f6b98a603d8e6f47daf1"}
Jul 07 18:01:41.950817 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.950719    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t" event={"ID":"5f282c5a-6338-40f4-94ef-0c45c9c79286","Type":"ContainerDied","Data":"320e7cb6efd122163b1b95713f69ea23ade2c5bf5dacaab3642f007f027e0f6e"}
Jul 07 18:01:41.950817 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.950750    2561 scope.go:117] "RemoveContainer" containerID="63126d2ed0636d3d8e0496be1689bd698d05647b8322f6b98a603d8e6f47daf1"
Jul 07 18:01:41.960790 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.960765    2561 scope.go:117] "RemoveContainer" containerID="4d7c53ac674d2a0470d9acf4a47682831e14a75c947f66d8c2ea32326488c358"
Jul 07 18:01:41.969456 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.969435    2561 scope.go:117] "RemoveContainer" containerID="63126d2ed0636d3d8e0496be1689bd698d05647b8322f6b98a603d8e6f47daf1"
Jul 07 18:01:41.969792 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:01:41.969769    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63126d2ed0636d3d8e0496be1689bd698d05647b8322f6b98a603d8e6f47daf1\": container with ID starting with 63126d2ed0636d3d8e0496be1689bd698d05647b8322f6b98a603d8e6f47daf1 not found: ID does not exist" containerID="63126d2ed0636d3d8e0496be1689bd698d05647b8322f6b98a603d8e6f47daf1"
Jul 07 18:01:41.969868 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.969804    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63126d2ed0636d3d8e0496be1689bd698d05647b8322f6b98a603d8e6f47daf1"} err="failed to get container status \"63126d2ed0636d3d8e0496be1689bd698d05647b8322f6b98a603d8e6f47daf1\": rpc error: code = NotFound desc = could not find container \"63126d2ed0636d3d8e0496be1689bd698d05647b8322f6b98a603d8e6f47daf1\": container with ID starting with 63126d2ed0636d3d8e0496be1689bd698d05647b8322f6b98a603d8e6f47daf1 not found: ID does not exist"
Jul 07 18:01:41.969868 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.969827    2561 scope.go:117] "RemoveContainer" containerID="4d7c53ac674d2a0470d9acf4a47682831e14a75c947f66d8c2ea32326488c358"
Jul 07 18:01:41.970130 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:01:41.970111    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d7c53ac674d2a0470d9acf4a47682831e14a75c947f66d8c2ea32326488c358\": container with ID starting with 4d7c53ac674d2a0470d9acf4a47682831e14a75c947f66d8c2ea32326488c358 not found: ID does not exist" containerID="4d7c53ac674d2a0470d9acf4a47682831e14a75c947f66d8c2ea32326488c358"
Jul 07 18:01:41.970178 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.970138    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d7c53ac674d2a0470d9acf4a47682831e14a75c947f66d8c2ea32326488c358"} err="failed to get container status \"4d7c53ac674d2a0470d9acf4a47682831e14a75c947f66d8c2ea32326488c358\": rpc error: code = NotFound desc = could not find container \"4d7c53ac674d2a0470d9acf4a47682831e14a75c947f66d8c2ea32326488c358\": container with ID starting with 4d7c53ac674d2a0470d9acf4a47682831e14a75c947f66d8c2ea32326488c358 not found: ID does not exist"
Jul 07 18:01:41.975208 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.975182    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"]
Jul 07 18:01:41.981535 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:41.981508    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1e4fca-openshift-default-589fc89555-m4f2t"]
Jul 07 18:01:42.811264 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:42.811231    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f282c5a-6338-40f4-94ef-0c45c9c79286" path="/var/lib/kubelet/pods/5f282c5a-6338-40f4-94ef-0c45c9c79286/volumes"
Jul 07 18:01:43.752847 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:43.752809    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"]
Jul 07 18:01:43.753087 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:43.753047    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx" podUID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" containerName="istio-proxy" containerID="cri-o://036af91a9bc6157aa870f436ef7fc13a47ea8793e406efa54930fa8cfad3d176" gracePeriod=30
Jul 07 18:01:48.401284 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:48.401242    2561 patch_prober.go:28] interesting pod/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 18:01:48.401692 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:48.401332    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx" podUID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 18:01:48.989366 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:48.989257    2561 generic.go:356] "Generic (PLEG): container finished" podID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" containerID="036af91a9bc6157aa870f436ef7fc13a47ea8793e406efa54930fa8cfad3d176" exitCode=0
Jul 07 18:01:48.989366 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:48.989333    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx" event={"ID":"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d","Type":"ContainerDied","Data":"036af91a9bc6157aa870f436ef7fc13a47ea8793e406efa54930fa8cfad3d176"}
Jul 07 18:01:48.989525 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:48.989393    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx" event={"ID":"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d","Type":"ContainerDied","Data":"7090ca2e7ea0992250e4ddaafb2949f0f35a3a197aa38bc22779db1d02dce887"}
Jul 07 18:01:48.989525 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:48.989424    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7090ca2e7ea0992250e4ddaafb2949f0f35a3a197aa38bc22779db1d02dce887"
Jul 07 18:01:48.989525 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:48.989438    2561 scope.go:117] "RemoveContainer" containerID="6270ebcec3c3f6998792621f6c9960c4e00c95cbf20e520d1217f6bfdb7ef911"
Jul 07 18:01:49.003983 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:01:49.003942    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6270ebcec3c3f6998792621f6c9960c4e00c95cbf20e520d1217f6bfdb7ef911\": container with ID starting with 6270ebcec3c3f6998792621f6c9960c4e00c95cbf20e520d1217f6bfdb7ef911 not found: ID does not exist" containerID="6270ebcec3c3f6998792621f6c9960c4e00c95cbf20e520d1217f6bfdb7ef911"
Jul 07 18:01:49.007655 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.007635    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:49.118469 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.118433    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm6rp\" (UniqueName: \"kubernetes.io/projected/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-kube-api-access-jm6rp\") pod \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") "
Jul 07 18:01:49.118469 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.118477    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-token\") pod \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") "
Jul 07 18:01:49.118740 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.118509    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-data\") pod \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") "
Jul 07 18:01:49.118740 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.118535    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-envoy\") pod \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") "
Jul 07 18:01:49.118740 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.118566    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istiod-ca-cert\") pod \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") "
Jul 07 18:01:49.118740 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.118629    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-workload-socket\") pod \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") "
Jul 07 18:01:49.118740 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.118689    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-podinfo\") pod \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") "
Jul 07 18:01:49.118740 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.118728    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-workload-certs\") pod \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") "
Jul 07 18:01:49.119086 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.118755    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-credential-socket\") pod \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\" (UID: \"6a429065-1ee1-47d1-b5f7-6cf508ef1d1d\") "
Jul 07 18:01:49.119086 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.118936    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" (UID: "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:49.119086 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.119002    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" (UID: "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:01:49.119263 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.119172    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" (UID: "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:49.119335 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.119225    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:49.119335 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.119279    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:49.119541 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.119506    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" (UID: "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:49.119671 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.119570    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" (UID: "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:49.120932 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.120907    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-kube-api-access-jm6rp" (OuterVolumeSpecName: "kube-api-access-jm6rp") pod "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" (UID: "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d"). InnerVolumeSpecName "kube-api-access-jm6rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:01:49.121043 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.120907    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" (UID: "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:01:49.121043 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.120938    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" (UID: "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:01:49.121176 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.121161    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" (UID: "6a429065-1ee1-47d1-b5f7-6cf508ef1d1d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:01:49.220796 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.220756    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm6rp\" (UniqueName: \"kubernetes.io/projected/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-kube-api-access-jm6rp\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:49.220796 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.220787    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:49.220796 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.220799    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:49.220796 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.220807    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:49.221114 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.220817    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:49.221114 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.220826    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:49.221114 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.220834    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:01:49.995311 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:49.995284    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"
Jul 07 18:01:50.025443 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:50.025394    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"]
Jul 07 18:01:50.031305 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:50.031270    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b93a8f-openshift-default-6ddd99576c-nhqbx"]
Jul 07 18:01:50.810107 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:50.810078    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" path="/var/lib/kubelet/pods/6a429065-1ee1-47d1-b5f7-6cf508ef1d1d/volumes"
Jul 07 18:01:56.128076 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.128034    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"]
Jul 07 18:01:56.128649 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.128594    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f282c5a-6338-40f4-94ef-0c45c9c79286" containerName="istio-proxy"
Jul 07 18:01:56.128649 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.128616    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f282c5a-6338-40f4-94ef-0c45c9c79286" containerName="istio-proxy"
Jul 07 18:01:56.128649 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.128632    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" containerName="istio-proxy"
Jul 07 18:01:56.128649 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.128640    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" containerName="istio-proxy"
Jul 07 18:01:56.128927 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.128678    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f282c5a-6338-40f4-94ef-0c45c9c79286" containerName="istio-proxy"
Jul 07 18:01:56.128927 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.128687    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f282c5a-6338-40f4-94ef-0c45c9c79286" containerName="istio-proxy"
Jul 07 18:01:56.128927 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.128788    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f282c5a-6338-40f4-94ef-0c45c9c79286" containerName="istio-proxy"
Jul 07 18:01:56.128927 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.128803    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f282c5a-6338-40f4-94ef-0c45c9c79286" containerName="istio-proxy"
Jul 07 18:01:56.128927 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.128816    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" containerName="istio-proxy"
Jul 07 18:01:56.128927 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.128827    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" containerName="istio-proxy"
Jul 07 18:01:56.132270 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.132246    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.135755 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.135733    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-b60419-openshift-default-dockercfg-2v897\""
Jul 07 18:01:56.146496 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.146475    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"]
Jul 07 18:01:56.183847 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.183816    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2c6081f-5ad8-4340-b602-f45cb62d9543-istiod-ca-cert\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.184070 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.183869    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-data\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.184070 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.183927    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-credential-socket\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.184070 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.183952    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-podinfo\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.184070 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.183999    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-workload-certs\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.184070 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.184021    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-workload-socket\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.184070 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.184041    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-token\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.184311 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.184091    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2q8v\" (UniqueName: \"kubernetes.io/projected/b2c6081f-5ad8-4340-b602-f45cb62d9543-kube-api-access-w2q8v\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.184311 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.184121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-envoy\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.285091 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.285046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2c6081f-5ad8-4340-b602-f45cb62d9543-istiod-ca-cert\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.285091 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.285101    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-data\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.285370 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.285133    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-credential-socket\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.285370 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.285159    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-podinfo\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.285370 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.285176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-workload-certs\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.285370 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.285202    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-workload-socket\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.285370 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.285225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-token\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.285370 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.285279    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2q8v\" (UniqueName: \"kubernetes.io/projected/b2c6081f-5ad8-4340-b602-f45cb62d9543-kube-api-access-w2q8v\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.285370 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.285323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-envoy\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.285757 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.285650    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-data\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.285825 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.285748    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-workload-certs\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.285825 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.285784    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-credential-socket\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.286003 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.285951    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-workload-socket\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.286003 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.285952    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2c6081f-5ad8-4340-b602-f45cb62d9543-istiod-ca-cert\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.287889 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.287866    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-envoy\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.288027 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.288007    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-podinfo\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.294436 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.294413    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-token\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.294577 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.294559    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2q8v\" (UniqueName: \"kubernetes.io/projected/b2c6081f-5ad8-4340-b602-f45cb62d9543-kube-api-access-w2q8v\") pod \"e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") " pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.443191 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.443088    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:56.591802 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.591770    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"]
Jul 07 18:01:56.593856 ip-10-0-136-242 kubenswrapper[2561]: W0707 18:01:56.593807    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c6081f_5ad8_4340_b602_f45cb62d9543.slice/crio-c227fe4d6a0c16cf5eb612f0ad427c812d769720226e8dc2718fd02bccaf7973 WatchSource:0}: Error finding container c227fe4d6a0c16cf5eb612f0ad427c812d769720226e8dc2718fd02bccaf7973: Status 404 returned error can't find the container with id c227fe4d6a0c16cf5eb612f0ad427c812d769720226e8dc2718fd02bccaf7973
Jul 07 18:01:56.596189 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.596145    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:56.596261 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.596244    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:56.596309 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:56.596290    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:01:57.034123 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:57.034083    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk" event={"ID":"b2c6081f-5ad8-4340-b602-f45cb62d9543","Type":"ContainerStarted","Data":"5586f6c1858ddbc77caf78c32972afb630b2a5c145e0544e7386d7e67d11c0ea"}
Jul 07 18:01:57.034341 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:57.034152    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk" event={"ID":"b2c6081f-5ad8-4340-b602-f45cb62d9543","Type":"ContainerStarted","Data":"c227fe4d6a0c16cf5eb612f0ad427c812d769720226e8dc2718fd02bccaf7973"}
Jul 07 18:01:57.060257 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:57.060205    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk" podStartSLOduration=1.06018715 podStartE2EDuration="1.06018715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:01:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:01:57.057237142 +0000 UTC m=+2046.820696989" watchObservedRunningTime="2026-07-07 18:01:57.06018715 +0000 UTC m=+2046.823646993"
Jul 07 18:01:57.444156 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:57.444120    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:57.449132 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:57.449103    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:58.038812 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:58.038781    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:58.039898 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:58.039881    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:01:59.233667 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.233620    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"]
Jul 07 18:01:59.234262 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.234245    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" containerName="istio-proxy"
Jul 07 18:01:59.234350 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.234265    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a429065-1ee1-47d1-b5f7-6cf508ef1d1d" containerName="istio-proxy"
Jul 07 18:01:59.237985 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.237946    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:01:59.240794 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.240772    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-b60419-serving-cert\""
Jul 07 18:01:59.240929 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.240838    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-q97km\""
Jul 07 18:01:59.247257 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.247231    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"]
Jul 07 18:01:59.318286 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.318250    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef59eb2f-def4-47e8-bb20-804cd59461a6-maas-api-tls\") pod \"maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc\" (UID: \"ef59eb2f-def4-47e8-bb20-804cd59461a6\") " pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:01:59.318286 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.318286    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef59eb2f-def4-47e8-bb20-804cd59461a6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc\" (UID: \"ef59eb2f-def4-47e8-bb20-804cd59461a6\") " pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:01:59.318503 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.318475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfbw8\" (UniqueName: \"kubernetes.io/projected/ef59eb2f-def4-47e8-bb20-804cd59461a6-kube-api-access-qfbw8\") pod \"maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc\" (UID: \"ef59eb2f-def4-47e8-bb20-804cd59461a6\") " pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:01:59.419606 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.419560    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfbw8\" (UniqueName: \"kubernetes.io/projected/ef59eb2f-def4-47e8-bb20-804cd59461a6-kube-api-access-qfbw8\") pod \"maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc\" (UID: \"ef59eb2f-def4-47e8-bb20-804cd59461a6\") " pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:01:59.419606 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.419614    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef59eb2f-def4-47e8-bb20-804cd59461a6-maas-api-tls\") pod \"maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc\" (UID: \"ef59eb2f-def4-47e8-bb20-804cd59461a6\") " pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:01:59.419858 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.419636    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef59eb2f-def4-47e8-bb20-804cd59461a6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc\" (UID: \"ef59eb2f-def4-47e8-bb20-804cd59461a6\") " pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:01:59.419858 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:01:59.419729    2561 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-b60419-serving-cert: secret "maas-api-e2e-shared-b-b60419-serving-cert" not found
Jul 07 18:01:59.419858 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:01:59.419807    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef59eb2f-def4-47e8-bb20-804cd59461a6-maas-api-tls podName:ef59eb2f-def4-47e8-bb20-804cd59461a6 nodeName:}" failed. No retries permitted until 2026-07-07 18:01:59.919786031 +0000 UTC m=+2049.683245859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef59eb2f-def4-47e8-bb20-804cd59461a6-maas-api-tls") pod "maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc" (UID: "ef59eb2f-def4-47e8-bb20-804cd59461a6") : secret "maas-api-e2e-shared-b-b60419-serving-cert" not found
Jul 07 18:01:59.420296 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.420278    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef59eb2f-def4-47e8-bb20-804cd59461a6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc\" (UID: \"ef59eb2f-def4-47e8-bb20-804cd59461a6\") " pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:01:59.429828 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.429800    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfbw8\" (UniqueName: \"kubernetes.io/projected/ef59eb2f-def4-47e8-bb20-804cd59461a6-kube-api-access-qfbw8\") pod \"maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc\" (UID: \"ef59eb2f-def4-47e8-bb20-804cd59461a6\") " pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:01:59.925223 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.925178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef59eb2f-def4-47e8-bb20-804cd59461a6-maas-api-tls\") pod \"maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc\" (UID: \"ef59eb2f-def4-47e8-bb20-804cd59461a6\") " pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:01:59.928107 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:01:59.928085    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef59eb2f-def4-47e8-bb20-804cd59461a6-maas-api-tls\") pod \"maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc\" (UID: \"ef59eb2f-def4-47e8-bb20-804cd59461a6\") " pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:02:00.151731 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:00.151694    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:02:00.301799 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:00.301763    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"]
Jul 07 18:02:00.303679 ip-10-0-136-242 kubenswrapper[2561]: W0707 18:02:00.303640    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef59eb2f_def4_47e8_bb20_804cd59461a6.slice/crio-2be2d80a557404fad3b06bf6a0f6d5e65ae291fc7707bee54d4a96368679559f WatchSource:0}: Error finding container 2be2d80a557404fad3b06bf6a0f6d5e65ae291fc7707bee54d4a96368679559f: Status 404 returned error can't find the container with id 2be2d80a557404fad3b06bf6a0f6d5e65ae291fc7707bee54d4a96368679559f
Jul 07 18:02:00.305234 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:00.305214    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:02:01.056706 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:01.056588    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc" event={"ID":"ef59eb2f-def4-47e8-bb20-804cd59461a6","Type":"ContainerStarted","Data":"af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5"}
Jul 07 18:02:01.056706 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:01.056663    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc" event={"ID":"ef59eb2f-def4-47e8-bb20-804cd59461a6","Type":"ContainerStarted","Data":"2be2d80a557404fad3b06bf6a0f6d5e65ae291fc7707bee54d4a96368679559f"}
Jul 07 18:02:01.056953 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:01.056728    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:02:01.078383 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:01.078322    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc" podStartSLOduration=1.621179529 podStartE2EDuration="2.078301366s" totalImagesPullingTime="457.121837ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:01.077161133 +0000 UTC m=+2050.840620994" watchObservedRunningTime="2026-07-07 18:02:01.078301366 +0000 UTC m=+2050.841761213"
Jul 07 18:02:07.067638 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:07.067606    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:02:11.421625 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.421594    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"]
Jul 07 18:02:11.424197 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.424173    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.426847 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.426825    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8c0ae4\"/\"kube-root-ca.crt\""
Jul 07 18:02:11.427806 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.427785    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8c0ae4\"/\"default-dockercfg-jkfcb\""
Jul 07 18:02:11.427937 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.427830    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8c0ae4\"/\"openshift-service-ca.crt\""
Jul 07 18:02:11.427937 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.427876    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8c0ae4\"/\"auth-test-model-8c0ae4-kserve-self-signed-certs\""
Jul 07 18:02:11.436850 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.436825    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"]
Jul 07 18:02:11.562137 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.562108    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-tls-certs\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.562323 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.562161    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-tmp-dir\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.562323 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.562221    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-home\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.562323 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.562267    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-dshm\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.562442 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.562335    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62664\" (UniqueName: \"kubernetes.io/projected/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-kube-api-access-62664\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.562442 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.562364    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-model-cache\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.663462 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.663373    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-model-cache\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.663462 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.663424    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-tls-certs\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.663462 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.663454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-tmp-dir\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.663733 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.663481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-home\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.663733 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.663532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-dshm\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.663733 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.663584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62664\" (UniqueName: \"kubernetes.io/projected/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-kube-api-access-62664\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.663993 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.663756    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-model-cache\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.663993 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.663868    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-tmp-dir\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.663993 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.663925    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-home\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.665894 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.665878    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-dshm\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.666190 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.666171    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-tls-certs\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.673579 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.673553    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62664\" (UniqueName: \"kubernetes.io/projected/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-kube-api-access-62664\") pod \"auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") " pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.734231 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.734188    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:11.877998 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:11.877942    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"]
Jul 07 18:02:11.881514 ip-10-0-136-242 kubenswrapper[2561]: W0707 18:02:11.881487    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72ec6e6d_3e46_4f7a_a16e_3e58f41f2c17.slice/crio-3a6db1a80f056b3ba0516d14530dac44128e2f28934150e4c75ab47bb3733412 WatchSource:0}: Error finding container 3a6db1a80f056b3ba0516d14530dac44128e2f28934150e4c75ab47bb3733412: Status 404 returned error can't find the container with id 3a6db1a80f056b3ba0516d14530dac44128e2f28934150e4c75ab47bb3733412
Jul 07 18:02:12.129595 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:12.129551    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5" event={"ID":"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17","Type":"ContainerStarted","Data":"8d0bdad9731909335ebfdc81079baa044a9ca047be3794b8509e28d48b0b2798"}
Jul 07 18:02:12.129595 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:12.129601    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5" event={"ID":"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17","Type":"ContainerStarted","Data":"3a6db1a80f056b3ba0516d14530dac44128e2f28934150e4c75ab47bb3733412"}
Jul 07 18:02:12.131146 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:12.131121    2561 generic.go:356] "Generic (PLEG): container finished" podID="b2c6081f-5ad8-4340-b602-f45cb62d9543" containerID="5586f6c1858ddbc77caf78c32972afb630b2a5c145e0544e7386d7e67d11c0ea" exitCode=0
Jul 07 18:02:12.131271 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:12.131190    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk" event={"ID":"b2c6081f-5ad8-4340-b602-f45cb62d9543","Type":"ContainerDied","Data":"5586f6c1858ddbc77caf78c32972afb630b2a5c145e0544e7386d7e67d11c0ea"}
Jul 07 18:02:12.131591 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:12.131571    2561 scope.go:117] "RemoveContainer" containerID="5586f6c1858ddbc77caf78c32972afb630b2a5c145e0544e7386d7e67d11c0ea"
Jul 07 18:02:12.132657 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:12.132633    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:02:12.132732 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:12.132719    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:02:12.132769 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:12.132754    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 07 18:02:12.148632 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:12.148578    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5" podStartSLOduration=1.148561965 podStartE2EDuration="1.148561965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:12.147070949 +0000 UTC m=+2061.910530794" watchObservedRunningTime="2026-07-07 18:02:12.148561965 +0000 UTC m=+2061.912021811"
Jul 07 18:02:13.039078 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:13.039034    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:02:13.137824 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:13.137778    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk" event={"ID":"b2c6081f-5ad8-4340-b602-f45cb62d9543","Type":"ContainerStarted","Data":"145d48a0b2ce0d907732b9e8d7225dc6d3daddccc939f24a5a8edd38cb1caa5e"}
Jul 07 18:02:13.443467 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:13.443426    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:02:13.444582 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:13.444559    2561 patch_prober.go:28] interesting pod/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 07 18:02:13.444643 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:13.444613    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk" podUID="b2c6081f-5ad8-4340-b602-f45cb62d9543" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 07 18:02:14.443785 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:14.443744    2561 patch_prober.go:28] interesting pod/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 07 18:02:14.444225 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:14.443807    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk" podUID="b2c6081f-5ad8-4340-b602-f45cb62d9543" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 07 18:02:15.443544 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:15.443499    2561 patch_prober.go:28] interesting pod/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 07 18:02:15.443728 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:15.443561    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk" podUID="b2c6081f-5ad8-4340-b602-f45cb62d9543" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 07 18:02:16.444522 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:16.444476    2561 patch_prober.go:28] interesting pod/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 07 18:02:16.445068 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:16.444539    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk" podUID="b2c6081f-5ad8-4340-b602-f45cb62d9543" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 07 18:02:17.447555 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:17.447524    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:02:17.447955 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:17.447861    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:02:17.448493 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:17.448475    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:02:21.734673 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:21.734638    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:21.735134 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:21.734698    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:21.747400 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:21.747374    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:02:22.194557 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:02:22.194517    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:03:11.423924 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.423891    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"]
Jul 07 18:03:11.428148 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.428127    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.430795 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.430771    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b60419\"/\"auth-test-model-b60419-kserve-self-signed-certs\""
Jul 07 18:03:11.431872 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.431855    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b60419\"/\"default-dockercfg-fmvkf\""
Jul 07 18:03:11.431872 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.431865    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b60419\"/\"kube-root-ca.crt\""
Jul 07 18:03:11.431959 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.431869    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b60419\"/\"openshift-service-ca.crt\""
Jul 07 18:03:11.439298 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.439262    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"]
Jul 07 18:03:11.484916 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.484877    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/222b8682-12fe-40ed-a299-df9ae39156b5-tls-certs\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.485123 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.484929    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7644\" (UniqueName: \"kubernetes.io/projected/222b8682-12fe-40ed-a299-df9ae39156b5-kube-api-access-p7644\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.485123 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.485068    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-dshm\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.485204 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.485130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-home\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.485204 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.485188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-model-cache\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.485282 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.485250    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-tmp-dir\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.585902 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.585869    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-dshm\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.586111 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.585924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-home\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.586111 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.585957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-model-cache\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.586111 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.586008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-tmp-dir\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.586111 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.586066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/222b8682-12fe-40ed-a299-df9ae39156b5-tls-certs\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.586111 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.586109    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7644\" (UniqueName: \"kubernetes.io/projected/222b8682-12fe-40ed-a299-df9ae39156b5-kube-api-access-p7644\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.586385 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.586360    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-home\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.586446 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.586402    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-tmp-dir\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.586446 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.586434    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-model-cache\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.588520 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.588498    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-dshm\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.588634 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.588618    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/222b8682-12fe-40ed-a299-df9ae39156b5-tls-certs\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.596267 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.596239    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7644\" (UniqueName: \"kubernetes.io/projected/222b8682-12fe-40ed-a299-df9ae39156b5-kube-api-access-p7644\") pod \"auth-test-model-b60419-kserve-758c6f675-mtp86\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") " pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.738736 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.738650    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:11.886037 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:11.886006    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"]
Jul 07 18:03:11.888300 ip-10-0-136-242 kubenswrapper[2561]: W0707 18:03:11.888264    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod222b8682_12fe_40ed_a299_df9ae39156b5.slice/crio-cf9ab354c2b414c15b8e942a186ae72fc2b11eeea6cc6c9fb91686bedca946f1 WatchSource:0}: Error finding container cf9ab354c2b414c15b8e942a186ae72fc2b11eeea6cc6c9fb91686bedca946f1: Status 404 returned error can't find the container with id cf9ab354c2b414c15b8e942a186ae72fc2b11eeea6cc6c9fb91686bedca946f1
Jul 07 18:03:12.434015 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:12.433957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86" event={"ID":"222b8682-12fe-40ed-a299-df9ae39156b5","Type":"ContainerStarted","Data":"9dd57b6ccc5b9c6fddc906bd46af85b1ed512feac92c287f0d8d11cc89a4f1e8"}
Jul 07 18:03:12.434015 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:12.434021    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86" event={"ID":"222b8682-12fe-40ed-a299-df9ae39156b5","Type":"ContainerStarted","Data":"cf9ab354c2b414c15b8e942a186ae72fc2b11eeea6cc6c9fb91686bedca946f1"}
Jul 07 18:03:12.456775 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:12.456724    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86" podStartSLOduration=1.456708711 podStartE2EDuration="1.456708711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:03:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:03:12.454228767 +0000 UTC m=+2122.217688656" watchObservedRunningTime="2026-07-07 18:03:12.456708711 +0000 UTC m=+2122.220168570"
Jul 07 18:03:21.739085 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:21.739047    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:21.739589 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:21.739101    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:21.752290 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:21.752260    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:03:22.495433 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:03:22.495402    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:05:29.586092 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:29.586054    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"]
Jul 07 18:05:30.403415 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:30.403377    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"]
Jul 07 18:05:44.606955 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.606909    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5" podUID="72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17" containerName="main" containerID="cri-o://8d0bdad9731909335ebfdc81079baa044a9ca047be3794b8509e28d48b0b2798" gracePeriod=45
Jul 07 18:05:44.866909 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.866842    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:05:44.968791 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.968754    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-home\") pod \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") "
Jul 07 18:05:44.969010 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.968819    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-dshm\") pod \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") "
Jul 07 18:05:44.969010 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.968852    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-tmp-dir\") pod \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") "
Jul 07 18:05:44.969010 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.968905    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-tls-certs\") pod \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") "
Jul 07 18:05:44.969010 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.968931    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-model-cache\") pod \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") "
Jul 07 18:05:44.969268 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.969077    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62664\" (UniqueName: \"kubernetes.io/projected/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-kube-api-access-62664\") pod \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\" (UID: \"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17\") "
Jul 07 18:05:44.969268 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.969147    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-home" (OuterVolumeSpecName: "home") pod "72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17" (UID: "72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:05:44.969268 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.969229    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-model-cache" (OuterVolumeSpecName: "model-cache") pod "72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17" (UID: "72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:05:44.969268 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.969235    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17" (UID: "72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:05:44.969496 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.969474    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-model-cache\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:05:44.969535 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.969502    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-home\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:05:44.969535 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.969517    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-tmp-dir\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:05:44.971429 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.971406    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-dshm" (OuterVolumeSpecName: "dshm") pod "72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17" (UID: "72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:05:44.971429 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.971411    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17" (UID: "72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:05:44.971429 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:44.971412    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-kube-api-access-62664" (OuterVolumeSpecName: "kube-api-access-62664") pod "72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17" (UID: "72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17"). InnerVolumeSpecName "kube-api-access-62664". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:05:45.070772 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.070732    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62664\" (UniqueName: \"kubernetes.io/projected/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-kube-api-access-62664\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:05:45.070772 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.070765    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-dshm\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:05:45.070772 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.070774    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17-tls-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:05:45.218035 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.217912    2561 generic.go:356] "Generic (PLEG): container finished" podID="72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17" containerID="8d0bdad9731909335ebfdc81079baa044a9ca047be3794b8509e28d48b0b2798" exitCode=0
Jul 07 18:05:45.218035 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.217957    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"
Jul 07 18:05:45.218035 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.218000    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5" event={"ID":"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17","Type":"ContainerDied","Data":"8d0bdad9731909335ebfdc81079baa044a9ca047be3794b8509e28d48b0b2798"}
Jul 07 18:05:45.218296 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.218051    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5" event={"ID":"72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17","Type":"ContainerDied","Data":"3a6db1a80f056b3ba0516d14530dac44128e2f28934150e4c75ab47bb3733412"}
Jul 07 18:05:45.218296 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.218072    2561 scope.go:117] "RemoveContainer" containerID="8d0bdad9731909335ebfdc81079baa044a9ca047be3794b8509e28d48b0b2798"
Jul 07 18:05:45.227752 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.227733    2561 scope.go:117] "RemoveContainer" containerID="8d0bdad9731909335ebfdc81079baa044a9ca047be3794b8509e28d48b0b2798"
Jul 07 18:05:45.228092 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:05:45.228071    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d0bdad9731909335ebfdc81079baa044a9ca047be3794b8509e28d48b0b2798\": container with ID starting with 8d0bdad9731909335ebfdc81079baa044a9ca047be3794b8509e28d48b0b2798 not found: ID does not exist" containerID="8d0bdad9731909335ebfdc81079baa044a9ca047be3794b8509e28d48b0b2798"
Jul 07 18:05:45.228162 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.228102    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d0bdad9731909335ebfdc81079baa044a9ca047be3794b8509e28d48b0b2798"} err="failed to get container status \"8d0bdad9731909335ebfdc81079baa044a9ca047be3794b8509e28d48b0b2798\": rpc error: code = NotFound desc = could not find container \"8d0bdad9731909335ebfdc81079baa044a9ca047be3794b8509e28d48b0b2798\": container with ID starting with 8d0bdad9731909335ebfdc81079baa044a9ca047be3794b8509e28d48b0b2798 not found: ID does not exist"
Jul 07 18:05:45.241739 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.241711    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"]
Jul 07 18:05:45.247348 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.247319    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/auth-test-model-8c0ae4-kserve-78ffd9767f-kj9v5"]
Jul 07 18:05:45.424324 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.424279    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86" podUID="222b8682-12fe-40ed-a299-df9ae39156b5" containerName="main" containerID="cri-o://9dd57b6ccc5b9c6fddc906bd46af85b1ed512feac92c287f0d8d11cc89a4f1e8" gracePeriod=45
Jul 07 18:05:45.679458 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.679432    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:05:45.776402 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.776365    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-model-cache\") pod \"222b8682-12fe-40ed-a299-df9ae39156b5\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") "
Jul 07 18:05:45.776402 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.776402    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-tmp-dir\") pod \"222b8682-12fe-40ed-a299-df9ae39156b5\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") "
Jul 07 18:05:45.776670 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.776422    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-home\") pod \"222b8682-12fe-40ed-a299-df9ae39156b5\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") "
Jul 07 18:05:45.776670 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.776460    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7644\" (UniqueName: \"kubernetes.io/projected/222b8682-12fe-40ed-a299-df9ae39156b5-kube-api-access-p7644\") pod \"222b8682-12fe-40ed-a299-df9ae39156b5\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") "
Jul 07 18:05:45.776670 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.776499    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-dshm\") pod \"222b8682-12fe-40ed-a299-df9ae39156b5\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") "
Jul 07 18:05:45.776670 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.776572    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/222b8682-12fe-40ed-a299-df9ae39156b5-tls-certs\") pod \"222b8682-12fe-40ed-a299-df9ae39156b5\" (UID: \"222b8682-12fe-40ed-a299-df9ae39156b5\") "
Jul 07 18:05:45.776882 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.776723    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-home" (OuterVolumeSpecName: "home") pod "222b8682-12fe-40ed-a299-df9ae39156b5" (UID: "222b8682-12fe-40ed-a299-df9ae39156b5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:05:45.776882 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.776731    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-model-cache" (OuterVolumeSpecName: "model-cache") pod "222b8682-12fe-40ed-a299-df9ae39156b5" (UID: "222b8682-12fe-40ed-a299-df9ae39156b5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:05:45.776882 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.776752    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "222b8682-12fe-40ed-a299-df9ae39156b5" (UID: "222b8682-12fe-40ed-a299-df9ae39156b5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:05:45.777039 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.776932    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-model-cache\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:05:45.777039 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.776953    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-tmp-dir\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:05:45.777039 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.777000    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-home\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:05:45.779028 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.779000    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/222b8682-12fe-40ed-a299-df9ae39156b5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "222b8682-12fe-40ed-a299-df9ae39156b5" (UID: "222b8682-12fe-40ed-a299-df9ae39156b5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:05:45.779282 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.779251    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-dshm" (OuterVolumeSpecName: "dshm") pod "222b8682-12fe-40ed-a299-df9ae39156b5" (UID: "222b8682-12fe-40ed-a299-df9ae39156b5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:05:45.779375 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.779284    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/222b8682-12fe-40ed-a299-df9ae39156b5-kube-api-access-p7644" (OuterVolumeSpecName: "kube-api-access-p7644") pod "222b8682-12fe-40ed-a299-df9ae39156b5" (UID: "222b8682-12fe-40ed-a299-df9ae39156b5"). InnerVolumeSpecName "kube-api-access-p7644". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:05:45.877770 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.877735    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/222b8682-12fe-40ed-a299-df9ae39156b5-dshm\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:05:45.877770 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.877766    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/222b8682-12fe-40ed-a299-df9ae39156b5-tls-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:05:45.877770 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:45.877779    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7644\" (UniqueName: \"kubernetes.io/projected/222b8682-12fe-40ed-a299-df9ae39156b5-kube-api-access-p7644\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:05:46.224440 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:46.224343    2561 generic.go:356] "Generic (PLEG): container finished" podID="222b8682-12fe-40ed-a299-df9ae39156b5" containerID="9dd57b6ccc5b9c6fddc906bd46af85b1ed512feac92c287f0d8d11cc89a4f1e8" exitCode=0
Jul 07 18:05:46.224440 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:46.224391    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"
Jul 07 18:05:46.224685 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:46.224433    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86" event={"ID":"222b8682-12fe-40ed-a299-df9ae39156b5","Type":"ContainerDied","Data":"9dd57b6ccc5b9c6fddc906bd46af85b1ed512feac92c287f0d8d11cc89a4f1e8"}
Jul 07 18:05:46.224685 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:46.224485    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86" event={"ID":"222b8682-12fe-40ed-a299-df9ae39156b5","Type":"ContainerDied","Data":"cf9ab354c2b414c15b8e942a186ae72fc2b11eeea6cc6c9fb91686bedca946f1"}
Jul 07 18:05:46.224685 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:46.224506    2561 scope.go:117] "RemoveContainer" containerID="9dd57b6ccc5b9c6fddc906bd46af85b1ed512feac92c287f0d8d11cc89a4f1e8"
Jul 07 18:05:46.234285 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:46.234263    2561 scope.go:117] "RemoveContainer" containerID="9dd57b6ccc5b9c6fddc906bd46af85b1ed512feac92c287f0d8d11cc89a4f1e8"
Jul 07 18:05:46.234552 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:05:46.234532    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dd57b6ccc5b9c6fddc906bd46af85b1ed512feac92c287f0d8d11cc89a4f1e8\": container with ID starting with 9dd57b6ccc5b9c6fddc906bd46af85b1ed512feac92c287f0d8d11cc89a4f1e8 not found: ID does not exist" containerID="9dd57b6ccc5b9c6fddc906bd46af85b1ed512feac92c287f0d8d11cc89a4f1e8"
Jul 07 18:05:46.234624 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:46.234561    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd57b6ccc5b9c6fddc906bd46af85b1ed512feac92c287f0d8d11cc89a4f1e8"} err="failed to get container status \"9dd57b6ccc5b9c6fddc906bd46af85b1ed512feac92c287f0d8d11cc89a4f1e8\": rpc error: code = NotFound desc = could not find container \"9dd57b6ccc5b9c6fddc906bd46af85b1ed512feac92c287f0d8d11cc89a4f1e8\": container with ID starting with 9dd57b6ccc5b9c6fddc906bd46af85b1ed512feac92c287f0d8d11cc89a4f1e8 not found: ID does not exist"
Jul 07 18:05:46.247663 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:46.247634    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"]
Jul 07 18:05:46.255017 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:46.254993    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b60419/auth-test-model-b60419-kserve-758c6f675-mtp86"]
Jul 07 18:05:46.809543 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:46.809507    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="222b8682-12fe-40ed-a299-df9ae39156b5" path="/var/lib/kubelet/pods/222b8682-12fe-40ed-a299-df9ae39156b5/volumes"
Jul 07 18:05:46.809926 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:46.809912    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17" path="/var/lib/kubelet/pods/72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17/volumes"
Jul 07 18:05:51.027469 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.027441    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"]
Jul 07 18:05:51.027848 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.027834    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="222b8682-12fe-40ed-a299-df9ae39156b5" containerName="main"
Jul 07 18:05:51.027893 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.027850    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="222b8682-12fe-40ed-a299-df9ae39156b5" containerName="main"
Jul 07 18:05:51.027893 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.027862    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17" containerName="main"
Jul 07 18:05:51.027893 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.027867    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17" containerName="main"
Jul 07 18:05:51.028021 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.027952    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="72ec6e6d-3e46-4f7a-a16e-3e58f41f2c17" containerName="main"
Jul 07 18:05:51.028021 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.027958    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="222b8682-12fe-40ed-a299-df9ae39156b5" containerName="main"
Jul 07 18:05:51.032471 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.032456    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.036097 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.036075    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8c0ae4\"/\"sub-test-model-8c0ae4-kserve-self-signed-certs\""
Jul 07 18:05:51.036252 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.036083    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8c0ae4\"/\"openshift-service-ca.crt\""
Jul 07 18:05:51.036252 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.036124    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8c0ae4\"/\"kube-root-ca.crt\""
Jul 07 18:05:51.036252 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.036192    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8c0ae4\"/\"default-dockercfg-jkfcb\""
Jul 07 18:05:51.040826 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.040808    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"]
Jul 07 18:05:51.132256 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.132220    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2zz6\" (UniqueName: \"kubernetes.io/projected/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-kube-api-access-x2zz6\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.132256 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.132262    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-dshm\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.132480 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.132344    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-model-cache\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.132480 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.132389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-tmp-dir\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.132480 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.132440    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-tls-certs\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.132480 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.132459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-home\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.233437 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.233394    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-model-cache\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.233645 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.233451    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-tmp-dir\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.233645 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.233488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-tls-certs\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.233645 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.233506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-home\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.233645 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.233559    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2zz6\" (UniqueName: \"kubernetes.io/projected/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-kube-api-access-x2zz6\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.233645 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.233597    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-dshm\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.233921 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.233869    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-model-cache\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.233921 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.233885    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-tmp-dir\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.234057 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.233939    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-home\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.236066 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.236041    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-dshm\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.236210 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.236190    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-tls-certs\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.243816 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.243788    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2zz6\" (UniqueName: \"kubernetes.io/projected/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-kube-api-access-x2zz6\") pod \"sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") " pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.342606 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.342575    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:05:51.489602 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:51.489571    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"]
Jul 07 18:05:51.491391 ip-10-0-136-242 kubenswrapper[2561]: W0707 18:05:51.491364    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2adfb2dd_42c8_40e2_9d62_8f78ee7c60f0.slice/crio-d2a0a58f17679bbd78322c3ca71f5db2661d158c22c3ae2d915ba917bc664afc WatchSource:0}: Error finding container d2a0a58f17679bbd78322c3ca71f5db2661d158c22c3ae2d915ba917bc664afc: Status 404 returned error can't find the container with id d2a0a58f17679bbd78322c3ca71f5db2661d158c22c3ae2d915ba917bc664afc
Jul 07 18:05:52.259810 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:52.259774    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr" event={"ID":"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0","Type":"ContainerStarted","Data":"05f2ce8baf2ac3e0d7fae16fac0308e40ff0ed6fffbf5b4d8d09edb25b92fff1"}
Jul 07 18:05:52.259810 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:52.259816    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr" event={"ID":"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0","Type":"ContainerStarted","Data":"d2a0a58f17679bbd78322c3ca71f5db2661d158c22c3ae2d915ba917bc664afc"}
Jul 07 18:05:52.279601 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:05:52.279546    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr" podStartSLOduration=1.279529025 podStartE2EDuration="1.279529025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:05:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:05:52.277532016 +0000 UTC m=+2282.040991865" watchObservedRunningTime="2026-07-07 18:05:52.279529025 +0000 UTC m=+2282.042988870"
Jul 07 18:06:01.342696 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:06:01.342655    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:06:01.343327 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:06:01.342710    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:06:01.357003 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:06:01.356957    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:06:02.323418 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:06:02.323384    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:07:51.027669 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:07:51.027636    2561 scope.go:117] "RemoveContainer" containerID="036af91a9bc6157aa870f436ef7fc13a47ea8793e406efa54930fa8cfad3d176"
Jul 07 18:07:55.700628 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:07:55.700593    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"]
Jul 07 18:08:07.623004 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.622926    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"]
Jul 07 18:08:07.626683 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.626659    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.629040 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.629016    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8c0ae4\"/\"rate-test-model-8c0ae4-kserve-self-signed-certs\""
Jul 07 18:08:07.636334 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.636311    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"]
Jul 07 18:08:07.738521 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.738487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f39bc6fa-6c79-436a-b9e4-00a58176cda9-tls-certs\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.738521 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.738530    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mxzl\" (UniqueName: \"kubernetes.io/projected/f39bc6fa-6c79-436a-b9e4-00a58176cda9-kube-api-access-8mxzl\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.738765 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.738607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-dshm\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.738765 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.738644    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-tmp-dir\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.738765 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.738699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-model-cache\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.738872 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.738781    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-home\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.840041 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.840002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-model-cache\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.840246 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.840125    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-home\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.840246 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.840182    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f39bc6fa-6c79-436a-b9e4-00a58176cda9-tls-certs\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.840246 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.840220    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mxzl\" (UniqueName: \"kubernetes.io/projected/f39bc6fa-6c79-436a-b9e4-00a58176cda9-kube-api-access-8mxzl\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.840428 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.840265    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-dshm\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.840428 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.840291    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-tmp-dir\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.840537 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.840454    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-model-cache\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.840601 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.840584    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-home\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.840660 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.840635    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-tmp-dir\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.843282 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.843254    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-dshm\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.843429 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.843318    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f39bc6fa-6c79-436a-b9e4-00a58176cda9-tls-certs\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.851498 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.851468    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mxzl\" (UniqueName: \"kubernetes.io/projected/f39bc6fa-6c79-436a-b9e4-00a58176cda9-kube-api-access-8mxzl\") pod \"rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") " pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:07.937427 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:07.937338    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:08.077798 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:08.077773    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"]
Jul 07 18:08:08.079635 ip-10-0-136-242 kubenswrapper[2561]: W0707 18:08:08.079603    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf39bc6fa_6c79_436a_b9e4_00a58176cda9.slice/crio-77feb33bd1a90278a0cce6e959c63e7d8ade89c9f79900df6336c10db51718f7 WatchSource:0}: Error finding container 77feb33bd1a90278a0cce6e959c63e7d8ade89c9f79900df6336c10db51718f7: Status 404 returned error can't find the container with id 77feb33bd1a90278a0cce6e959c63e7d8ade89c9f79900df6336c10db51718f7
Jul 07 18:08:08.949298 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:08.949257    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42" event={"ID":"f39bc6fa-6c79-436a-b9e4-00a58176cda9","Type":"ContainerStarted","Data":"190be946faf5aaffbb9bce1f45ffa75a66a2da76ffe4c7289772056dc0155e17"}
Jul 07 18:08:08.949727 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:08.949307    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42" event={"ID":"f39bc6fa-6c79-436a-b9e4-00a58176cda9","Type":"ContainerStarted","Data":"77feb33bd1a90278a0cce6e959c63e7d8ade89c9f79900df6336c10db51718f7"}
Jul 07 18:08:08.968930 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:08.968855    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42" podStartSLOduration=1.9688377830000001 podStartE2EDuration="1.968837783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:08:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:08:08.967157913 +0000 UTC m=+2418.730617759" watchObservedRunningTime="2026-07-07 18:08:08.968837783 +0000 UTC m=+2418.732297630"
Jul 07 18:08:10.722492 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:10.722406    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr" podUID="2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0" containerName="main" containerID="cri-o://05f2ce8baf2ac3e0d7fae16fac0308e40ff0ed6fffbf5b4d8d09edb25b92fff1" gracePeriod=45
Jul 07 18:08:10.961134 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:10.960956    2561 generic.go:356] "Generic (PLEG): container finished" podID="2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0" containerID="05f2ce8baf2ac3e0d7fae16fac0308e40ff0ed6fffbf5b4d8d09edb25b92fff1" exitCode=0
Jul 07 18:08:10.961134 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:10.961030    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr" event={"ID":"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0","Type":"ContainerDied","Data":"05f2ce8baf2ac3e0d7fae16fac0308e40ff0ed6fffbf5b4d8d09edb25b92fff1"}
Jul 07 18:08:10.961134 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:10.961073    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr" event={"ID":"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0","Type":"ContainerDied","Data":"d2a0a58f17679bbd78322c3ca71f5db2661d158c22c3ae2d915ba917bc664afc"}
Jul 07 18:08:10.961134 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:10.961088    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2a0a58f17679bbd78322c3ca71f5db2661d158c22c3ae2d915ba917bc664afc"
Jul 07 18:08:10.984403 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:10.984329    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:08:11.075606 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.075564    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-dshm\") pod \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") "
Jul 07 18:08:11.075801 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.075669    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-tmp-dir\") pod \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") "
Jul 07 18:08:11.075801 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.075697    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-home\") pod \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") "
Jul 07 18:08:11.075801 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.075779    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2zz6\" (UniqueName: \"kubernetes.io/projected/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-kube-api-access-x2zz6\") pod \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") "
Jul 07 18:08:11.075918 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.075833    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-model-cache\") pod \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") "
Jul 07 18:08:11.075918 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.075897    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-tls-certs\") pod \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\" (UID: \"2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0\") "
Jul 07 18:08:11.076067 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.075962    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0" (UID: "2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:08:11.076067 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.076024    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-home" (OuterVolumeSpecName: "home") pod "2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0" (UID: "2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:08:11.076224 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.076198    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-model-cache" (OuterVolumeSpecName: "model-cache") pod "2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0" (UID: "2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:08:11.076391 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.076368    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-model-cache\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:08:11.076391 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.076392    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-tmp-dir\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:08:11.076758 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.076406    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-home\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:08:11.078085 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.078054    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0" (UID: "2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:08:11.078197 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.078091    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-dshm" (OuterVolumeSpecName: "dshm") pod "2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0" (UID: "2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:08:11.078197 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.078112    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-kube-api-access-x2zz6" (OuterVolumeSpecName: "kube-api-access-x2zz6") pod "2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0" (UID: "2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0"). InnerVolumeSpecName "kube-api-access-x2zz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:08:11.177438 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.177398    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2zz6\" (UniqueName: \"kubernetes.io/projected/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-kube-api-access-x2zz6\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:08:11.177438 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.177436    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-tls-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:08:11.177438 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.177449    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0-dshm\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:08:11.965872 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.965838    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"
Jul 07 18:08:11.989096 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.989064    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"]
Jul 07 18:08:11.993248 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:11.993217    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/sub-test-model-8c0ae4-kserve-6d77c779c7-jpmsr"]
Jul 07 18:08:12.810267 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:12.810233    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0" path="/var/lib/kubelet/pods/2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0/volumes"
Jul 07 18:08:17.937892 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:17.937860    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:17.938438 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:17.937908    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:17.951115 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:17.951085    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:08:18.008433 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:08:18.008398    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:09:29.342899 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:29.342861    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"]
Jul 07 18:09:44.363471 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.363364    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42" podUID="f39bc6fa-6c79-436a-b9e4-00a58176cda9" containerName="main" containerID="cri-o://190be946faf5aaffbb9bce1f45ffa75a66a2da76ffe4c7289772056dc0155e17" gracePeriod=45
Jul 07 18:09:44.620043 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.619960    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:09:44.749735 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.749700    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-tmp-dir\") pod \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") "
Jul 07 18:09:44.749992 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.749791    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-model-cache\") pod \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") "
Jul 07 18:09:44.749992 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.749814    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-dshm\") pod \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") "
Jul 07 18:09:44.749992 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.749867    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mxzl\" (UniqueName: \"kubernetes.io/projected/f39bc6fa-6c79-436a-b9e4-00a58176cda9-kube-api-access-8mxzl\") pod \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") "
Jul 07 18:09:44.749992 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.749933    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f39bc6fa-6c79-436a-b9e4-00a58176cda9-tls-certs\") pod \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") "
Jul 07 18:09:44.750245 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.750003    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-home\") pod \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\" (UID: \"f39bc6fa-6c79-436a-b9e4-00a58176cda9\") "
Jul 07 18:09:44.750245 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.750031    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f39bc6fa-6c79-436a-b9e4-00a58176cda9" (UID: "f39bc6fa-6c79-436a-b9e4-00a58176cda9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:44.750245 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.750141    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-model-cache" (OuterVolumeSpecName: "model-cache") pod "f39bc6fa-6c79-436a-b9e4-00a58176cda9" (UID: "f39bc6fa-6c79-436a-b9e4-00a58176cda9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:44.750417 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.750321    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-home" (OuterVolumeSpecName: "home") pod "f39bc6fa-6c79-436a-b9e4-00a58176cda9" (UID: "f39bc6fa-6c79-436a-b9e4-00a58176cda9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:44.750417 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.750335    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-model-cache\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:09:44.750417 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.750359    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-tmp-dir\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:09:44.752237 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.752206    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-dshm" (OuterVolumeSpecName: "dshm") pod "f39bc6fa-6c79-436a-b9e4-00a58176cda9" (UID: "f39bc6fa-6c79-436a-b9e4-00a58176cda9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:44.752237 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.752220    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f39bc6fa-6c79-436a-b9e4-00a58176cda9-kube-api-access-8mxzl" (OuterVolumeSpecName: "kube-api-access-8mxzl") pod "f39bc6fa-6c79-436a-b9e4-00a58176cda9" (UID: "f39bc6fa-6c79-436a-b9e4-00a58176cda9"). InnerVolumeSpecName "kube-api-access-8mxzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:09:44.752432 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.752398    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f39bc6fa-6c79-436a-b9e4-00a58176cda9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f39bc6fa-6c79-436a-b9e4-00a58176cda9" (UID: "f39bc6fa-6c79-436a-b9e4-00a58176cda9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:09:44.851582 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.851543    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-dshm\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:09:44.851582 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.851575    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mxzl\" (UniqueName: \"kubernetes.io/projected/f39bc6fa-6c79-436a-b9e4-00a58176cda9-kube-api-access-8mxzl\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:09:44.851582 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.851585    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f39bc6fa-6c79-436a-b9e4-00a58176cda9-tls-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:09:44.851846 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:44.851594    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f39bc6fa-6c79-436a-b9e4-00a58176cda9-home\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:09:45.455005 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:45.454949    2561 generic.go:356] "Generic (PLEG): container finished" podID="f39bc6fa-6c79-436a-b9e4-00a58176cda9" containerID="190be946faf5aaffbb9bce1f45ffa75a66a2da76ffe4c7289772056dc0155e17" exitCode=0
Jul 07 18:09:45.455414 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:45.455020    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"
Jul 07 18:09:45.455414 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:45.455037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42" event={"ID":"f39bc6fa-6c79-436a-b9e4-00a58176cda9","Type":"ContainerDied","Data":"190be946faf5aaffbb9bce1f45ffa75a66a2da76ffe4c7289772056dc0155e17"}
Jul 07 18:09:45.455414 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:45.455084    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42" event={"ID":"f39bc6fa-6c79-436a-b9e4-00a58176cda9","Type":"ContainerDied","Data":"77feb33bd1a90278a0cce6e959c63e7d8ade89c9f79900df6336c10db51718f7"}
Jul 07 18:09:45.455414 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:45.455103    2561 scope.go:117] "RemoveContainer" containerID="190be946faf5aaffbb9bce1f45ffa75a66a2da76ffe4c7289772056dc0155e17"
Jul 07 18:09:45.463930 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:45.463911    2561 scope.go:117] "RemoveContainer" containerID="190be946faf5aaffbb9bce1f45ffa75a66a2da76ffe4c7289772056dc0155e17"
Jul 07 18:09:45.464229 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:09:45.464207    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"190be946faf5aaffbb9bce1f45ffa75a66a2da76ffe4c7289772056dc0155e17\": container with ID starting with 190be946faf5aaffbb9bce1f45ffa75a66a2da76ffe4c7289772056dc0155e17 not found: ID does not exist" containerID="190be946faf5aaffbb9bce1f45ffa75a66a2da76ffe4c7289772056dc0155e17"
Jul 07 18:09:45.464304 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:45.464240    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"190be946faf5aaffbb9bce1f45ffa75a66a2da76ffe4c7289772056dc0155e17"} err="failed to get container status \"190be946faf5aaffbb9bce1f45ffa75a66a2da76ffe4c7289772056dc0155e17\": rpc error: code = NotFound desc = could not find container \"190be946faf5aaffbb9bce1f45ffa75a66a2da76ffe4c7289772056dc0155e17\": container with ID starting with 190be946faf5aaffbb9bce1f45ffa75a66a2da76ffe4c7289772056dc0155e17 not found: ID does not exist"
Jul 07 18:09:45.475627 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:45.475600    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"]
Jul 07 18:09:45.480288 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:45.480260    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8c0ae4/rate-test-model-8c0ae4-kserve-559fd9c7c5-49f42"]
Jul 07 18:09:46.810345 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:09:46.810313    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f39bc6fa-6c79-436a-b9e4-00a58176cda9" path="/var/lib/kubelet/pods/f39bc6fa-6c79-436a-b9e4-00a58176cda9/volumes"
Jul 07 18:10:15.747503 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:15.747451    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"]
Jul 07 18:10:15.748172 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:15.747717    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc" podUID="ef59eb2f-def4-47e8-bb20-804cd59461a6" containerName="maas-api" containerID="cri-o://af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5" gracePeriod=30
Jul 07 18:10:15.799980 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:10:15.799931    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef59eb2f_def4_47e8_bb20_804cd59461a6.slice/crio-af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef59eb2f_def4_47e8_bb20_804cd59461a6.slice/crio-conmon-af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5.scope\": RecentStats: unable to find data in memory cache]"
Jul 07 18:10:16.003924 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.003851    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:10:16.054958 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.054896    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfbw8\" (UniqueName: \"kubernetes.io/projected/ef59eb2f-def4-47e8-bb20-804cd59461a6-kube-api-access-qfbw8\") pod \"ef59eb2f-def4-47e8-bb20-804cd59461a6\" (UID: \"ef59eb2f-def4-47e8-bb20-804cd59461a6\") "
Jul 07 18:10:16.055184 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.055037    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef59eb2f-def4-47e8-bb20-804cd59461a6-openshift-service-ca\") pod \"ef59eb2f-def4-47e8-bb20-804cd59461a6\" (UID: \"ef59eb2f-def4-47e8-bb20-804cd59461a6\") "
Jul 07 18:10:16.055184 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.055106    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef59eb2f-def4-47e8-bb20-804cd59461a6-maas-api-tls\") pod \"ef59eb2f-def4-47e8-bb20-804cd59461a6\" (UID: \"ef59eb2f-def4-47e8-bb20-804cd59461a6\") "
Jul 07 18:10:16.055472 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.055446    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef59eb2f-def4-47e8-bb20-804cd59461a6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef59eb2f-def4-47e8-bb20-804cd59461a6" (UID: "ef59eb2f-def4-47e8-bb20-804cd59461a6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:10:16.057322 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.057290    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef59eb2f-def4-47e8-bb20-804cd59461a6-kube-api-access-qfbw8" (OuterVolumeSpecName: "kube-api-access-qfbw8") pod "ef59eb2f-def4-47e8-bb20-804cd59461a6" (UID: "ef59eb2f-def4-47e8-bb20-804cd59461a6"). InnerVolumeSpecName "kube-api-access-qfbw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:10:16.057428 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.057331    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef59eb2f-def4-47e8-bb20-804cd59461a6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef59eb2f-def4-47e8-bb20-804cd59461a6" (UID: "ef59eb2f-def4-47e8-bb20-804cd59461a6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:10:16.156154 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.156113    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef59eb2f-def4-47e8-bb20-804cd59461a6-openshift-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:10:16.156154 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.156149    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef59eb2f-def4-47e8-bb20-804cd59461a6-maas-api-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:10:16.156154 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.156157    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfbw8\" (UniqueName: \"kubernetes.io/projected/ef59eb2f-def4-47e8-bb20-804cd59461a6-kube-api-access-qfbw8\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:10:16.616199 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.616165    2561 generic.go:356] "Generic (PLEG): container finished" podID="ef59eb2f-def4-47e8-bb20-804cd59461a6" containerID="af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5" exitCode=0
Jul 07 18:10:16.616380 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.616217    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"
Jul 07 18:10:16.616380 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.616220    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc" event={"ID":"ef59eb2f-def4-47e8-bb20-804cd59461a6","Type":"ContainerDied","Data":"af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5"}
Jul 07 18:10:16.616380 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.616322    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc" event={"ID":"ef59eb2f-def4-47e8-bb20-804cd59461a6","Type":"ContainerDied","Data":"2be2d80a557404fad3b06bf6a0f6d5e65ae291fc7707bee54d4a96368679559f"}
Jul 07 18:10:16.616380 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.616342    2561 scope.go:117] "RemoveContainer" containerID="af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5"
Jul 07 18:10:16.626356 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.626333    2561 scope.go:117] "RemoveContainer" containerID="af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5"
Jul 07 18:10:16.626671 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:10:16.626653    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5\": container with ID starting with af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5 not found: ID does not exist" containerID="af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5"
Jul 07 18:10:16.626726 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.626681    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5"} err="failed to get container status \"af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5\": rpc error: code = NotFound desc = could not find container \"af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5\": container with ID starting with af74a8420d7d6d83c6d2b99157af35d756558f4ef1c9789cf7e4823e93aa6ee5 not found: ID does not exist"
Jul 07 18:10:16.639474 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.639442    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"]
Jul 07 18:10:16.645159 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.645131    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b60419-5b74cbcf6c-jlkqc"]
Jul 07 18:10:16.809682 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:16.809650    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef59eb2f-def4-47e8-bb20-804cd59461a6" path="/var/lib/kubelet/pods/ef59eb2f-def4-47e8-bb20-804cd59461a6/volumes"
Jul 07 18:10:22.153134 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:22.153099    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"]
Jul 07 18:10:22.153588 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:22.153324    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk" podUID="b2c6081f-5ad8-4340-b602-f45cb62d9543" containerName="istio-proxy" containerID="cri-o://145d48a0b2ce0d907732b9e8d7225dc6d3daddccc939f24a5a8edd38cb1caa5e" gracePeriod=30
Jul 07 18:10:22.889176 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:22.889145    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7565bddf64-dxz29_3be8befc-2943-40d7-85b5-0d75a93e1b83/authorino/0.log"
Jul 07 18:10:27.411979 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.411932    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:10:27.576796 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.576760    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-credential-socket\") pod \"b2c6081f-5ad8-4340-b602-f45cb62d9543\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") "
Jul 07 18:10:27.576796 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.576799    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2q8v\" (UniqueName: \"kubernetes.io/projected/b2c6081f-5ad8-4340-b602-f45cb62d9543-kube-api-access-w2q8v\") pod \"b2c6081f-5ad8-4340-b602-f45cb62d9543\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") "
Jul 07 18:10:27.577056 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.576843    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-podinfo\") pod \"b2c6081f-5ad8-4340-b602-f45cb62d9543\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") "
Jul 07 18:10:27.577056 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.576863    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-workload-certs\") pod \"b2c6081f-5ad8-4340-b602-f45cb62d9543\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") "
Jul 07 18:10:27.577056 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.576884    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-data\") pod \"b2c6081f-5ad8-4340-b602-f45cb62d9543\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") "
Jul 07 18:10:27.577056 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.576993    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-token\") pod \"b2c6081f-5ad8-4340-b602-f45cb62d9543\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") "
Jul 07 18:10:27.577056 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.577038    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-workload-socket\") pod \"b2c6081f-5ad8-4340-b602-f45cb62d9543\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") "
Jul 07 18:10:27.577327 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.577064    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-envoy\") pod \"b2c6081f-5ad8-4340-b602-f45cb62d9543\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") "
Jul 07 18:10:27.577327 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.577094    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2c6081f-5ad8-4340-b602-f45cb62d9543-istiod-ca-cert\") pod \"b2c6081f-5ad8-4340-b602-f45cb62d9543\" (UID: \"b2c6081f-5ad8-4340-b602-f45cb62d9543\") "
Jul 07 18:10:27.577327 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.577124    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2c6081f-5ad8-4340-b602-f45cb62d9543" (UID: "b2c6081f-5ad8-4340-b602-f45cb62d9543"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:10:27.577327 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.577232    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2c6081f-5ad8-4340-b602-f45cb62d9543" (UID: "b2c6081f-5ad8-4340-b602-f45cb62d9543"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:10:27.577560 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.577345    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2c6081f-5ad8-4340-b602-f45cb62d9543" (UID: "b2c6081f-5ad8-4340-b602-f45cb62d9543"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:10:27.577629 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.577573    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:10:27.577629 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.577595    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:10:27.577629 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.577601    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2c6081f-5ad8-4340-b602-f45cb62d9543-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2c6081f-5ad8-4340-b602-f45cb62d9543" (UID: "b2c6081f-5ad8-4340-b602-f45cb62d9543"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:10:27.577629 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.577611    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:10:27.578520 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.578490    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2c6081f-5ad8-4340-b602-f45cb62d9543" (UID: "b2c6081f-5ad8-4340-b602-f45cb62d9543"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:10:27.579439 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.579415    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2c6081f-5ad8-4340-b602-f45cb62d9543" (UID: "b2c6081f-5ad8-4340-b602-f45cb62d9543"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:10:27.579529 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.579449    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2c6081f-5ad8-4340-b602-f45cb62d9543" (UID: "b2c6081f-5ad8-4340-b602-f45cb62d9543"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:10:27.579664 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.579645    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2c6081f-5ad8-4340-b602-f45cb62d9543-kube-api-access-w2q8v" (OuterVolumeSpecName: "kube-api-access-w2q8v") pod "b2c6081f-5ad8-4340-b602-f45cb62d9543" (UID: "b2c6081f-5ad8-4340-b602-f45cb62d9543"). InnerVolumeSpecName "kube-api-access-w2q8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:10:27.579723 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.579646    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2c6081f-5ad8-4340-b602-f45cb62d9543" (UID: "b2c6081f-5ad8-4340-b602-f45cb62d9543"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:10:27.671818 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.671773    2561 generic.go:356] "Generic (PLEG): container finished" podID="b2c6081f-5ad8-4340-b602-f45cb62d9543" containerID="145d48a0b2ce0d907732b9e8d7225dc6d3daddccc939f24a5a8edd38cb1caa5e" exitCode=0
Jul 07 18:10:27.671818 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.671821    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"
Jul 07 18:10:27.672098 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.671863    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk" event={"ID":"b2c6081f-5ad8-4340-b602-f45cb62d9543","Type":"ContainerDied","Data":"145d48a0b2ce0d907732b9e8d7225dc6d3daddccc939f24a5a8edd38cb1caa5e"}
Jul 07 18:10:27.672098 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.671919    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk" event={"ID":"b2c6081f-5ad8-4340-b602-f45cb62d9543","Type":"ContainerDied","Data":"c227fe4d6a0c16cf5eb612f0ad427c812d769720226e8dc2718fd02bccaf7973"}
Jul 07 18:10:27.672098 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.671942    2561 scope.go:117] "RemoveContainer" containerID="145d48a0b2ce0d907732b9e8d7225dc6d3daddccc939f24a5a8edd38cb1caa5e"
Jul 07 18:10:27.678723 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.678690    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:10:27.678723 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.678724    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:10:27.678926 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.678736    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2c6081f-5ad8-4340-b602-f45cb62d9543-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:10:27.678926 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.678749    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2q8v\" (UniqueName: \"kubernetes.io/projected/b2c6081f-5ad8-4340-b602-f45cb62d9543-kube-api-access-w2q8v\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:10:27.678926 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.678765    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:10:27.678926 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.678778    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2c6081f-5ad8-4340-b602-f45cb62d9543-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 07 18:10:27.682146 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.682129    2561 scope.go:117] "RemoveContainer" containerID="5586f6c1858ddbc77caf78c32972afb630b2a5c145e0544e7386d7e67d11c0ea"
Jul 07 18:10:27.690774 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.690756    2561 scope.go:117] "RemoveContainer" containerID="145d48a0b2ce0d907732b9e8d7225dc6d3daddccc939f24a5a8edd38cb1caa5e"
Jul 07 18:10:27.691096 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:10:27.691076    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"145d48a0b2ce0d907732b9e8d7225dc6d3daddccc939f24a5a8edd38cb1caa5e\": container with ID starting with 145d48a0b2ce0d907732b9e8d7225dc6d3daddccc939f24a5a8edd38cb1caa5e not found: ID does not exist" containerID="145d48a0b2ce0d907732b9e8d7225dc6d3daddccc939f24a5a8edd38cb1caa5e"
Jul 07 18:10:27.691169 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.691106    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"145d48a0b2ce0d907732b9e8d7225dc6d3daddccc939f24a5a8edd38cb1caa5e"} err="failed to get container status \"145d48a0b2ce0d907732b9e8d7225dc6d3daddccc939f24a5a8edd38cb1caa5e\": rpc error: code = NotFound desc = could not find container \"145d48a0b2ce0d907732b9e8d7225dc6d3daddccc939f24a5a8edd38cb1caa5e\": container with ID starting with 145d48a0b2ce0d907732b9e8d7225dc6d3daddccc939f24a5a8edd38cb1caa5e not found: ID does not exist"
Jul 07 18:10:27.691169 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.691125    2561 scope.go:117] "RemoveContainer" containerID="5586f6c1858ddbc77caf78c32972afb630b2a5c145e0544e7386d7e67d11c0ea"
Jul 07 18:10:27.691384 ip-10-0-136-242 kubenswrapper[2561]: E0707 18:10:27.691363    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5586f6c1858ddbc77caf78c32972afb630b2a5c145e0544e7386d7e67d11c0ea\": container with ID starting with 5586f6c1858ddbc77caf78c32972afb630b2a5c145e0544e7386d7e67d11c0ea not found: ID does not exist" containerID="5586f6c1858ddbc77caf78c32972afb630b2a5c145e0544e7386d7e67d11c0ea"
Jul 07 18:10:27.691424 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.691391    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5586f6c1858ddbc77caf78c32972afb630b2a5c145e0544e7386d7e67d11c0ea"} err="failed to get container status \"5586f6c1858ddbc77caf78c32972afb630b2a5c145e0544e7386d7e67d11c0ea\": rpc error: code = NotFound desc = could not find container \"5586f6c1858ddbc77caf78c32972afb630b2a5c145e0544e7386d7e67d11c0ea\": container with ID starting with 5586f6c1858ddbc77caf78c32972afb630b2a5c145e0544e7386d7e67d11c0ea not found: ID does not exist"
Jul 07 18:10:27.695680 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.695658    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"]
Jul 07 18:10:27.700466 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:27.700442    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-b60419-openshift-default-7d4d85b559-25zvk"]
Jul 07 18:10:28.011245 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:28.011164    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5fcf4f568d-pp5dn_ed947c30-717c-434f-bac0-d7a37321473e/maas-api/0.log"
Jul 07 18:10:28.376310 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:28.376281    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6c5bb8b8df-5nks6_77e68694-d6af-40fc-8d2f-d604055eb9fe/manager/0.log"
Jul 07 18:10:28.810309 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:28.810275    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2c6081f-5ad8-4340-b602-f45cb62d9543" path="/var/lib/kubelet/pods/b2c6081f-5ad8-4340-b602-f45cb62d9543/volumes"
Jul 07 18:10:29.027911 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:29.027881    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-88cd6769f-w5k86_5ddfe359-c8d0-4de5-9846-14e96588f64b/copy-manifests/0.log"
Jul 07 18:10:29.035400 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:29.035380    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-88cd6769f-w5k86_5ddfe359-c8d0-4de5-9846-14e96588f64b/manager/0.log"
Jul 07 18:10:30.540229 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:30.540195    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7565bddf64-dxz29_3be8befc-2943-40d7-85b5-0d75a93e1b83/authorino/0.log"
Jul 07 18:10:30.803036 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:30.802919    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9tl45_bb768db6-1216-4f11-9955-b44efb8497e5/manager/0.log"
Jul 07 18:10:30.924119 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:30.924092    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9dkps_9746c878-d06e-445e-a988-b273c33492da/kuadrant-console-plugin/0.log"
Jul 07 18:10:31.844328 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:31.844302    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678kjwkc_c89d460f-0b4c-4a93-bce4-05d0b9a2ace8/istio-proxy/0.log"
Jul 07 18:10:32.204643 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:32.204558    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bbcb8bd4c-qckpx_58e9691d-dc23-4529-9754-63c005a47313/kube-auth-proxy/0.log"
Jul 07 18:10:32.326709 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:32.326679    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6pjbv_e5cbb00d-d555-480a-940c-46bcdca44c0e/istio-proxy/1.log"
Jul 07 18:10:33.287259 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:33.287225    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-sl2cp_f766b800-4db7-40f9-874d-7c1fadea4383/main/0.log"
Jul 07 18:10:33.400360 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:33.400329    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkh86s_fe0ca86b-ecd1-4f8b-99bc-97d233f7fa82/main/0.log"
Jul 07 18:10:41.707863 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:41.707831    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k74rl_ff2b6c66-5e0e-4bb8-90f5-d8a972b0f974/global-pull-secret-syncer/0.log"
Jul 07 18:10:41.894221 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:41.894191    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fkjch_bc7ff047-99c6-469c-94c3-b2c5d82ba26e/konnectivity-agent/0.log"
Jul 07 18:10:41.956827 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:41.956798    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-242.ec2.internal_0fd611b44a23458fa0755b93d5b2fcb1/haproxy/0.log"
Jul 07 18:10:46.527154 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:46.527116    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7565bddf64-dxz29_3be8befc-2943-40d7-85b5-0d75a93e1b83/authorino/0.log"
Jul 07 18:10:46.688304 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:46.688277    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9tl45_bb768db6-1216-4f11-9955-b44efb8497e5/manager/0.log"
Jul 07 18:10:46.727274 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:46.727240    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9dkps_9746c878-d06e-445e-a988-b273c33492da/kuadrant-console-plugin/0.log"
Jul 07 18:10:48.872448 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:48.872417    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62fd10ae-747a-49ed-b721-7ca5ac394f67/alertmanager/0.log"
Jul 07 18:10:48.901449 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:48.901418    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62fd10ae-747a-49ed-b721-7ca5ac394f67/config-reloader/0.log"
Jul 07 18:10:48.935486 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:48.935461    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62fd10ae-747a-49ed-b721-7ca5ac394f67/kube-rbac-proxy-web/0.log"
Jul 07 18:10:48.962526 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:48.962499    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62fd10ae-747a-49ed-b721-7ca5ac394f67/kube-rbac-proxy/0.log"
Jul 07 18:10:48.990639 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:48.990613    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62fd10ae-747a-49ed-b721-7ca5ac394f67/kube-rbac-proxy-metric/0.log"
Jul 07 18:10:49.020251 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.020221    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62fd10ae-747a-49ed-b721-7ca5ac394f67/prom-label-proxy/0.log"
Jul 07 18:10:49.047717 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.047691    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62fd10ae-747a-49ed-b721-7ca5ac394f67/init-config-reloader/0.log"
Jul 07 18:10:49.152501 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.152467    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mjs29_c435f6a7-0da0-466d-a5aa-cf305d2ecc6d/kube-state-metrics/0.log"
Jul 07 18:10:49.205745 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.205713    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mjs29_c435f6a7-0da0-466d-a5aa-cf305d2ecc6d/kube-rbac-proxy-main/0.log"
Jul 07 18:10:49.244308 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.244276    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mjs29_c435f6a7-0da0-466d-a5aa-cf305d2ecc6d/kube-rbac-proxy-self/0.log"
Jul 07 18:10:49.282648 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.282618    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7bd65d9874-bc6nm_9b1e62b0-ad5f-4a89-920c-314cad74b1af/metrics-server/0.log"
Jul 07 18:10:49.360640 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.360550    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-98xg9_769c5fa4-5419-4ada-940a-fefcbd820e9a/node-exporter/0.log"
Jul 07 18:10:49.387834 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.387806    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-98xg9_769c5fa4-5419-4ada-940a-fefcbd820e9a/kube-rbac-proxy/0.log"
Jul 07 18:10:49.419537 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.419511    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-98xg9_769c5fa4-5419-4ada-940a-fefcbd820e9a/init-textfile/0.log"
Jul 07 18:10:49.646989 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.646941    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-d6j9w_96e7fc26-0780-4e64-99fd-8de373c0cc54/kube-rbac-proxy-main/0.log"
Jul 07 18:10:49.675540 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.675514    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-d6j9w_96e7fc26-0780-4e64-99fd-8de373c0cc54/kube-rbac-proxy-self/0.log"
Jul 07 18:10:49.705576 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.705541    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-d6j9w_96e7fc26-0780-4e64-99fd-8de373c0cc54/openshift-state-metrics/0.log"
Jul 07 18:10:49.756391 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.756361    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d3241c7-6104-4f3b-b350-806bd0c8cfe1/prometheus/0.log"
Jul 07 18:10:49.787381 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.787353    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d3241c7-6104-4f3b-b350-806bd0c8cfe1/config-reloader/0.log"
Jul 07 18:10:49.816085 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.816060    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d3241c7-6104-4f3b-b350-806bd0c8cfe1/thanos-sidecar/0.log"
Jul 07 18:10:49.843816 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.843787    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d3241c7-6104-4f3b-b350-806bd0c8cfe1/kube-rbac-proxy-web/0.log"
Jul 07 18:10:49.872364 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.872282    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d3241c7-6104-4f3b-b350-806bd0c8cfe1/kube-rbac-proxy/0.log"
Jul 07 18:10:49.901376 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.901343    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d3241c7-6104-4f3b-b350-806bd0c8cfe1/kube-rbac-proxy-thanos/0.log"
Jul 07 18:10:49.928111 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:49.928088    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d3241c7-6104-4f3b-b350-806bd0c8cfe1/init-config-reloader/0.log"
Jul 07 18:10:50.171430 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:50.171347    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5696546d8-xmm56_15f8427a-aa69-4563-834b-3edef30d1deb/thanos-query/0.log"
Jul 07 18:10:50.201006 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:50.200959    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5696546d8-xmm56_15f8427a-aa69-4563-834b-3edef30d1deb/kube-rbac-proxy-web/0.log"
Jul 07 18:10:50.229279 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:50.229255    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5696546d8-xmm56_15f8427a-aa69-4563-834b-3edef30d1deb/kube-rbac-proxy/0.log"
Jul 07 18:10:50.268412 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:50.268386    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5696546d8-xmm56_15f8427a-aa69-4563-834b-3edef30d1deb/prom-label-proxy/0.log"
Jul 07 18:10:50.293134 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:50.293104    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5696546d8-xmm56_15f8427a-aa69-4563-834b-3edef30d1deb/kube-rbac-proxy-rules/0.log"
Jul 07 18:10:50.319910 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:50.319879    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5696546d8-xmm56_15f8427a-aa69-4563-834b-3edef30d1deb/kube-rbac-proxy-metrics/0.log"
Jul 07 18:10:52.502991 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.498920    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"]
Jul 07 18:10:52.502991 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.499861    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2c6081f-5ad8-4340-b602-f45cb62d9543" containerName="istio-proxy"
Jul 07 18:10:52.502991 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.499883    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2c6081f-5ad8-4340-b602-f45cb62d9543" containerName="istio-proxy"
Jul 07 18:10:52.502991 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.499899    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef59eb2f-def4-47e8-bb20-804cd59461a6" containerName="maas-api"
Jul 07 18:10:52.502991 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.499908    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef59eb2f-def4-47e8-bb20-804cd59461a6" containerName="maas-api"
Jul 07 18:10:52.502991 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.499940    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0" containerName="main"
Jul 07 18:10:52.502991 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.499957    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0" containerName="main"
Jul 07 18:10:52.502991 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.499987    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f39bc6fa-6c79-436a-b9e4-00a58176cda9" containerName="main"
Jul 07 18:10:52.502991 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.499996    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f39bc6fa-6c79-436a-b9e4-00a58176cda9" containerName="main"
Jul 07 18:10:52.502991 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.500206    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2c6081f-5ad8-4340-b602-f45cb62d9543" containerName="istio-proxy"
Jul 07 18:10:52.502991 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.500227    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f39bc6fa-6c79-436a-b9e4-00a58176cda9" containerName="main"
Jul 07 18:10:52.502991 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.500237    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef59eb2f-def4-47e8-bb20-804cd59461a6" containerName="maas-api"
Jul 07 18:10:52.502991 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.500245    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2adfb2dd-42c8-40e2-9d62-8f78ee7c60f0" containerName="main"
Jul 07 18:10:52.507415 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.507381    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.509771 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.509750    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rs4cf\"/\"default-dockercfg-9j7qd\""
Jul 07 18:10:52.510928 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.510855    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rs4cf\"/\"kube-root-ca.crt\""
Jul 07 18:10:52.511208 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.511175    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rs4cf\"/\"openshift-service-ca.crt\""
Jul 07 18:10:52.513202 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.513179    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"]
Jul 07 18:10:52.608924 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.608886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5612a39-da89-4358-9b6a-d6cd2eac41b6-proc\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.609177 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.608954    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5612a39-da89-4358-9b6a-d6cd2eac41b6-podres\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.609177 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.609107    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5612a39-da89-4358-9b6a-d6cd2eac41b6-lib-modules\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.609177 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.609148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5612a39-da89-4358-9b6a-d6cd2eac41b6-sys\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.609177 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.609173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bzqf\" (UniqueName: \"kubernetes.io/projected/a5612a39-da89-4358-9b6a-d6cd2eac41b6-kube-api-access-8bzqf\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.710175 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.710129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5612a39-da89-4358-9b6a-d6cd2eac41b6-lib-modules\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.710175 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.710178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5612a39-da89-4358-9b6a-d6cd2eac41b6-sys\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.710423 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.710258    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5612a39-da89-4358-9b6a-d6cd2eac41b6-sys\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.710423 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.710294    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bzqf\" (UniqueName: \"kubernetes.io/projected/a5612a39-da89-4358-9b6a-d6cd2eac41b6-kube-api-access-8bzqf\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.710423 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.710310    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5612a39-da89-4358-9b6a-d6cd2eac41b6-lib-modules\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.710423 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.710394    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5612a39-da89-4358-9b6a-d6cd2eac41b6-proc\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.710601 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.710450    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5612a39-da89-4358-9b6a-d6cd2eac41b6-podres\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.710601 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.710510    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5612a39-da89-4358-9b6a-d6cd2eac41b6-proc\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.710601 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.710543    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5612a39-da89-4358-9b6a-d6cd2eac41b6-podres\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.721773 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.721743    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bzqf\" (UniqueName: \"kubernetes.io/projected/a5612a39-da89-4358-9b6a-d6cd2eac41b6-kube-api-access-8bzqf\") pod \"perf-node-gather-daemonset-qn28z\" (UID: \"a5612a39-da89-4358-9b6a-d6cd2eac41b6\") " pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.789123 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.789034    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66cbd9489b-mnlkp_c25718f0-1514-41c5-8bde-ce7d9a92248a/console/0.log"
Jul 07 18:10:52.819092 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.819058    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:52.956668 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:52.956639    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"]
Jul 07 18:10:52.959159 ip-10-0-136-242 kubenswrapper[2561]: W0707 18:10:52.959128    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda5612a39_da89_4358_9b6a_d6cd2eac41b6.slice/crio-e5f7a4e95cb92d7d231b54c0b966e740293fedec911b3cc85ea057b0769af047 WatchSource:0}: Error finding container e5f7a4e95cb92d7d231b54c0b966e740293fedec911b3cc85ea057b0769af047: Status 404 returned error can't find the container with id e5f7a4e95cb92d7d231b54c0b966e740293fedec911b3cc85ea057b0769af047
Jul 07 18:10:53.810039 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:53.810006    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z" event={"ID":"a5612a39-da89-4358-9b6a-d6cd2eac41b6","Type":"ContainerStarted","Data":"469deccf9b4511cb4b18d38c20850ee4c54f4527db763683cdc2bbda94bdc355"}
Jul 07 18:10:53.810461 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:53.810067    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z" event={"ID":"a5612a39-da89-4358-9b6a-d6cd2eac41b6","Type":"ContainerStarted","Data":"e5f7a4e95cb92d7d231b54c0b966e740293fedec911b3cc85ea057b0769af047"}
Jul 07 18:10:53.810461 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:53.810096    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:10:53.830948 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:53.830893    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z" podStartSLOduration=1.830876315 podStartE2EDuration="1.830876315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:10:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:10:53.830576198 +0000 UTC m=+2583.594036040" watchObservedRunningTime="2026-07-07 18:10:53.830876315 +0000 UTC m=+2583.594336162"
Jul 07 18:10:54.841472 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:54.841444    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zz49v_b223289d-337d-412d-a3d5-e0501f032ff5/dns/0.log"
Jul 07 18:10:54.871350 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:54.871325    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zz49v_b223289d-337d-412d-a3d5-e0501f032ff5/kube-rbac-proxy/0.log"
Jul 07 18:10:54.934940 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:54.934915    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bgwx5_c82757ce-a55f-4356-a6b0-e4939ddd7789/dns-node-resolver/0.log"
Jul 07 18:10:55.607377 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:55.607349    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mp4x5_9ab9d796-f2d4-4e10-83a1-3bae4980a8b6/node-ca/0.log"
Jul 07 18:10:56.726845 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:56.726795    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678kjwkc_c89d460f-0b4c-4a93-bce4-05d0b9a2ace8/istio-proxy/0.log"
Jul 07 18:10:56.928050 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:56.928011    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bbcb8bd4c-qckpx_58e9691d-dc23-4529-9754-63c005a47313/kube-auth-proxy/0.log"
Jul 07 18:10:56.969259 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:56.969223    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6pjbv_e5cbb00d-d555-480a-940c-46bcdca44c0e/istio-proxy/0.log"
Jul 07 18:10:56.998263 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:56.998150    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6pjbv_e5cbb00d-d555-480a-940c-46bcdca44c0e/istio-proxy/1.log"
Jul 07 18:10:57.838914 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:57.838882    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bq4q5_418d60e7-bc7e-42f3-b43f-10e6b45e1bfd/serve-healthcheck-canary/0.log"
Jul 07 18:10:58.577932 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:58.577905    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-glnnx_0d62b8a0-88c4-48c4-aae5-5e732026bcf5/kube-rbac-proxy/0.log"
Jul 07 18:10:58.605588 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:58.605563    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-glnnx_0d62b8a0-88c4-48c4-aae5-5e732026bcf5/exporter/0.log"
Jul 07 18:10:58.633906 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:58.633883    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-glnnx_0d62b8a0-88c4-48c4-aae5-5e732026bcf5/extractor/0.log"
Jul 07 18:10:59.825025 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:10:59.824997    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rs4cf/perf-node-gather-daemonset-qn28z"
Jul 07 18:11:01.255004 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:11:01.254949    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5fcf4f568d-pp5dn_ed947c30-717c-434f-bac0-d7a37321473e/maas-api/0.log"
Jul 07 18:11:01.424802 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:11:01.424768    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6c5bb8b8df-5nks6_77e68694-d6af-40fc-8d2f-d604055eb9fe/manager/0.log"
Jul 07 18:11:01.762449 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:11:01.762422    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-88cd6769f-w5k86_5ddfe359-c8d0-4de5-9846-14e96588f64b/manager/0.log"
Jul 07 18:11:01.791443 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:11:01.791413    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-88cd6769f-w5k86_5ddfe359-c8d0-4de5-9846-14e96588f64b/copy-manifests/0.log"
Jul 07 18:11:02.614703 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:11:02.614667    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678kjwkc_c89d460f-0b4c-4a93-bce4-05d0b9a2ace8/istio-proxy/0.log"
Jul 07 18:11:02.763107 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:11:02.763078    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bbcb8bd4c-qckpx_58e9691d-dc23-4529-9754-63c005a47313/kube-auth-proxy/0.log"
Jul 07 18:11:02.785946 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:11:02.785894    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6pjbv_e5cbb00d-d555-480a-940c-46bcdca44c0e/istio-proxy/0.log"
Jul 07 18:11:02.814962 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:11:02.814928    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6pjbv_e5cbb00d-d555-480a-940c-46bcdca44c0e/istio-proxy/1.log"
Jul 07 18:11:03.330556 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:11:03.330529    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-677d4664c8-cbzv9_7fb00a91-4ed0-4904-a380-39b231037406/manager/0.log"
Jul 07 18:11:04.132702 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:11:04.132674    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678kjwkc_c89d460f-0b4c-4a93-bce4-05d0b9a2ace8/istio-proxy/0.log"
Jul 07 18:11:04.297873 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:11:04.297851    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bbcb8bd4c-qckpx_58e9691d-dc23-4529-9754-63c005a47313/kube-auth-proxy/0.log"
Jul 07 18:11:04.331894 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:11:04.331865    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6pjbv_e5cbb00d-d555-480a-940c-46bcdca44c0e/istio-proxy/0.log"
Jul 07 18:11:04.358103 ip-10-0-136-242 kubenswrapper[2561]: I0707 18:11:04.358067    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6pjbv_e5cbb00d-d555-480a-940c-46bcdca44c0e/istio-proxy/1.log"