Jul 24 15:45:33.725010 ip-10-0-136-199 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 15:45:33.725026 ip-10-0-136-199 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 15:45:33.725036 ip-10-0-136-199 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 15:45:33.725388 ip-10-0-136-199 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 15:45:43.948819 ip-10-0-136-199 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 15:45:43.948841 ip-10-0-136-199 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c66450b484564240ae52064881d464b7 --
Jul 24 15:47:24.414254 ip-10-0-136-199 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 15:47:24.822190 ip-10-0-136-199 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 15:47:24.822190 ip-10-0-136-199 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 15:47:24.822190 ip-10-0-136-199 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 15:47:24.822190 ip-10-0-136-199 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 15:47:24.822190 ip-10-0-136-199 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 15:47:24.822883 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.822245    2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 15:47:24.827817 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827791    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 15:47:24.827817 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827813    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 15:47:24.827817 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827817    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 15:47:24.827817 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827820    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 15:47:24.827817 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827823    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827827    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827830    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827833    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827836    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827839    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827841    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827845    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827848    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827851    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827854    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827856    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827859    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827862    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827864    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827867    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827871    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827875    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827879    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 15:47:24.828091 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827882    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827885    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827888    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827891    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827894    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827897    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827899    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827902    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827905    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827908    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827911    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827913    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827916    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827918    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827921    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827924    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827928    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827930    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827933    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827950    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 15:47:24.828534 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827953    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827956    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827959    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827961    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827964    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827967    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827970    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827973    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827976    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827979    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827981    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827984    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827987    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827990    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827993    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827995    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.827998    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828000    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828003    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828005    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 15:47:24.829063 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828008    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828010    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828014    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828016    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828021    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828024    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828027    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828032    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828035    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828038    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828041    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828044    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828046    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828049    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828052    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828054    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828057    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828059    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828062    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 15:47:24.829551 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828064    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828067    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828070    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828072    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828075    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828078    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828081    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828084    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828086    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828089    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828092    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828095    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828097    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828100    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828103    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828106    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828109    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828815    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828822    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828825    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 15:47:24.830034 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828829    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828832    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828835    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828837    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828840    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828843    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828845    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828848    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828850    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828853    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828855    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828858    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828860    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828863    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828866    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828869    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828872    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828875    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828877    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828880    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 15:47:24.830518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828882    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828885    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828888    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828890    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828893    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828895    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828898    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828901    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828904    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828906    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828910    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828914    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828919    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828923    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828926    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828930    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828934    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828952    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828955    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 15:47:24.831024 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828958    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828961    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828963    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828966    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828969    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828971    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828974    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828976    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828979    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828983    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828986    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828988    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828991    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828994    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.828996    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829000    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829002    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829005    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829007    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829010    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 15:47:24.831486 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829013    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829015    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829018    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829023    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829026    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829029    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829032    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829035    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829037    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829040    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829043    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829045    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829047    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829050    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829053    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829055    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829058    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829060    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829062    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 15:47:24.832027 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829065    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829068    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829072    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829075    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829078    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829081    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829084    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829086    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829089    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829092    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829094    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829097    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829099    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829102    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829105    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829107    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829110    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829112    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829506    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829510    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 15:47:24.832501 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829513    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829516    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829518    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829522    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829525    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829527    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829530    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829533    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829535    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829538    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829540    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829543    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829546    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829548    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829552    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829554    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829558    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829560    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829564    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 15:47:24.833006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829567    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829570    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829574    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829578    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829581    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829583    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829586    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829588    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829591    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829593    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829596    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829598    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829601    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829603    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829606    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829608    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829611    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829613    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829616    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829619    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 15:47:24.833464 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829621    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829623    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829626    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829628    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829631    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829633    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829636    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829639    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829643    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829645    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829648    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829650    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829653    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829657    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829660    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829663    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829666    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829670    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829673    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 15:47:24.833964 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829677    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829680    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829682    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829685    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829688    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829691    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829694    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829696    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829699    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829701    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829704    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829706    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829709    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829712    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829714    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829717    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829719    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829723    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829726    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829729    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 15:47:24.834426 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829731    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829734    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829737    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829740    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829743    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829747    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829752    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829755    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829758    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829760    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829763    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829765    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829768    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829770    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829773    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829775    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829778    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829780    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.829783    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829863    2553 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 15:47:24.834918 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829883    2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829893    2553 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829898    2553 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829904    2553 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829907    2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829912    2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829916    2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829919    2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829923    2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829926    2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829930    2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829933    2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829948    2553 flags.go:64] FLAG: --cgroup-root=""
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829951    2553 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829955    2553 flags.go:64] FLAG: --client-ca-file=""
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829958    2553 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829962    2553 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829966    2553 flags.go:64] FLAG: --cluster-domain=""
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829971    2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829974    2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829977    2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829980    2553 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829984    2553 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 15:47:24.835414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829987    2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829990    2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829994    2553 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.829997    2553 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830000    2553 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830003    2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830006    2553 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830009    2553 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830013    2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830016    2553 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830019    2553 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830022    2553 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830027    2553 flags.go:64] FLAG: --enable-server="true"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830030    2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830035    2553 flags.go:64] FLAG: --event-burst="100"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830038    2553 flags.go:64] FLAG: --event-qps="50"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830041    2553 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830044    2553 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830048    2553 flags.go:64] FLAG: --eviction-hard=""
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830052    2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830055    2553 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830058    2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830061    2553 flags.go:64] FLAG: --eviction-soft=""
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830064    2553 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830067    2553 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 15:47:24.836009 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830073    2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830076    2553 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830080    2553 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830083    2553 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830086    2553 flags.go:64] FLAG: --feature-gates=""
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830090    2553 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830093    2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830096    2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830099    2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830102    2553 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830105    2553 flags.go:64] FLAG: --help="false"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830107    2553 flags.go:64] FLAG: --hostname-override="ip-10-0-136-199.ec2.internal"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830111    2553 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830113    2553 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830117    2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830120    2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830123    2553 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830126    2553 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830129    2553 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830134    2553 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830137    2553 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830139    2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830142    2553 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830145    2553 flags.go:64] FLAG: --kube-reserved=""
Jul 24 15:47:24.836734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830148    2553 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830151    2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830154    2553 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830157    2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830160    2553 flags.go:64] FLAG: --lock-file=""
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830162    2553 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830165    2553 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830168    2553 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830173    2553 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830177    2553 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830181    2553 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830184    2553 flags.go:64] FLAG: --logging-format="text"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830187    2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830190    2553 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830193    2553 flags.go:64] FLAG: --manifest-url=""
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830196    2553 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830200    2553 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830203    2553 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830208    2553 flags.go:64] FLAG: --max-pods="110"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830211    2553 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830213    2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830216    2553 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830220    2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830223    2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830226    2553 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 15:47:24.837338 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830229    2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830236    2553 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830240    2553 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830244    2553 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830247    2553 flags.go:64] FLAG: --pod-cidr=""
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830249    2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830256    2553 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830258    2553 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830262    2553 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830264    2553 flags.go:64] FLAG: --port="10250"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830268    2553 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830271    2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04feeb5bf24a86962"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830274    2553 flags.go:64] FLAG: --qos-reserved=""
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830277    2553 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830280    2553 flags.go:64] FLAG: --register-node="true"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830283    2553 flags.go:64] FLAG: --register-with-taints=""
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830287    2553 flags.go:64] FLAG: --registry-burst="10"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830290    2553 flags.go:64] FLAG: --registry-qps="5"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830293    2553 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830296    2553 flags.go:64] FLAG: --reserved-memory=""
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830299    2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830302    2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830305    2553 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830308    2553 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830311    2553 flags.go:64] FLAG: --runonce="false"
Jul 24 15:47:24.837984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830314    2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830317    2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830320    2553 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830323    2553 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830325    2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830328    2553 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830331    2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830334    2553 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830337    2553 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830341    2553 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830344    2553 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830347    2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830349    2553 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830352    2553 flags.go:64] FLAG: --system-cgroups=""
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830355    2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830360    2553 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830363    2553 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830366    2553 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830370    2553 flags.go:64] FLAG: --tls-min-version=""
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830372    2553 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830375    2553 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830378    2553 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830381    2553 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830384    2553 flags.go:64] FLAG: --v="2"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830388    2553 flags.go:64] FLAG: --version="false"
Jul 24 15:47:24.838585 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830392    2553 flags.go:64] FLAG: --vmodule=""
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830396    2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.830399    2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830529    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830533    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830536    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830539    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830542    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830545    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830547    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830550    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830552    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830555    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830557    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830560    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830562    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830566    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830568    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830571    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830573    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 15:47:24.839215 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830576    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830578    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830581    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830583    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830586    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830588    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830590    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830593    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830597    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830599    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830602    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830605    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830608    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830611    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830614    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830616    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830619    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830622    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830624    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830627    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 15:47:24.839709 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830629    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830632    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830634    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830637    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830640    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830643    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830645    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830648    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830651    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830654    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830658    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830661    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830663    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830666    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830668    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830671    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830674    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830676    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830679    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830681    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 15:47:24.840217 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830685    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830688    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830691    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830694    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830696    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830699    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830702    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830705    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830707    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830710    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830713    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830715    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830718    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830720    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830723    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830725    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830728    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830732    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830735    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 15:47:24.840710 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830738    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830741    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830744    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830747    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830749    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830752    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830755    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830757    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830760    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830762    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830765    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830767    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830770    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830774    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830777    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830780    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830784    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830787    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830791    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830793    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 15:47:24.841288 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830797    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 15:47:24.841779 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830799    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 15:47:24.841779 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.830802    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 15:47:24.841779 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.831476    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 15:47:24.841779 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.838649    2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 15:47:24.841779 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.838668    2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 15:47:24.841779 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.838689    2553 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 15:47:24.841779 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.838694    2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 15:47:24.841779 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838752    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 15:47:24.841779 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838757    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 15:47:24.841779 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838761    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 15:47:24.841779 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838764    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 15:47:24.841779 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838767    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 15:47:24.841779 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838770    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 15:47:24.841779 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838773    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838776    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838779    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838782    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838785    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838788    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838790    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838794    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838797    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838799    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838802    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838805    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838808    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838811    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838815    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838819    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838822    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838826    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838830    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 15:47:24.842156 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838833    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838836    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838839    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838842    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838846    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838849    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838852    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838854    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838857    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838860    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838862    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838865    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838867    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838870    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838873    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838875    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838878    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838880    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838883    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838885    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 15:47:24.842617 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838888    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838890    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838893    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838896    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838898    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838901    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838904    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838906    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838909    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838911    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838914    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838916    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838919    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838922    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838924    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838927    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838930    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838933    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838950    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838954    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 15:47:24.843115 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838959    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838962    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838966    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838968    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838971    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838973    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838976    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838979    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838982    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838984    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838987    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838989    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838992    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838994    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838997    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.838999    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839002    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839004    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839007    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839010    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 15:47:24.843623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839013    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839015    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839018    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839020    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839023    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839025    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839028    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839030    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839033    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839036    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839040    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839042    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839045    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839048    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.839053    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 15:47:24.844126 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839170    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839176    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839179    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839182    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839186    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839189    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839192    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839194    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839197    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839199    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839202    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839205    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839208    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839210    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839213    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839215    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839218    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839221    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839224    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 15:47:24.844537 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839226    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839229    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839232    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839234    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839237    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839239    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839242    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839245    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839248    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839251    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839253    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839256    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839259    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839261    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839264    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839266    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839269    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839271    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839274    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839276    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 15:47:24.845104 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839279    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839282    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839284    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839286    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839289    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839292    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839294    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839297    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839299    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839302    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839304    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839307    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839310    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839312    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839315    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839317    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839320    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839322    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839325    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839327    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 15:47:24.845590 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839329    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839332    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839335    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839337    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839340    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839343    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839345    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839348    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839350    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839353    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839355    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839358    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839360    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839363    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839365    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839368    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839370    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839373    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839376    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839378    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 15:47:24.846093 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839381    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839385    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839389    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839392    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839395    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839398    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839401    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839403    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839406    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839408    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839411    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839415    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839418    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839421    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839423    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839427    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839429    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839432    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839435    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 15:47:24.846575 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:24.839437    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 15:47:24.847053 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.839442    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 15:47:24.847053 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.839564    2553 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 15:47:24.847053 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.843556    2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 15:47:24.847053 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.845069    2553 server.go:1019] "Starting client certificate rotation"
Jul 24 15:47:24.847053 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.845171    2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 15:47:24.847053 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.845234    2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 15:47:24.847620 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.847603    2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 15:47:24.850281 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.850255    2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 15:47:24.860444 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.860424    2553 log.go:25] "Validated CRI v1 runtime API"
Jul 24 15:47:24.862953 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.862926    2553 log.go:25] "Validated CRI v1 image API"
Jul 24 15:47:24.864590 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.864577    2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 15:47:24.869004 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.868979    2553 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8bc22440-8724-49f3-9129-10b0b5deab80:/dev/nvme0n1p4 e7e36917-342e-4450-aeee-cd244889d01e:/dev/nvme0n1p3]
Jul 24 15:47:24.869115 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.869002    2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 15:47:24.874517 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.874392    2553 manager.go:216] Machine: {Timestamp:2026-07-24 15:47:24.873055829 +0000 UTC m=+0.333150230 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099362 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec247c3b2f159e466a1a4c676e96b738 SystemUUID:ec247c3b-2f15-9e46-6a1a-4c676e96b738 BootID:c66450b4-8456-4240-ae52-064881d464b7 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bc:8e:d0:c1:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bc:8e:d0:c1:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:3a:af:ab:08:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 15:47:24.874517 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.874504    2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 15:47:24.874696 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.874618    2553 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 15:47:24.875225 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.875209    2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 15:47:24.876550 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.876522    2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 15:47:24.876687 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.876554    2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-199.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 15:47:24.877320 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.877309    2553 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 15:47:24.877354 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.877321    2553 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 15:47:24.877354 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.877329    2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 15:47:24.878078 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.878067    2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 15:47:24.879401 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.879390    2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 15:47:24.881280 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.881268    2553 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 15:47:24.881413 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.881403    2553 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 15:47:24.881454 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.881436    2553 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 15:47:24.881454 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.881450    2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 15:47:24.881514 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.881474    2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 15:47:24.881514 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.881491    2553 kubelet.go:398] "Adding apiserver pod source"
Jul 24 15:47:24.881514 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.881504    2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 15:47:24.882080 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.882058    2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 15:47:24.882080 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.882084    2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 15:47:24.884209 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.884187    2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 15:47:24.887197 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.887181    2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 15:47:24.887274 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.887213    2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 15:47:24.888910 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.888897    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 15:47:24.888977 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.888913    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 15:47:24.888977 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.888919    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 15:47:24.888977 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.888924    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 15:47:24.888977 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.888932    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 15:47:24.888977 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.888949    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 15:47:24.888977 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.888958    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 15:47:24.888977 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.888963    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 15:47:24.888977 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.888970    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 15:47:24.888977 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.888976    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 15:47:24.889214 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.888984    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 15:47:24.889214 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.888989    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 15:47:24.889734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.889721    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 15:47:24.889734 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.889731    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 15:47:24.892363 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.892334    2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-199.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 15:47:24.892522 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:24.892506    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 15:47:24.892718 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:24.892694    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 15:47:24.893566 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.893548    2553 server.go:1268] "Started kubelet"
Jul 24 15:47:24.893685 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.893619    2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 15:47:24.893783 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.893729    2553 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 15:47:24.893981 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.893656    2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 15:47:24.895374 ip-10-0-136-199 systemd[1]: Started Kubernetes Kubelet.
Jul 24 15:47:24.899004 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.898297    2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 15:47:24.899004 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.898412    2553 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 15:47:24.901244 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:24.901226    2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 15:47:24.901875 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:24.900879    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-199.ec2.internal.18c54468f495cd7d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-199.ec2.internal,UID:ip-10-0-136-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-199.ec2.internal,},FirstTimestamp:2026-07-24 15:47:24.893015421 +0000 UTC m=+0.353109822,LastTimestamp:2026-07-24 15:47:24.893015421 +0000 UTC m=+0.353109822,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-199.ec2.internal,}"
Jul 24 15:47:24.903502 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.903482    2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-52dpk"
Jul 24 15:47:24.908416 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.908394    2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 15:47:24.908416 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.908409    2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 15:47:24.908557 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:24.908465    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-199.ec2.internal\" not found"
Jul 24 15:47:24.909591 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.909322    2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 15:47:24.909764 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.909748    2553 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 15:47:24.909829 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.909815    2553 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 15:47:24.909973 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.909962    2553 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 15:47:24.909973 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.909971    2553 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 15:47:24.910231 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.910214    2553 factory.go:55] Registering systemd factory
Jul 24 15:47:24.910283 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.910235    2553 factory.go:223] Registration of the systemd container factory successfully
Jul 24 15:47:24.910402 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.910380    2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-52dpk"
Jul 24 15:47:24.910539 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.910526    2553 factory.go:153] Registering CRI-O factory
Jul 24 15:47:24.910620 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.910610    2553 factory.go:223] Registration of the crio container factory successfully
Jul 24 15:47:24.910731 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.910721    2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 15:47:24.910830 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.910820    2553 factory.go:103] Registering Raw factory
Jul 24 15:47:24.910909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.910901    2553 manager.go:1196] Started watching for new ooms in manager
Jul 24 15:47:24.911573 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.911557    2553 manager.go:349] Starting recovery of all containers
Jul 24 15:47:24.919317 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.919294    2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 15:47:24.921875 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.921857    2553 manager.go:354] Recovery completed
Jul 24 15:47:24.922424 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:24.922405    2553 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-199.ec2.internal\" not found" node="ip-10-0-136-199.ec2.internal"
Jul 24 15:47:24.927370 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.927355    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 15:47:24.929251 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.929235    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 15:47:24.929333 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.929266    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 15:47:24.929333 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.929280    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasSufficientPID"
Jul 24 15:47:24.929820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.929804    2553 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 15:47:24.929820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.929818    2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 15:47:24.929953 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.929838    2553 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 15:47:24.929953 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.929820    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 15:47:24.930681 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.930662    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 15:47:24.930752 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.930695    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 15:47:24.930752 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.930709    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasSufficientPID"
Jul 24 15:47:24.931670 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.931657    2553 policy_none.go:49] "None policy: Start"
Jul 24 15:47:24.931727 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.931675    2553 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 15:47:24.931727 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.931688    2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 15:47:24.932742 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.932730    2553 policy_none.go:47] "Start"
Jul 24 15:47:24.986902 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.986696    2553 manager.go:337] "Starting Device Plugin manager"
Jul 24 15:47:24.987056 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:24.986956    2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 15:47:24.987056 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.986969    2553 server.go:87] "Starting device plugin registration server"
Jul 24 15:47:24.987221 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.987209    2553 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 15:47:24.987261 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.987222    2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 15:47:24.987386 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.987337    2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 15:47:24.987526 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.987496    2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 15:47:24.987526 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:24.987525    2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 15:47:24.988022 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:24.988004    2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 15:47:24.988102 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:24.988060    2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-199.ec2.internal\" not found"
Jul 24 15:47:25.069238 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.069198    2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 15:47:25.070445 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.070424    2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 15:47:25.070534 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.070462    2553 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 15:47:25.070534 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.070487    2553 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 15:47:25.070534 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:25.070521    2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 15:47:25.072857 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.072805    2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 15:47:25.087924 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.087903    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 15:47:25.089154 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.089134    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 15:47:25.089255 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.089172    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 15:47:25.089255 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.089188    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasSufficientPID"
Jul 24 15:47:25.089255 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.089218    2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.096905 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.096888    2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.096999 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:25.096913    2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-199.ec2.internal\": node \"ip-10-0-136-199.ec2.internal\" not found"
Jul 24 15:47:25.111030 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:25.111007    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-199.ec2.internal\" not found"
Jul 24 15:47:25.170887 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.170854    2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-199.ec2.internal"]
Jul 24 15:47:25.171019 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.170956    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 15:47:25.171996 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.171974    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 15:47:25.171996 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.172002    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 15:47:25.172153 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.172011    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasSufficientPID"
Jul 24 15:47:25.173410 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.173397    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 15:47:25.173522 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.173505    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.173577 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.173540    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 15:47:25.174156 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.174138    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 15:47:25.174257 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.174139    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 15:47:25.174257 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.174191    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 15:47:25.174257 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.174202    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasSufficientPID"
Jul 24 15:47:25.174257 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.174167    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 15:47:25.174257 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.174238    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasSufficientPID"
Jul 24 15:47:25.175544 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.175528    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.175596 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.175561    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 15:47:25.176215 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.176199    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 15:47:25.176318 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.176227    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 15:47:25.176318 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.176240    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeHasSufficientPID"
Jul 24 15:47:25.208896 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:25.208871    2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-199.ec2.internal\" not found" node="ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.211387 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:25.211364    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-199.ec2.internal\" not found"
Jul 24 15:47:25.212211 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.212186    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/139e51abe32fc6d140a5f3ceeea4020f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal\" (UID: \"139e51abe32fc6d140a5f3ceeea4020f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.212275 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.212222    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/139e51abe32fc6d140a5f3ceeea4020f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal\" (UID: \"139e51abe32fc6d140a5f3ceeea4020f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.212322 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.212280    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf62266a6ae3b77620eda580b89764b9-config\") pod \"kube-apiserver-proxy-ip-10-0-136-199.ec2.internal\" (UID: \"cf62266a6ae3b77620eda580b89764b9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.213424 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:25.213407    2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-199.ec2.internal\" not found" node="ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.311475 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:25.311442    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-199.ec2.internal\" not found"
Jul 24 15:47:25.312567 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.312546    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/139e51abe32fc6d140a5f3ceeea4020f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal\" (UID: \"139e51abe32fc6d140a5f3ceeea4020f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.312625 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.312578    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/139e51abe32fc6d140a5f3ceeea4020f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal\" (UID: \"139e51abe32fc6d140a5f3ceeea4020f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.312625 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.312596    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf62266a6ae3b77620eda580b89764b9-config\") pod \"kube-apiserver-proxy-ip-10-0-136-199.ec2.internal\" (UID: \"cf62266a6ae3b77620eda580b89764b9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.312693 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.312638    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf62266a6ae3b77620eda580b89764b9-config\") pod \"kube-apiserver-proxy-ip-10-0-136-199.ec2.internal\" (UID: \"cf62266a6ae3b77620eda580b89764b9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.312693 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.312664    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/139e51abe32fc6d140a5f3ceeea4020f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal\" (UID: \"139e51abe32fc6d140a5f3ceeea4020f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.312752 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.312664    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/139e51abe32fc6d140a5f3ceeea4020f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal\" (UID: \"139e51abe32fc6d140a5f3ceeea4020f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.412268 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:25.412221    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-199.ec2.internal\" not found"
Jul 24 15:47:25.512693 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:25.512668    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-199.ec2.internal\" not found"
Jul 24 15:47:25.512783 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.512708    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:25.518230 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:25.518215    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:27.011165 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:27.011143    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-199.ec2.internal\" not found"
Jul 24 15:47:27.111719 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:27.111634    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-199.ec2.internal\" not found"
Jul 24 15:47:27.212278 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:27.212245    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-199.ec2.internal\" not found"
Jul 24 15:47:27.242511 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:27.242482    2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 15:47:27.242962 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:27.242648    2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 15:47:27.242962 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:27.242665    2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 15:47:27.312890 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:27.312866    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-199.ec2.internal\" not found"
Jul 24 15:47:27.314366 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:27.314340    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 15:42:26 +0000 UTC" deadline="2028-04-10 23:42:01.586368644 +0000 UTC"
Jul 24 15:47:27.314366 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:27.314366    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15031h54m34.272006111s"
Jul 24 15:47:27.316980 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:27.316964    2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 15:47:27.413906 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:27.413873    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-199.ec2.internal\" not found"
Jul 24 15:47:27.491754 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:27.491708    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf62266a6ae3b77620eda580b89764b9.slice/crio-5269d632b6f8616c749529c500bfc52d54b5df4e1b0738e8d2b685cc60f973c2 WatchSource:0}: Error finding container 5269d632b6f8616c749529c500bfc52d54b5df4e1b0738e8d2b685cc60f973c2: Status 404 returned error can't find the container with id 5269d632b6f8616c749529c500bfc52d54b5df4e1b0738e8d2b685cc60f973c2
Jul 24 15:47:27.492178 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:27.492151    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139e51abe32fc6d140a5f3ceeea4020f.slice/crio-d82ea91087315980fc807d3e1ecd709c983e2150c82f65f0e354b46b74c001de WatchSource:0}: Error finding container d82ea91087315980fc807d3e1ecd709c983e2150c82f65f0e354b46b74c001de: Status 404 returned error can't find the container with id d82ea91087315980fc807d3e1ecd709c983e2150c82f65f0e354b46b74c001de
Jul 24 15:47:27.497260 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:27.497244    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:47:27.513993 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:27.513973    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-199.ec2.internal\" not found"
Jul 24 15:47:27.605696 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:27.605672    2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 15:47:27.606617 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:27.606601    2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:27.617475 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:27.617449    2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 15:47:27.618492 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:27.618476    2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-199.ec2.internal"
Jul 24 15:47:27.626705 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:27.626682    2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 15:47:28.280735 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.280700    2553 apiserver.go:52] "Watching apiserver"
Jul 24 15:47:28.290729 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.290698    2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 15:47:28.292017 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.291970    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g","openshift-image-registry/node-ca-j5x8q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal","openshift-multus/multus-2gc58","openshift-multus/network-metrics-daemon-r6vqh","openshift-ovn-kubernetes/ovnkube-node-x2djb","kube-system/global-pull-secret-syncer-gfnfh","kube-system/kube-apiserver-proxy-ip-10-0-136-199.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8vf58","openshift-dns/node-resolver-ljfg6","openshift-multus/multus-additional-cni-plugins-v4nr7","openshift-network-diagnostics/network-check-target-mq5hc","openshift-network-operator/iptables-alerter-2dglb","kube-system/konnectivity-agent-p9kvb"]
Jul 24 15:47:28.293652 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.293626    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:28.293747 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.293723    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:28.295088 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.294847    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2dglb"
Jul 24 15:47:28.296189 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.296159    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p9kvb"
Jul 24 15:47:28.297798 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.297338    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.297909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.297797    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 15:47:28.297909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.297817    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tbtg5\""
Jul 24 15:47:28.298023 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.297924    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 15:47:28.298023 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.297946    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 15:47:28.298865 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.298844    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:28.299009 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.298986    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:28.299541 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.299522    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2shtm\""
Jul 24 15:47:28.299858 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.299834    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 15:47:28.300004 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.299989    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 15:47:28.300401 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.300369    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bspnx\""
Jul 24 15:47:28.300401 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.300400    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 15:47:28.300634 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.300618    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 15:47:28.300719 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.300700    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 15:47:28.300719 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.300624    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 15:47:28.300824 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.300710    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.302051 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.302033    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.303023 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.303006    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 15:47:28.303455 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.303438    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 15:47:28.303699 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.303679    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.304383 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.304366    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 15:47:28.304448 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.304406    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 15:47:28.304448 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.304419    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s9928\""
Jul 24 15:47:28.304708 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.304690    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 15:47:28.304939 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.304882    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 15:47:28.305154 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.305135    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k9m9k\""
Jul 24 15:47:28.305230 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.305190    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j5x8q"
Jul 24 15:47:28.305441 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.305424    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 15:47:28.305689 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.305669    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 15:47:28.306200 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.306183    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 15:47:28.306295 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.306225    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 15:47:28.306558 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.306520    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5z8kt\""
Jul 24 15:47:28.306689 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.306574    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 15:47:28.307702 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.307683    2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 15:47:28.308957 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.308508    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ljfg6"
Jul 24 15:47:28.311272 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.311253    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.312482 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.311966    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:28.312482 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.311987    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 15:47:28.312482 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.312042    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:28.312482 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.312175    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 15:47:28.312482 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.312187    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 15:47:28.312482 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.312479    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 15:47:28.312830 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.312554    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lm9gm\""
Jul 24 15:47:28.312830 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.312791    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 15:47:28.312940 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.312925    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-w896k\""
Jul 24 15:47:28.314172 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.314151    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-srxxh\""
Jul 24 15:47:28.314456 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.314438    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 15:47:28.315052 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.315034    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 15:47:28.319090 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319054    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-cni-binary-copy\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.319185 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319091    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-cni-netd\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.319185 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319115    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-modprobe-d\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.319185 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319138    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aef08cfc-aea6-4566-afdb-9f5a4332c337-tmp\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.319185 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319163    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a99759ef-4eee-46cb-ac25-cce29b9395b9-dbus\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:28.319185 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319184    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-cnibin\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.319435 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319205    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-etc-openvswitch\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.319435 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319231    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjj9p\" (UniqueName: \"kubernetes.io/projected/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-kube-api-access-bjj9p\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.319435 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319257    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-kubernetes\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.319435 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319297    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-host\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.319435 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319341    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/464e984d-dae7-496c-a3b3-40bf169475c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.319435 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319367    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/509140b1-2afc-4042-a7ea-f1cb5d579852-iptables-alerter-script\") pod \"iptables-alerter-2dglb\" (UID: \"509140b1-2afc-4042-a7ea-f1cb5d579852\") " pod="openshift-network-operator/iptables-alerter-2dglb"
Jul 24 15:47:28.319435 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319395    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-multus-conf-dir\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.319435 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319417    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-run-systemd\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.319814 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319437    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-log-socket\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.319814 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319459    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-ovn-node-metrics-cert\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.319814 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319495    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-lib-modules\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.319814 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319559    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.319814 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319622    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-run-openvswitch\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.319814 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319648    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-run-ovn\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.319814 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319719    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-tuned\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.319814 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319751    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/509140b1-2afc-4042-a7ea-f1cb5d579852-host-slash\") pod \"iptables-alerter-2dglb\" (UID: \"509140b1-2afc-4042-a7ea-f1cb5d579852\") " pod="openshift-network-operator/iptables-alerter-2dglb"
Jul 24 15:47:28.319814 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319779    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8148a263-1d0e-438e-ac4f-ca703f81fd72-konnectivity-ca\") pod \"konnectivity-agent-p9kvb\" (UID: \"8148a263-1d0e-438e-ac4f-ca703f81fd72\") " pod="kube-system/konnectivity-agent-p9kvb"
Jul 24 15:47:28.319814 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319803    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-var-lib-cni-bin\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.320271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319835    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdzcn\" (UniqueName: \"kubernetes.io/projected/aef08cfc-aea6-4566-afdb-9f5a4332c337-kube-api-access-bdzcn\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.320271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319863    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-sys-fs\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.320271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319904    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-multus-daemon-config\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.320271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319963    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-cni-bin\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.320271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.319995    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-ovnkube-config\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.320271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320013    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-sysctl-conf\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.320271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320030    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4qpz\" (UniqueName: \"kubernetes.io/projected/6c6ae9c2-c974-424a-b3bf-3fac535eee78-kube-api-access-k4qpz\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.320271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320046    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/464e984d-dae7-496c-a3b3-40bf169475c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.320271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320069    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8148a263-1d0e-438e-ac4f-ca703f81fd72-agent-certs\") pod \"konnectivity-agent-p9kvb\" (UID: \"8148a263-1d0e-438e-ac4f-ca703f81fd72\") " pod="kube-system/konnectivity-agent-p9kvb"
Jul 24 15:47:28.320271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320108    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-os-release\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.320271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320137    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-run-k8s-cni-cncf-io\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.320271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320206    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.320271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320235    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/464e984d-dae7-496c-a3b3-40bf169475c1-system-cni-dir\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.320271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320259    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a99759ef-4eee-46cb-ac25-cce29b9395b9-kubelet-config\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320282    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-run-netns\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320306    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34acff67-e6d0-4c76-b011-4280b5935771-tmp-dir\") pod \"node-resolver-ljfg6\" (UID: \"34acff67-e6d0-4c76-b011-4280b5935771\") " pod="openshift-dns/node-resolver-ljfg6"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320367    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgwmt\" (UniqueName: \"kubernetes.io/projected/464e984d-dae7-496c-a3b3-40bf169475c1-kube-api-access-fgwmt\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320385    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-multus-cni-dir\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320400    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-var-lib-kubelet\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320421    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-etc-kubernetes\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320439    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crm62\" (UniqueName: \"kubernetes.io/projected/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-kube-api-access-crm62\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320470    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-sysconfig\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320505    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-run-multus-certs\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320537    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-kubelet\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320559    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-node-log\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320599    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-ovnkube-script-lib\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320628    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br4ln\" (UniqueName: \"kubernetes.io/projected/f5906871-c948-4d05-8433-4968968c6221-kube-api-access-br4ln\") pod \"network-metrics-daemon-r6vqh\" (UID: \"f5906871-c948-4d05-8433-4968968c6221\") " pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320651    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-socket-dir\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320688    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjxnh\" (UniqueName: \"kubernetes.io/projected/509140b1-2afc-4042-a7ea-f1cb5d579852-kube-api-access-sjxnh\") pod \"iptables-alerter-2dglb\" (UID: \"509140b1-2afc-4042-a7ea-f1cb5d579852\") " pod="openshift-network-operator/iptables-alerter-2dglb"
Jul 24 15:47:28.321138 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320790    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-var-lib-openvswitch\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320815    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-sysctl-d\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320836    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-run\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320878    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320905    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-multus-socket-dir-parent\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320929    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-run-netns\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320952    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrfhj\" (UniqueName: \"kubernetes.io/projected/34acff67-e6d0-4c76-b011-4280b5935771-kube-api-access-hrfhj\") pod \"node-resolver-ljfg6\" (UID: \"34acff67-e6d0-4c76-b011-4280b5935771\") " pod="openshift-dns/node-resolver-ljfg6"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320974    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-device-dir\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.320996    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/464e984d-dae7-496c-a3b3-40bf169475c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321011    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/464e984d-dae7-496c-a3b3-40bf169475c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321026    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-system-cni-dir\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321049    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-registration-dir\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321071    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-var-lib-cni-multus\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321098    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-var-lib-kubelet\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321120    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs\") pod \"network-metrics-daemon-r6vqh\" (UID: \"f5906871-c948-4d05-8433-4968968c6221\") " pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321142    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/464e984d-dae7-496c-a3b3-40bf169475c1-cnibin\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.321907 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321164    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/464e984d-dae7-496c-a3b3-40bf169475c1-os-release\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.322820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321187    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-slash\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.322820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321209    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-env-overrides\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.322820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321244    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1c36bc9-7991-4a81-99ab-e00758772a24-host\") pod \"node-ca-j5x8q\" (UID: \"e1c36bc9-7991-4a81-99ab-e00758772a24\") " pod="openshift-image-registry/node-ca-j5x8q"
Jul 24 15:47:28.322820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321278    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-hostroot\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.322820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321339    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-systemd-units\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.322820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321372    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-run-ovn-kubernetes\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.322820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321401    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-systemd\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.322820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321425    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-sys\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.322820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321447    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e1c36bc9-7991-4a81-99ab-e00758772a24-serviceca\") pod \"node-ca-j5x8q\" (UID: \"e1c36bc9-7991-4a81-99ab-e00758772a24\") " pod="openshift-image-registry/node-ca-j5x8q"
Jul 24 15:47:28.322820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321448    2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 15:47:28.322820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321469    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfmwv\" (UniqueName: \"kubernetes.io/projected/e1c36bc9-7991-4a81-99ab-e00758772a24-kube-api-access-bfmwv\") pod \"node-ca-j5x8q\" (UID: \"e1c36bc9-7991-4a81-99ab-e00758772a24\") " pod="openshift-image-registry/node-ca-j5x8q"
Jul 24 15:47:28.322820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321490    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34acff67-e6d0-4c76-b011-4280b5935771-hosts-file\") pod \"node-resolver-ljfg6\" (UID: \"34acff67-e6d0-4c76-b011-4280b5935771\") " pod="openshift-dns/node-resolver-ljfg6"
Jul 24 15:47:28.322820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.321506    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.344973 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.344940    2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wjjht"
Jul 24 15:47:28.352752 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.352729    2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wjjht"
Jul 24 15:47:28.382178 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.382154    2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 15:47:28.407797 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.407769    2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 15:47:28.422256 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422223    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br4ln\" (UniqueName: \"kubernetes.io/projected/f5906871-c948-4d05-8433-4968968c6221-kube-api-access-br4ln\") pod \"network-metrics-daemon-r6vqh\" (UID: \"f5906871-c948-4d05-8433-4968968c6221\") " pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:28.422430 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422267    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-socket-dir\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.422430 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422294    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjxnh\" (UniqueName: \"kubernetes.io/projected/509140b1-2afc-4042-a7ea-f1cb5d579852-kube-api-access-sjxnh\") pod \"iptables-alerter-2dglb\" (UID: \"509140b1-2afc-4042-a7ea-f1cb5d579852\") " pod="openshift-network-operator/iptables-alerter-2dglb"
Jul 24 15:47:28.422430 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422324    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-var-lib-openvswitch\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.422430 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422347    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-sysctl-d\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.422430 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422423    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-run\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.422690 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422452    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:28.422690 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422478    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-multus-socket-dir-parent\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.422690 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422502    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-run-netns\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.422690 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422525    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrfhj\" (UniqueName: \"kubernetes.io/projected/34acff67-e6d0-4c76-b011-4280b5935771-kube-api-access-hrfhj\") pod \"node-resolver-ljfg6\" (UID: \"34acff67-e6d0-4c76-b011-4280b5935771\") " pod="openshift-dns/node-resolver-ljfg6"
Jul 24 15:47:28.422690 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422560    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-device-dir\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.422690 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422600    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/464e984d-dae7-496c-a3b3-40bf169475c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.422690 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422657    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/464e984d-dae7-496c-a3b3-40bf169475c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.422690 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422689    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-system-cni-dir\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.423034 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422715    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-registration-dir\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.423034 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422740    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-var-lib-cni-multus\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.423034 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422762    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-var-lib-kubelet\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.423034 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422787    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs\") pod \"network-metrics-daemon-r6vqh\" (UID: \"f5906871-c948-4d05-8433-4968968c6221\") " pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:28.423034 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422812    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/464e984d-dae7-496c-a3b3-40bf169475c1-cnibin\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.423034 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422836    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/464e984d-dae7-496c-a3b3-40bf169475c1-os-release\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.423034 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422860    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-slash\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.423034 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422864    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-socket-dir\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.423034 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422885    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-env-overrides\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.423034 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422907    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1c36bc9-7991-4a81-99ab-e00758772a24-host\") pod \"node-ca-j5x8q\" (UID: \"e1c36bc9-7991-4a81-99ab-e00758772a24\") " pod="openshift-image-registry/node-ca-j5x8q"
Jul 24 15:47:28.423034 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422939    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-hostroot\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.423034 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422990    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-systemd-units\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.423034 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423018    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-run-ovn-kubernetes\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423043    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-systemd\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423065    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-sys\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.422736    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-run\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423087    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e1c36bc9-7991-4a81-99ab-e00758772a24-serviceca\") pod \"node-ca-j5x8q\" (UID: \"e1c36bc9-7991-4a81-99ab-e00758772a24\") " pod="openshift-image-registry/node-ca-j5x8q"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423111    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfmwv\" (UniqueName: \"kubernetes.io/projected/e1c36bc9-7991-4a81-99ab-e00758772a24-kube-api-access-bfmwv\") pod \"node-ca-j5x8q\" (UID: \"e1c36bc9-7991-4a81-99ab-e00758772a24\") " pod="openshift-image-registry/node-ca-j5x8q"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423130    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-var-lib-openvswitch\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423134    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34acff67-e6d0-4c76-b011-4280b5935771-hosts-file\") pod \"node-resolver-ljfg6\" (UID: \"34acff67-e6d0-4c76-b011-4280b5935771\") " pod="openshift-dns/node-resolver-ljfg6"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423180    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.423186    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423208    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-cni-binary-copy\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423214    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34acff67-e6d0-4c76-b011-4280b5935771-hosts-file\") pod \"node-resolver-ljfg6\" (UID: \"34acff67-e6d0-4c76-b011-4280b5935771\") " pod="openshift-dns/node-resolver-ljfg6"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423236    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-cni-netd\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.423270    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret podName:a99759ef-4eee-46cb-ac25-cce29b9395b9 nodeName:}" failed. No retries permitted until 2026-07-24 15:47:28.923235279 +0000 UTC m=+2.985684461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret") pod "global-pull-secret-syncer-gfnfh" (UID: "a99759ef-4eee-46cb-ac25-cce29b9395b9") : object "kube-system"/"original-pull-secret" not registered
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423282    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-cni-netd\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.423315    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423323    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-multus-socket-dir-parent\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423333    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-var-lib-kubelet\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.423671 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423371    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/464e984d-dae7-496c-a3b3-40bf169475c1-cnibin\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423385    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-registration-dir\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423396    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423433    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-var-lib-cni-multus\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423418    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-system-cni-dir\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423542    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/464e984d-dae7-496c-a3b3-40bf169475c1-os-release\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423600    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-slash\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.423660    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs podName:f5906871-c948-4d05-8433-4968968c6221 nodeName:}" failed. No retries permitted until 2026-07-24 15:47:28.9236443 +0000 UTC m=+2.986093465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs") pod "network-metrics-daemon-r6vqh" (UID: "f5906871-c948-4d05-8433-4968968c6221") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423691    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-modprobe-d\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423717    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aef08cfc-aea6-4566-afdb-9f5a4332c337-tmp\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423743    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a99759ef-4eee-46cb-ac25-cce29b9395b9-dbus\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423765    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-cnibin\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423787    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-etc-openvswitch\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423813    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjj9p\" (UniqueName: \"kubernetes.io/projected/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-kube-api-access-bjj9p\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423954    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-cni-binary-copy\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.423999    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-sysctl-d\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424016    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/464e984d-dae7-496c-a3b3-40bf169475c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.424503 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424066    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-cnibin\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424095    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-run-netns\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424139    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-run-ovn-kubernetes\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424146    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a99759ef-4eee-46cb-ac25-cce29b9395b9-dbus\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424169    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1c36bc9-7991-4a81-99ab-e00758772a24-host\") pod \"node-ca-j5x8q\" (UID: \"e1c36bc9-7991-4a81-99ab-e00758772a24\") " pod="openshift-image-registry/node-ca-j5x8q"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424194    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-hostroot\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424205    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-sys\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424221    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-systemd-units\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424227    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-env-overrides\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424280    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-systemd\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424296    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-modprobe-d\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424294    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-etc-openvswitch\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424295    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-kubernetes\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424336    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-host\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424335    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-kubernetes\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424360    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/464e984d-dae7-496c-a3b3-40bf169475c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424371    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-host\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424383    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/509140b1-2afc-4042-a7ea-f1cb5d579852-iptables-alerter-script\") pod \"iptables-alerter-2dglb\" (UID: \"509140b1-2afc-4042-a7ea-f1cb5d579852\") " pod="openshift-network-operator/iptables-alerter-2dglb"
Jul 24 15:47:28.425316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424402    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-multus-conf-dir\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424421    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-run-systemd\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424436    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-log-socket\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424451    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-ovn-node-metrics-cert\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424468    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-lib-modules\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424483    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424499    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-run-openvswitch\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424515    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-run-ovn\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424531    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-tuned\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424537    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/464e984d-dae7-496c-a3b3-40bf169475c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424616    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/509140b1-2afc-4042-a7ea-f1cb5d579852-host-slash\") pod \"iptables-alerter-2dglb\" (UID: \"509140b1-2afc-4042-a7ea-f1cb5d579852\") " pod="openshift-network-operator/iptables-alerter-2dglb"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424660    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-run-ovn\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424481    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-multus-conf-dir\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424545    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/509140b1-2afc-4042-a7ea-f1cb5d579852-host-slash\") pod \"iptables-alerter-2dglb\" (UID: \"509140b1-2afc-4042-a7ea-f1cb5d579852\") " pod="openshift-network-operator/iptables-alerter-2dglb"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424709    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8148a263-1d0e-438e-ac4f-ca703f81fd72-konnectivity-ca\") pod \"konnectivity-agent-p9kvb\" (UID: \"8148a263-1d0e-438e-ac4f-ca703f81fd72\") " pod="kube-system/konnectivity-agent-p9kvb"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424735    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-var-lib-cni-bin\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424758    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdzcn\" (UniqueName: \"kubernetes.io/projected/aef08cfc-aea6-4566-afdb-9f5a4332c337-kube-api-access-bdzcn\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.426186 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424768    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e1c36bc9-7991-4a81-99ab-e00758772a24-serviceca\") pod \"node-ca-j5x8q\" (UID: \"e1c36bc9-7991-4a81-99ab-e00758772a24\") " pod="openshift-image-registry/node-ca-j5x8q"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424782    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-sys-fs\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424804    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-log-socket\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424805    2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424828    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-multus-daemon-config\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424853    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-cni-bin\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424893    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/464e984d-dae7-496c-a3b3-40bf169475c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424900    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-ovnkube-config\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424952    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-sysctl-conf\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424977    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-var-lib-cni-bin\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424979    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4qpz\" (UniqueName: \"kubernetes.io/projected/6c6ae9c2-c974-424a-b3bf-3fac535eee78-kube-api-access-k4qpz\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424784    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-run-systemd\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425008    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/464e984d-dae7-496c-a3b3-40bf169475c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425022    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-sys-fs\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.424623    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425033    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8148a263-1d0e-438e-ac4f-ca703f81fd72-agent-certs\") pod \"konnectivity-agent-p9kvb\" (UID: \"8148a263-1d0e-438e-ac4f-ca703f81fd72\") " pod="kube-system/konnectivity-agent-p9kvb"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425045    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/509140b1-2afc-4042-a7ea-f1cb5d579852-iptables-alerter-script\") pod \"iptables-alerter-2dglb\" (UID: \"509140b1-2afc-4042-a7ea-f1cb5d579852\") " pod="openshift-network-operator/iptables-alerter-2dglb"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425057    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-os-release\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.426909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425094    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-run-k8s-cni-cncf-io\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425122    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-lib-modules\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425162    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-run-k8s-cni-cncf-io\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425167    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425124    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425185    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-os-release\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425212    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/464e984d-dae7-496c-a3b3-40bf169475c1-system-cni-dir\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425251    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a99759ef-4eee-46cb-ac25-cce29b9395b9-kubelet-config\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425277    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-run-netns\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425285    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8148a263-1d0e-438e-ac4f-ca703f81fd72-konnectivity-ca\") pod \"konnectivity-agent-p9kvb\" (UID: \"8148a263-1d0e-438e-ac4f-ca703f81fd72\") " pod="kube-system/konnectivity-agent-p9kvb"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425301    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34acff67-e6d0-4c76-b011-4280b5935771-tmp-dir\") pod \"node-resolver-ljfg6\" (UID: \"34acff67-e6d0-4c76-b011-4280b5935771\") " pod="openshift-dns/node-resolver-ljfg6"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425329    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwmt\" (UniqueName: \"kubernetes.io/projected/464e984d-dae7-496c-a3b3-40bf169475c1-kube-api-access-fgwmt\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425334    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-run-openvswitch\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425353    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-ovnkube-config\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425354    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-multus-cni-dir\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425382    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-var-lib-kubelet\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425386    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-cni-bin\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.427751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425406    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-etc-kubernetes\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425430    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crm62\" (UniqueName: \"kubernetes.io/projected/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-kube-api-access-crm62\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425451    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-sysconfig\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425476    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rcz8\" (UniqueName: \"kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8\") pod \"network-check-target-mq5hc\" (UID: \"46b9a741-240c-474f-8f54-323a430573bb\") " pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425468    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/464e984d-dae7-496c-a3b3-40bf169475c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425502    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-run-multus-certs\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425524    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-kubelet\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425532    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a99759ef-4eee-46cb-ac25-cce29b9395b9-kubelet-config\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425544    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-node-log\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425564    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/464e984d-dae7-496c-a3b3-40bf169475c1-system-cni-dir\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425565    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-ovnkube-script-lib\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425643    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34acff67-e6d0-4c76-b011-4280b5935771-tmp-dir\") pod \"node-resolver-ljfg6\" (UID: \"34acff67-e6d0-4c76-b011-4280b5935771\") " pod="openshift-dns/node-resolver-ljfg6"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425698    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6c6ae9c2-c974-424a-b3bf-3fac535eee78-device-dir\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425712    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-run-netns\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425288    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-sysctl-conf\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425840    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-var-lib-kubelet\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425913    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-etc-kubernetes\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.428601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425916    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-host-run-multus-certs\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.429335 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425991    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-sysconfig\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.429335 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.426045    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-host-kubelet\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.429335 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.426047    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-ovnkube-script-lib\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.429335 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.426104    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-node-log\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.429335 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.426135    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-multus-daemon-config\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.429335 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.425778    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-multus-cni-dir\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.429633 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.429366    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aef08cfc-aea6-4566-afdb-9f5a4332c337-etc-tuned\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.429633 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.429490    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-ovn-node-metrics-cert\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.429834 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.429815    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8148a263-1d0e-438e-ac4f-ca703f81fd72-agent-certs\") pod \"konnectivity-agent-p9kvb\" (UID: \"8148a263-1d0e-438e-ac4f-ca703f81fd72\") " pod="kube-system/konnectivity-agent-p9kvb"
Jul 24 15:47:28.430004 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.429981    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aef08cfc-aea6-4566-afdb-9f5a4332c337-tmp\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.440811 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.440783    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br4ln\" (UniqueName: \"kubernetes.io/projected/f5906871-c948-4d05-8433-4968968c6221-kube-api-access-br4ln\") pod \"network-metrics-daemon-r6vqh\" (UID: \"f5906871-c948-4d05-8433-4968968c6221\") " pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:28.443203 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.443175    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrfhj\" (UniqueName: \"kubernetes.io/projected/34acff67-e6d0-4c76-b011-4280b5935771-kube-api-access-hrfhj\") pod \"node-resolver-ljfg6\" (UID: \"34acff67-e6d0-4c76-b011-4280b5935771\") " pod="openshift-dns/node-resolver-ljfg6"
Jul 24 15:47:28.444222 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.444203    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfmwv\" (UniqueName: \"kubernetes.io/projected/e1c36bc9-7991-4a81-99ab-e00758772a24-kube-api-access-bfmwv\") pod \"node-ca-j5x8q\" (UID: \"e1c36bc9-7991-4a81-99ab-e00758772a24\") " pod="openshift-image-registry/node-ca-j5x8q"
Jul 24 15:47:28.444700 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.444676    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjxnh\" (UniqueName: \"kubernetes.io/projected/509140b1-2afc-4042-a7ea-f1cb5d579852-kube-api-access-sjxnh\") pod \"iptables-alerter-2dglb\" (UID: \"509140b1-2afc-4042-a7ea-f1cb5d579852\") " pod="openshift-network-operator/iptables-alerter-2dglb"
Jul 24 15:47:28.444961 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.444943    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crm62\" (UniqueName: \"kubernetes.io/projected/551d05d5-ca76-42a2-b320-a6ac7bbfdc39-kube-api-access-crm62\") pod \"multus-2gc58\" (UID: \"551d05d5-ca76-42a2-b320-a6ac7bbfdc39\") " pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.445048 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.444991    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdzcn\" (UniqueName: \"kubernetes.io/projected/aef08cfc-aea6-4566-afdb-9f5a4332c337-kube-api-access-bdzcn\") pod \"tuned-8vf58\" (UID: \"aef08cfc-aea6-4566-afdb-9f5a4332c337\") " pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.446117 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.445624    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjj9p\" (UniqueName: \"kubernetes.io/projected/0d83ab12-4bc4-4b86-9ef2-94c9c8f56472-kube-api-access-bjj9p\") pod \"ovnkube-node-x2djb\" (UID: \"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.447095 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.447071    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4qpz\" (UniqueName: \"kubernetes.io/projected/6c6ae9c2-c974-424a-b3bf-3fac535eee78-kube-api-access-k4qpz\") pod \"aws-ebs-csi-driver-node-g9n7g\" (UID: \"6c6ae9c2-c974-424a-b3bf-3fac535eee78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.447906 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.447886    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgwmt\" (UniqueName: \"kubernetes.io/projected/464e984d-dae7-496c-a3b3-40bf169475c1-kube-api-access-fgwmt\") pod \"multus-additional-cni-plugins-v4nr7\" (UID: \"464e984d-dae7-496c-a3b3-40bf169475c1\") " pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.473616 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.473534    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-199.ec2.internal" event={"ID":"cf62266a6ae3b77620eda580b89764b9","Type":"ContainerStarted","Data":"5269d632b6f8616c749529c500bfc52d54b5df4e1b0738e8d2b685cc60f973c2"}
Jul 24 15:47:28.474876 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.474845    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal" event={"ID":"139e51abe32fc6d140a5f3ceeea4020f","Type":"ContainerStarted","Data":"d82ea91087315980fc807d3e1ecd709c983e2150c82f65f0e354b46b74c001de"}
Jul 24 15:47:28.526228 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.526197    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rcz8\" (UniqueName: \"kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8\") pod \"network-check-target-mq5hc\" (UID: \"46b9a741-240c-474f-8f54-323a430573bb\") " pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:28.531975 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.531900    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 15:47:28.531975 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.531930    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 15:47:28.531975 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.531945    2553 projected.go:196] Error preparing data for projected volume kube-api-access-8rcz8 for pod openshift-network-diagnostics/network-check-target-mq5hc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:47:28.532175 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.532010    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8 podName:46b9a741-240c-474f-8f54-323a430573bb nodeName:}" failed. No retries permitted until 2026-07-24 15:47:29.031995152 +0000 UTC m=+3.094444317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8rcz8" (UniqueName: "kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8") pod "network-check-target-mq5hc" (UID: "46b9a741-240c-474f-8f54-323a430573bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:47:28.612387 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.612346    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2dglb"
Jul 24 15:47:28.619397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.619367    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p9kvb"
Jul 24 15:47:28.631427 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.631403    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2gc58"
Jul 24 15:47:28.636355 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.636334    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:28.643970 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.643951    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8vf58"
Jul 24 15:47:28.652559 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.652538    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g"
Jul 24 15:47:28.661316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.661291    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j5x8q"
Jul 24 15:47:28.665472 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.665452    2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 15:47:28.669728 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.669709    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ljfg6"
Jul 24 15:47:28.676307 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.676287    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v4nr7"
Jul 24 15:47:28.929339 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.929265    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:28.929339 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:28.929309    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs\") pod \"network-metrics-daemon-r6vqh\" (UID: \"f5906871-c948-4d05-8433-4968968c6221\") " pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:28.929506 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.929379    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 15:47:28.929506 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.929446    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret podName:a99759ef-4eee-46cb-ac25-cce29b9395b9 nodeName:}" failed. No retries permitted until 2026-07-24 15:47:29.929430621 +0000 UTC m=+3.991879785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret") pod "global-pull-secret-syncer-gfnfh" (UID: "a99759ef-4eee-46cb-ac25-cce29b9395b9") : object "kube-system"/"original-pull-secret" not registered
Jul 24 15:47:28.929506 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.929388    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:47:28.929626 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:28.929520    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs podName:f5906871-c948-4d05-8433-4968968c6221 nodeName:}" failed. No retries permitted until 2026-07-24 15:47:29.929506715 +0000 UTC m=+3.991955881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs") pod "network-metrics-daemon-r6vqh" (UID: "f5906871-c948-4d05-8433-4968968c6221") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:47:29.131710 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.131668    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rcz8\" (UniqueName: \"kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8\") pod \"network-check-target-mq5hc\" (UID: \"46b9a741-240c-474f-8f54-323a430573bb\") " pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:29.131894 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:29.131851    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 15:47:29.131894 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:29.131878    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 15:47:29.131894 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:29.131890    2553 projected.go:196] Error preparing data for projected volume kube-api-access-8rcz8 for pod openshift-network-diagnostics/network-check-target-mq5hc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:47:29.132008 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:29.131950    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8 podName:46b9a741-240c-474f-8f54-323a430573bb nodeName:}" failed. No retries permitted until 2026-07-24 15:47:30.131935067 +0000 UTC m=+4.194384232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rcz8" (UniqueName: "kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8") pod "network-check-target-mq5hc" (UID: "46b9a741-240c-474f-8f54-323a430573bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:47:29.355594 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.355519    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 15:42:28 +0000 UTC" deadline="2028-01-22 19:05:45.557561802 +0000 UTC"
Jul 24 15:47:29.355594 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.355576    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13131h18m16.201990952s"
Jul 24 15:47:29.417919 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:29.417544    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d83ab12_4bc4_4b86_9ef2_94c9c8f56472.slice/crio-503129611f7613b82df4f4ca3d95c47809d051362b02f6bf58298ab6dc51cba6 WatchSource:0}: Error finding container 503129611f7613b82df4f4ca3d95c47809d051362b02f6bf58298ab6dc51cba6: Status 404 returned error can't find the container with id 503129611f7613b82df4f4ca3d95c47809d051362b02f6bf58298ab6dc51cba6
Jul 24 15:47:29.420061 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:29.419896    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8148a263_1d0e_438e_ac4f_ca703f81fd72.slice/crio-5af692fe87de3adb7a14671e7b4670fb97a723fce101da2e4e8c14dae4ea6681 WatchSource:0}: Error finding container 5af692fe87de3adb7a14671e7b4670fb97a723fce101da2e4e8c14dae4ea6681: Status 404 returned error can't find the container with id 5af692fe87de3adb7a14671e7b4670fb97a723fce101da2e4e8c14dae4ea6681
Jul 24 15:47:29.423004 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:29.422979    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c36bc9_7991_4a81_99ab_e00758772a24.slice/crio-5346697c28505345a192ae3df3ad0079778d863623f59a1a880a34802f51cebc WatchSource:0}: Error finding container 5346697c28505345a192ae3df3ad0079778d863623f59a1a880a34802f51cebc: Status 404 returned error can't find the container with id 5346697c28505345a192ae3df3ad0079778d863623f59a1a880a34802f51cebc
Jul 24 15:47:29.424809 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:29.424651    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef08cfc_aea6_4566_afdb_9f5a4332c337.slice/crio-c17dfdd99c0174a2df1a848673ed16a17564a94e124e10931f03f8c349dc8161 WatchSource:0}: Error finding container c17dfdd99c0174a2df1a848673ed16a17564a94e124e10931f03f8c349dc8161: Status 404 returned error can't find the container with id c17dfdd99c0174a2df1a848673ed16a17564a94e124e10931f03f8c349dc8161
Jul 24 15:47:29.425623 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:29.425598    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34acff67_e6d0_4c76_b011_4280b5935771.slice/crio-e4b065d5a07934a7e0d91279058a5a22e1bce23afb67ea4d505d5b122e09ed79 WatchSource:0}: Error finding container e4b065d5a07934a7e0d91279058a5a22e1bce23afb67ea4d505d5b122e09ed79: Status 404 returned error can't find the container with id e4b065d5a07934a7e0d91279058a5a22e1bce23afb67ea4d505d5b122e09ed79
Jul 24 15:47:29.426902 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:29.426834    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod464e984d_dae7_496c_a3b3_40bf169475c1.slice/crio-402e772575e6b46e09d31d9625e608522098dba894c9486e6818f0e449d7d91c WatchSource:0}: Error finding container 402e772575e6b46e09d31d9625e608522098dba894c9486e6818f0e449d7d91c: Status 404 returned error can't find the container with id 402e772575e6b46e09d31d9625e608522098dba894c9486e6818f0e449d7d91c
Jul 24 15:47:29.427370 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:29.427322    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551d05d5_ca76_42a2_b320_a6ac7bbfdc39.slice/crio-cb0bd337215584a57519a67c1a157dbe744f14fd9ee824337435bfb20bdebfdf WatchSource:0}: Error finding container cb0bd337215584a57519a67c1a157dbe744f14fd9ee824337435bfb20bdebfdf: Status 404 returned error can't find the container with id cb0bd337215584a57519a67c1a157dbe744f14fd9ee824337435bfb20bdebfdf
Jul 24 15:47:29.429189 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:47:29.428615    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c6ae9c2_c974_424a_b3bf_3fac535eee78.slice/crio-8617073e1fb1c82ec0a959c5eee7e6340381ed021ec6346bf8eb06ab69f3808f WatchSource:0}: Error finding container 8617073e1fb1c82ec0a959c5eee7e6340381ed021ec6346bf8eb06ab69f3808f: Status 404 returned error can't find the container with id 8617073e1fb1c82ec0a959c5eee7e6340381ed021ec6346bf8eb06ab69f3808f
Jul 24 15:47:29.468677 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.468646    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:29.468785 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:29.468765    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:29.478130 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.478098    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2dglb" event={"ID":"509140b1-2afc-4042-a7ea-f1cb5d579852","Type":"ContainerStarted","Data":"68a8f883a2acbf8ae01acbaf24681a1816617d8e8ba76fc9f59fef3a2e4271ce"}
Jul 24 15:47:29.479137 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.479112    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2gc58" event={"ID":"551d05d5-ca76-42a2-b320-a6ac7bbfdc39","Type":"ContainerStarted","Data":"cb0bd337215584a57519a67c1a157dbe744f14fd9ee824337435bfb20bdebfdf"}
Jul 24 15:47:29.480085 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.480062    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4nr7" event={"ID":"464e984d-dae7-496c-a3b3-40bf169475c1","Type":"ContainerStarted","Data":"402e772575e6b46e09d31d9625e608522098dba894c9486e6818f0e449d7d91c"}
Jul 24 15:47:29.481231 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.480970    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ljfg6" event={"ID":"34acff67-e6d0-4c76-b011-4280b5935771","Type":"ContainerStarted","Data":"e4b065d5a07934a7e0d91279058a5a22e1bce23afb67ea4d505d5b122e09ed79"}
Jul 24 15:47:29.482159 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.482132    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8vf58" event={"ID":"aef08cfc-aea6-4566-afdb-9f5a4332c337","Type":"ContainerStarted","Data":"c17dfdd99c0174a2df1a848673ed16a17564a94e124e10931f03f8c349dc8161"}
Jul 24 15:47:29.489800 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.489770    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j5x8q" event={"ID":"e1c36bc9-7991-4a81-99ab-e00758772a24","Type":"ContainerStarted","Data":"5346697c28505345a192ae3df3ad0079778d863623f59a1a880a34802f51cebc"}
Jul 24 15:47:29.492190 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.492164    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g" event={"ID":"6c6ae9c2-c974-424a-b3bf-3fac535eee78","Type":"ContainerStarted","Data":"8617073e1fb1c82ec0a959c5eee7e6340381ed021ec6346bf8eb06ab69f3808f"}
Jul 24 15:47:29.493360 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.493196    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p9kvb" event={"ID":"8148a263-1d0e-438e-ac4f-ca703f81fd72","Type":"ContainerStarted","Data":"5af692fe87de3adb7a14671e7b4670fb97a723fce101da2e4e8c14dae4ea6681"}
Jul 24 15:47:29.494353 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.494333    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb" event={"ID":"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472","Type":"ContainerStarted","Data":"503129611f7613b82df4f4ca3d95c47809d051362b02f6bf58298ab6dc51cba6"}
Jul 24 15:47:29.936848 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.936756    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:29.936848 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:29.936819    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs\") pod \"network-metrics-daemon-r6vqh\" (UID: \"f5906871-c948-4d05-8433-4968968c6221\") " pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:29.937059 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:29.936989    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:47:29.937059 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:29.937051    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs podName:f5906871-c948-4d05-8433-4968968c6221 nodeName:}" failed. No retries permitted until 2026-07-24 15:47:31.937032409 +0000 UTC m=+5.999481587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs") pod "network-metrics-daemon-r6vqh" (UID: "f5906871-c948-4d05-8433-4968968c6221") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:47:29.937446 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:29.937423    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 15:47:29.937531 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:29.937480    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret podName:a99759ef-4eee-46cb-ac25-cce29b9395b9 nodeName:}" failed. No retries permitted until 2026-07-24 15:47:31.937466024 +0000 UTC m=+5.999915194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret") pod "global-pull-secret-syncer-gfnfh" (UID: "a99759ef-4eee-46cb-ac25-cce29b9395b9") : object "kube-system"/"original-pull-secret" not registered
Jul 24 15:47:30.138732 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:30.138693    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rcz8\" (UniqueName: \"kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8\") pod \"network-check-target-mq5hc\" (UID: \"46b9a741-240c-474f-8f54-323a430573bb\") " pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:30.138993 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:30.138907    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 15:47:30.138993 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:30.138925    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 15:47:30.138993 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:30.138938    2553 projected.go:196] Error preparing data for projected volume kube-api-access-8rcz8 for pod openshift-network-diagnostics/network-check-target-mq5hc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:47:30.139145 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:30.139001    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8 podName:46b9a741-240c-474f-8f54-323a430573bb nodeName:}" failed. No retries permitted until 2026-07-24 15:47:32.13898181 +0000 UTC m=+6.201430991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rcz8" (UniqueName: "kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8") pod "network-check-target-mq5hc" (UID: "46b9a741-240c-474f-8f54-323a430573bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:47:30.355970 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:30.355870    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 15:42:28 +0000 UTC" deadline="2028-05-11 00:54:07.634431388 +0000 UTC"
Jul 24 15:47:30.355970 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:30.355930    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15753h6m37.278505491s"
Jul 24 15:47:30.470661 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:30.470629    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:30.470833 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:30.470761    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:30.471371 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:30.471161    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:30.471371 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:30.471258    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:30.508928 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:30.508890    2553 generic.go:356] "Generic (PLEG): container finished" podID="139e51abe32fc6d140a5f3ceeea4020f" containerID="05fc17921faf123d8c1eb06b3bd613508993a127c6fcb789f21109868bf0ea54" exitCode=0
Jul 24 15:47:30.509108 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:30.508990    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal" event={"ID":"139e51abe32fc6d140a5f3ceeea4020f","Type":"ContainerDied","Data":"05fc17921faf123d8c1eb06b3bd613508993a127c6fcb789f21109868bf0ea54"}
Jul 24 15:47:30.523379 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:30.523343    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-199.ec2.internal" event={"ID":"cf62266a6ae3b77620eda580b89764b9","Type":"ContainerStarted","Data":"fda625276215062f53cbaf8a8c36ccf16c5df845c502404c9deb89412bebf57e"}
Jul 24 15:47:30.543377 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:30.541744    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-199.ec2.internal" podStartSLOduration=3.541722579 podStartE2EDuration="3.541722579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:47:30.541706151 +0000 UTC m=+4.604155339" watchObservedRunningTime="2026-07-24 15:47:30.541722579 +0000 UTC m=+4.604171767"
Jul 24 15:47:31.468889 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:31.468806    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:31.469343 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:31.468949    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:31.549258 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:31.548703    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal" event={"ID":"139e51abe32fc6d140a5f3ceeea4020f","Type":"ContainerStarted","Data":"df3c6e39a682a54487a97b2e2444ddc6cb55b0133191cd481f964e47f9ff4a23"}
Jul 24 15:47:31.576605 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:31.576256    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-199.ec2.internal" podStartSLOduration=4.57623511 podStartE2EDuration="4.57623511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:47:31.568730104 +0000 UTC m=+5.631179281" watchObservedRunningTime="2026-07-24 15:47:31.57623511 +0000 UTC m=+5.638684300"
Jul 24 15:47:31.960446 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:31.959724    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:31.960446 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:31.959783    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs\") pod \"network-metrics-daemon-r6vqh\" (UID: \"f5906871-c948-4d05-8433-4968968c6221\") " pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:31.960446 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:31.959926    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:47:31.960446 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:31.959984    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs podName:f5906871-c948-4d05-8433-4968968c6221 nodeName:}" failed. No retries permitted until 2026-07-24 15:47:35.959965563 +0000 UTC m=+10.022414731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs") pod "network-metrics-daemon-r6vqh" (UID: "f5906871-c948-4d05-8433-4968968c6221") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:47:31.960446 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:31.960378    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 15:47:31.960446 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:31.960422    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret podName:a99759ef-4eee-46cb-ac25-cce29b9395b9 nodeName:}" failed. No retries permitted until 2026-07-24 15:47:35.960408315 +0000 UTC m=+10.022857484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret") pod "global-pull-secret-syncer-gfnfh" (UID: "a99759ef-4eee-46cb-ac25-cce29b9395b9") : object "kube-system"/"original-pull-secret" not registered
Jul 24 15:47:32.161497 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:32.161456    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rcz8\" (UniqueName: \"kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8\") pod \"network-check-target-mq5hc\" (UID: \"46b9a741-240c-474f-8f54-323a430573bb\") " pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:32.162172 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:32.161691    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 15:47:32.162172 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:32.161716    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 15:47:32.162172 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:32.161729    2553 projected.go:196] Error preparing data for projected volume kube-api-access-8rcz8 for pod openshift-network-diagnostics/network-check-target-mq5hc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:47:32.162172 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:32.161788    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8 podName:46b9a741-240c-474f-8f54-323a430573bb nodeName:}" failed. No retries permitted until 2026-07-24 15:47:36.161770474 +0000 UTC m=+10.224219662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rcz8" (UniqueName: "kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8") pod "network-check-target-mq5hc" (UID: "46b9a741-240c-474f-8f54-323a430573bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:47:32.469257 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:32.469226    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:32.469257 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:32.469247    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:32.469778 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:32.469358    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:32.469778 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:32.469518    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:33.469320 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:33.469286    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:33.469858 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:33.469435    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:34.469572 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:34.469541    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:34.469572 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:34.469562    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:34.470112 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:34.469697    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:34.470174 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:34.470127    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:35.469408 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:35.469283    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:35.469610 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:35.469435    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:35.997307 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:35.997272    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:35.997307 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:35.997313    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs\") pod \"network-metrics-daemon-r6vqh\" (UID: \"f5906871-c948-4d05-8433-4968968c6221\") " pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:35.997539 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:35.997450    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:47:35.997539 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:35.997509    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs podName:f5906871-c948-4d05-8433-4968968c6221 nodeName:}" failed. No retries permitted until 2026-07-24 15:47:43.997493727 +0000 UTC m=+18.059942903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs") pod "network-metrics-daemon-r6vqh" (UID: "f5906871-c948-4d05-8433-4968968c6221") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:47:35.997539 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:35.997452    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 15:47:35.997959 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:35.997885    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret podName:a99759ef-4eee-46cb-ac25-cce29b9395b9 nodeName:}" failed. No retries permitted until 2026-07-24 15:47:43.997862054 +0000 UTC m=+18.060311276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret") pod "global-pull-secret-syncer-gfnfh" (UID: "a99759ef-4eee-46cb-ac25-cce29b9395b9") : object "kube-system"/"original-pull-secret" not registered
Jul 24 15:47:36.199330 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:36.199291    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rcz8\" (UniqueName: \"kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8\") pod \"network-check-target-mq5hc\" (UID: \"46b9a741-240c-474f-8f54-323a430573bb\") " pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:36.199511 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:36.199486    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 15:47:36.199511 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:36.199509    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 15:47:36.199647 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:36.199522    2553 projected.go:196] Error preparing data for projected volume kube-api-access-8rcz8 for pod openshift-network-diagnostics/network-check-target-mq5hc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:47:36.199647 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:36.199580    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8 podName:46b9a741-240c-474f-8f54-323a430573bb nodeName:}" failed. No retries permitted until 2026-07-24 15:47:44.199561585 +0000 UTC m=+18.262010764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rcz8" (UniqueName: "kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8") pod "network-check-target-mq5hc" (UID: "46b9a741-240c-474f-8f54-323a430573bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:47:36.470035 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:36.469936    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:36.470483 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:36.470040    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:36.470483 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:36.470405    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:36.470623 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:36.470493    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:37.468772 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:37.468737    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:37.468954 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:37.468873    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:38.469413 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:38.469282    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:38.469946 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:38.469427    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:38.469946 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:38.469821    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:38.469946 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:38.469911    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:39.469230 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:39.469192    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:39.469398 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:39.469331    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:40.468989 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:40.468949    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:40.468989 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:40.468978    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:40.469483 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:40.469093    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:40.469483 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:40.469233    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:41.468762 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:41.468729    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:41.468932 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:41.468857    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:42.468630 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:42.468596    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:42.469092 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:42.468729    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:42.469092 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:42.468779    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:42.469092 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:42.468868    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:43.468328 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:43.468297    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:43.468548 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:43.468432    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:44.062365 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:44.062304    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:44.062365 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:44.062372    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs\") pod \"network-metrics-daemon-r6vqh\" (UID: \"f5906871-c948-4d05-8433-4968968c6221\") " pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:44.062895 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:44.062483    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 15:47:44.062895 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:44.062572    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret podName:a99759ef-4eee-46cb-ac25-cce29b9395b9 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:00.062551345 +0000 UTC m=+34.125000526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret") pod "global-pull-secret-syncer-gfnfh" (UID: "a99759ef-4eee-46cb-ac25-cce29b9395b9") : object "kube-system"/"original-pull-secret" not registered
Jul 24 15:47:44.062895 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:44.062580    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:47:44.062895 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:44.062653    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs podName:f5906871-c948-4d05-8433-4968968c6221 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:00.062635033 +0000 UTC m=+34.125084201 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs") pod "network-metrics-daemon-r6vqh" (UID: "f5906871-c948-4d05-8433-4968968c6221") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:47:44.264350 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:44.264308    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rcz8\" (UniqueName: \"kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8\") pod \"network-check-target-mq5hc\" (UID: \"46b9a741-240c-474f-8f54-323a430573bb\") " pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:44.264558 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:44.264528    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 15:47:44.264694 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:44.264564    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 15:47:44.264694 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:44.264595    2553 projected.go:196] Error preparing data for projected volume kube-api-access-8rcz8 for pod openshift-network-diagnostics/network-check-target-mq5hc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:47:44.264694 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:44.264662    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8 podName:46b9a741-240c-474f-8f54-323a430573bb nodeName:}" failed. No retries permitted until 2026-07-24 15:48:00.264646047 +0000 UTC m=+34.327095213 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rcz8" (UniqueName: "kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8") pod "network-check-target-mq5hc" (UID: "46b9a741-240c-474f-8f54-323a430573bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:47:44.469435 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:44.469345    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:44.469435 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:44.469396    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:44.469659 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:44.469496    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:44.469659 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:44.469618    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:45.468545 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:45.468509    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:45.468958 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:45.468670    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:46.469998 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:46.469962    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:46.470475 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:46.470065    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:46.470475 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:46.470116    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:46.470475 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:46.470211    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:47.468815 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:47.468776    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:47.468993 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:47.468928    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:48.468847 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.468617    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:48.469434 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.468653    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:48.469434 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:48.468946    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:48.469434 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:48.469008    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:48.586470 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.586437    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g" event={"ID":"6c6ae9c2-c974-424a-b3bf-3fac535eee78","Type":"ContainerStarted","Data":"ca9c4fad0f052fb73c9b2591b194aaa1018fab8795ae0fd2d789872cd4c4d1a8"}
Jul 24 15:47:48.587906 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.587880    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p9kvb" event={"ID":"8148a263-1d0e-438e-ac4f-ca703f81fd72","Type":"ContainerStarted","Data":"6676c1594e83feef106606e312c940b83bfbd1deafc68a0a28ad162d3f6dea8f"}
Jul 24 15:47:48.590987 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.590961    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb" event={"ID":"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472","Type":"ContainerStarted","Data":"2960b308d4fbe8c571b066398e62fab054bc846972f404ab495797ecaa2bfe58"}
Jul 24 15:47:48.591094 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.591033    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb" event={"ID":"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472","Type":"ContainerStarted","Data":"8e810e2b161b167f40976dd6870e7da09edbf87b702a8e34cb0707fdeac35780"}
Jul 24 15:47:48.591094 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.591070    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb" event={"ID":"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472","Type":"ContainerStarted","Data":"400aec5c23acc04d0b21ceb9e69329aae1c4e74758673a9a728c080df3c9a465"}
Jul 24 15:47:48.591208 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.591097    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb" event={"ID":"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472","Type":"ContainerStarted","Data":"8bd36684c94f243144f0191bc52b720cb2955e87054af0405afe669ac46b4960"}
Jul 24 15:47:48.591208 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.591134    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb" event={"ID":"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472","Type":"ContainerStarted","Data":"0cd8dab93a3c668d5e2d4bd5b2a9f5d0208e2d58488d0b470d6dc1ae2fb79a4f"}
Jul 24 15:47:48.591208 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.591178    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb" event={"ID":"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472","Type":"ContainerStarted","Data":"19b13ea89dd8a314e6ef4206a6deaffdeb4f84c6bcbee8a8cc204293ead3d06c"}
Jul 24 15:47:48.592419 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.592396    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2gc58" event={"ID":"551d05d5-ca76-42a2-b320-a6ac7bbfdc39","Type":"ContainerStarted","Data":"c12eaf639679e149d847141dcda98d7aa02d39304a913f077dca06672e377c17"}
Jul 24 15:47:48.593779 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.593758    2553 generic.go:356] "Generic (PLEG): container finished" podID="464e984d-dae7-496c-a3b3-40bf169475c1" containerID="0180c4d55439831282f10ed890e99b2a3e10fdf0977bafeb7bb7618f4666aadd" exitCode=0
Jul 24 15:47:48.593880 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.593839    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4nr7" event={"ID":"464e984d-dae7-496c-a3b3-40bf169475c1","Type":"ContainerDied","Data":"0180c4d55439831282f10ed890e99b2a3e10fdf0977bafeb7bb7618f4666aadd"}
Jul 24 15:47:48.595303 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.595189    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ljfg6" event={"ID":"34acff67-e6d0-4c76-b011-4280b5935771","Type":"ContainerStarted","Data":"78286e3145ee6d0f296758704862d0b65c5bb7e66d607cba36510d22a52dd7c0"}
Jul 24 15:47:48.596836 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.596708    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8vf58" event={"ID":"aef08cfc-aea6-4566-afdb-9f5a4332c337","Type":"ContainerStarted","Data":"c2f475e5d865f45d2f89a652b9726f78346845e828f052618f3fc2ed8241f6b1"}
Jul 24 15:47:48.598127 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.598108    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j5x8q" event={"ID":"e1c36bc9-7991-4a81-99ab-e00758772a24","Type":"ContainerStarted","Data":"8c81ea43e19d7cbf7c8d55fbeeffecf91ea7323799eeebc2564a2a1c9b4828d9"}
Jul 24 15:47:48.605039 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.604999    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p9kvb" podStartSLOduration=8.528980662 podStartE2EDuration="22.604986115s" totalImagesPullingTime="14.076005453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:47:48.604802594 +0000 UTC m=+22.667251780" watchObservedRunningTime="2026-07-24 15:47:48.604986115 +0000 UTC m=+22.667435301"
Jul 24 15:47:48.619568 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.619522    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j5x8q" podStartSLOduration=4.089388404 podStartE2EDuration="22.619505794s" totalImagesPullingTime="18.53011739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:47:48.619392215 +0000 UTC m=+22.681841401" watchObservedRunningTime="2026-07-24 15:47:48.619505794 +0000 UTC m=+22.681954980"
Jul 24 15:47:48.657103 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.657041    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ljfg6" podStartSLOduration=4.109470953 podStartE2EDuration="22.657024569s" totalImagesPullingTime="18.547553616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:47:48.633526698 +0000 UTC m=+22.695975886" watchObservedRunningTime="2026-07-24 15:47:48.657024569 +0000 UTC m=+22.719473752"
Jul 24 15:47:48.673730 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.673670    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8vf58" podStartSLOduration=4.121496443 podStartE2EDuration="22.673650297s" totalImagesPullingTime="18.552153854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:47:48.673124405 +0000 UTC m=+22.735573592" watchObservedRunningTime="2026-07-24 15:47:48.673650297 +0000 UTC m=+22.736099485"
Jul 24 15:47:48.689560 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:48.689505    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2gc58" podStartSLOduration=4.04359639 podStartE2EDuration="22.689489896s" totalImagesPullingTime="18.645893506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:47:48.689315545 +0000 UTC m=+22.751764743" watchObservedRunningTime="2026-07-24 15:47:48.689489896 +0000 UTC m=+22.751939085"
Jul 24 15:47:49.468579 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:49.468546    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:49.468738 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:49.468694    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:49.496409 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:49.496381    2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 15:47:49.602572 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:49.602487    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g" event={"ID":"6c6ae9c2-c974-424a-b3bf-3fac535eee78","Type":"ContainerStarted","Data":"5c23009cdd2018450fd83ed18f9c1909c7a083c429b88f8f0d183a1096c6b575"}
Jul 24 15:47:49.603843 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:49.603820    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2dglb" event={"ID":"509140b1-2afc-4042-a7ea-f1cb5d579852","Type":"ContainerStarted","Data":"fbcf041f0d9dbaa8ad997040b949184881849898092d68422a7c29f826835a6e"}
Jul 24 15:47:49.619578 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:49.619525    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2dglb" podStartSLOduration=5.263271635 podStartE2EDuration="23.619509216s" totalImagesPullingTime="18.356237581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:47:49.619162076 +0000 UTC m=+23.681611262" watchObservedRunningTime="2026-07-24 15:47:49.619509216 +0000 UTC m=+23.681958403"
Jul 24 15:47:50.398643 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:50.398526    2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T15:47:49.496400165Z","UUID":"3bbbc4f3-32f9-42f5-adba-d28493a8ca14","Handler":null,"Name":"","Endpoint":""}
Jul 24 15:47:50.400176 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:50.400153    2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 15:47:50.400299 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:50.400199    2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 15:47:50.469324 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:50.469286    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:50.469512 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:50.469331    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:50.469512 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:50.469419    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:50.469659 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:50.469548    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:50.768738 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:50.768547    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p9kvb"
Jul 24 15:47:50.769111 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:50.768948    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p9kvb"
Jul 24 15:47:51.468982 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:51.468737    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:51.469142 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:51.469094    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:51.611939 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:51.611889    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb" event={"ID":"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472","Type":"ContainerStarted","Data":"941eb19f9c2777581b98185e69bde872978acf91d213f89c868bd239bd81c795"}
Jul 24 15:47:51.613995 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:51.613958    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g" event={"ID":"6c6ae9c2-c974-424a-b3bf-3fac535eee78","Type":"ContainerStarted","Data":"8a457fdf5ab195e1f2eaa1a13bdfd7d7f2abe067ca951882d49cdb10b585dd73"}
Jul 24 15:47:51.614263 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:51.614241    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p9kvb"
Jul 24 15:47:51.614761 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:51.614741    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p9kvb"
Jul 24 15:47:51.632431 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:51.632375    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9n7g" podStartSLOduration=4.905864396 podStartE2EDuration="25.632357051s" totalImagesPullingTime="20.726492655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:47:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:47:51.631604348 +0000 UTC m=+25.694053535" watchObservedRunningTime="2026-07-24 15:47:51.632357051 +0000 UTC m=+25.694806237"
Jul 24 15:47:52.469004 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:52.468970    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:52.469495 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:52.469104    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:52.469495 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:52.469156    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:52.469495 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:52.469268    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:53.469051 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:53.468775    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:53.469607 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:53.469200    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:53.625033 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:53.624990    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb" event={"ID":"0d83ab12-4bc4-4b86-9ef2-94c9c8f56472","Type":"ContainerStarted","Data":"e5389a6dc108ca654180046f5f330072319b3b1a3e0e4700526be6e9fc9eee37"}
Jul 24 15:47:53.625344 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:53.625306    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:53.625496 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:53.625391    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:53.626889 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:53.626865    2553 generic.go:356] "Generic (PLEG): container finished" podID="464e984d-dae7-496c-a3b3-40bf169475c1" containerID="ea631a138dd702824a390d80713e9167b68f20c49661e57ea9715aa0b85007aa" exitCode=0
Jul 24 15:47:53.627001 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:53.626946    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4nr7" event={"ID":"464e984d-dae7-496c-a3b3-40bf169475c1","Type":"ContainerDied","Data":"ea631a138dd702824a390d80713e9167b68f20c49661e57ea9715aa0b85007aa"}
Jul 24 15:47:53.641036 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:53.641014    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:53.651267 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:53.651229    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb" podStartSLOduration=9.042839329 podStartE2EDuration="27.651216043s" totalImagesPullingTime="18.608376714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:47:53.65077772 +0000 UTC m=+27.713226918" watchObservedRunningTime="2026-07-24 15:47:53.651216043 +0000 UTC m=+27.713665230"
Jul 24 15:47:54.469538 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:54.469499    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:54.470007 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:54.469654    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:54.470007 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:54.469694    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:54.470007 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:54.469810    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:54.629372 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:54.629341    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:54.645043 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:54.645017    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:47:55.442696 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:55.442487    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r6vqh"]
Jul 24 15:47:55.442878 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:55.442863    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:55.443009 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:55.442988    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:55.445290 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:55.445266    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gfnfh"]
Jul 24 15:47:55.445412 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:55.445366    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:55.445484 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:55.445464    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:55.446129 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:55.446107    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mq5hc"]
Jul 24 15:47:55.446224 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:55.446211    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:55.446323 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:55.446295    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:55.633402 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:55.633364    2553 generic.go:356] "Generic (PLEG): container finished" podID="464e984d-dae7-496c-a3b3-40bf169475c1" containerID="d3117b139abc7b7f0b77a66989b067184bdb4ae60fef9d5c97941303e0d88a44" exitCode=0
Jul 24 15:47:55.633821 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:55.633430    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4nr7" event={"ID":"464e984d-dae7-496c-a3b3-40bf169475c1","Type":"ContainerDied","Data":"d3117b139abc7b7f0b77a66989b067184bdb4ae60fef9d5c97941303e0d88a44"}
Jul 24 15:47:57.468725 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:57.468699    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:57.469288 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:57.468699    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:57.469288 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:57.468835    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:57.469288 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:57.468699    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:57.469288 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:57.468908    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:47:57.469288 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:57.468990    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:57.640803 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:57.640707    2553 generic.go:356] "Generic (PLEG): container finished" podID="464e984d-dae7-496c-a3b3-40bf169475c1" containerID="e68ff622005bf8f98876bd1fa775dd90889b1b93e5346d47c83a835978767dd7" exitCode=0
Jul 24 15:47:57.640803 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:57.640768    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4nr7" event={"ID":"464e984d-dae7-496c-a3b3-40bf169475c1","Type":"ContainerDied","Data":"e68ff622005bf8f98876bd1fa775dd90889b1b93e5346d47c83a835978767dd7"}
Jul 24 15:47:59.468929 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:59.468882    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:47:59.469391 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:59.468882    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:47:59.469391 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:59.469011    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r6vqh" podUID="f5906871-c948-4d05-8433-4968968c6221"
Jul 24 15:47:59.469391 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:47:59.468882    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:47:59.469391 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:59.469073    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq5hc" podUID="46b9a741-240c-474f-8f54-323a430573bb"
Jul 24 15:47:59.469391 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:47:59.469155    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfnfh" podUID="a99759ef-4eee-46cb-ac25-cce29b9395b9"
Jul 24 15:48:00.089700 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.089643    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:48:00.089700 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.089707    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs\") pod \"network-metrics-daemon-r6vqh\" (UID: \"f5906871-c948-4d05-8433-4968968c6221\") " pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:48:00.090026 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:00.089815    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 15:48:00.090026 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:00.089881    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret podName:a99759ef-4eee-46cb-ac25-cce29b9395b9 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:32.089867112 +0000 UTC m=+66.152316277 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret") pod "global-pull-secret-syncer-gfnfh" (UID: "a99759ef-4eee-46cb-ac25-cce29b9395b9") : object "kube-system"/"original-pull-secret" not registered
Jul 24 15:48:00.090026 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:00.089825    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:48:00.090026 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:00.089965    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs podName:f5906871-c948-4d05-8433-4968968c6221 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:32.089949363 +0000 UTC m=+66.152398532 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs") pod "network-metrics-daemon-r6vqh" (UID: "f5906871-c948-4d05-8433-4968968c6221") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 15:48:00.290905 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.290864    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rcz8\" (UniqueName: \"kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8\") pod \"network-check-target-mq5hc\" (UID: \"46b9a741-240c-474f-8f54-323a430573bb\") " pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:48:00.291092 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:00.291003    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 15:48:00.291092 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:00.291022    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 15:48:00.291092 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:00.291031    2553 projected.go:196] Error preparing data for projected volume kube-api-access-8rcz8 for pod openshift-network-diagnostics/network-check-target-mq5hc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:48:00.291092 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:00.291085    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8 podName:46b9a741-240c-474f-8f54-323a430573bb nodeName:}" failed. No retries permitted until 2026-07-24 15:48:32.291069051 +0000 UTC m=+66.353518237 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rcz8" (UniqueName: "kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8") pod "network-check-target-mq5hc" (UID: "46b9a741-240c-474f-8f54-323a430573bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 15:48:00.752679 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.752647    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-199.ec2.internal" event="NodeReady"
Jul 24 15:48:00.753101 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.752804    2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 15:48:00.799101 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.799065    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8bjnx"]
Jul 24 15:48:00.801121 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.801101    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d2b52"]
Jul 24 15:48:00.801248 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.801234    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8bjnx"
Jul 24 15:48:00.803321 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.803301    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:00.803919 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.803897    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 15:48:00.803919 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.803914    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 15:48:00.804091 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.804009    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 15:48:00.804091 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.804018    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c9gpx\""
Jul 24 15:48:00.805788 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.805768    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-59fhg\""
Jul 24 15:48:00.805788 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.805782    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 15:48:00.806188 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.806165    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 15:48:00.812061 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.811998    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8bjnx"]
Jul 24 15:48:00.815402 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.815380    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d2b52"]
Jul 24 15:48:00.882860 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.882826    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-22qsx"]
Jul 24 15:48:00.885367 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.885344    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:00.888544 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.888524    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 15:48:00.888705 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.888606    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 15:48:00.889023 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.888929    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qb9zg\""
Jul 24 15:48:00.889144 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.889128    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 15:48:00.892215 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.892195    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 15:48:00.913777 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.913747    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-22qsx"]
Jul 24 15:48:00.996274 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.996241    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6e88dd-033b-464c-b91d-358f9d663a6b-tmp-dir\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:00.996449 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.996300    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:00.996449 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.996325    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/437ecf30-7657-426a-80f2-ff44ed6e8767-crio-socket\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:00.996449 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.996343    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/437ecf30-7657-426a-80f2-ff44ed6e8767-data-volume\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:00.996449 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.996363    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snpv8\" (UniqueName: \"kubernetes.io/projected/0a6e88dd-033b-464c-b91d-358f9d663a6b-kube-api-access-snpv8\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:00.996647 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.996468    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kmh9\" (UniqueName: \"kubernetes.io/projected/b491a835-1499-44d8-a137-17d10e042f5c-kube-api-access-6kmh9\") pod \"ingress-canary-8bjnx\" (UID: \"b491a835-1499-44d8-a137-17d10e042f5c\") " pod="openshift-ingress-canary/ingress-canary-8bjnx"
Jul 24 15:48:00.996647 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.996510    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:00.996647 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.996542    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:00.996647 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.996573    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxttr\" (UniqueName: \"kubernetes.io/projected/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-api-access-sxttr\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:00.996647 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.996610    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b491a835-1499-44d8-a137-17d10e042f5c-cert\") pod \"ingress-canary-8bjnx\" (UID: \"b491a835-1499-44d8-a137-17d10e042f5c\") " pod="openshift-ingress-canary/ingress-canary-8bjnx"
Jul 24 15:48:00.996647 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:00.996629    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a6e88dd-033b-464c-b91d-358f9d663a6b-config-volume\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:01.097770 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.097670    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:01.097770 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.097715    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/437ecf30-7657-426a-80f2-ff44ed6e8767-crio-socket\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:01.097770 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.097747    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/437ecf30-7657-426a-80f2-ff44ed6e8767-data-volume\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:01.097770 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.097770    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snpv8\" (UniqueName: \"kubernetes.io/projected/0a6e88dd-033b-464c-b91d-358f9d663a6b-kube-api-access-snpv8\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:01.098070 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.097841    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kmh9\" (UniqueName: \"kubernetes.io/projected/b491a835-1499-44d8-a137-17d10e042f5c-kube-api-access-6kmh9\") pod \"ingress-canary-8bjnx\" (UID: \"b491a835-1499-44d8-a137-17d10e042f5c\") " pod="openshift-ingress-canary/ingress-canary-8bjnx"
Jul 24 15:48:01.098070 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:01.097858    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 15:48:01.098070 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.097877    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:01.098070 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.097905    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:01.098070 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:01.097931    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls podName:0a6e88dd-033b-464c-b91d-358f9d663a6b nodeName:}" failed. No retries permitted until 2026-07-24 15:48:01.59791088 +0000 UTC m=+35.660360053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls") pod "dns-default-d2b52" (UID: "0a6e88dd-033b-464c-b91d-358f9d663a6b") : secret "dns-default-metrics-tls" not found
Jul 24 15:48:01.098070 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.097960    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxttr\" (UniqueName: \"kubernetes.io/projected/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-api-access-sxttr\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:01.098070 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.097985    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b491a835-1499-44d8-a137-17d10e042f5c-cert\") pod \"ingress-canary-8bjnx\" (UID: \"b491a835-1499-44d8-a137-17d10e042f5c\") " pod="openshift-ingress-canary/ingress-canary-8bjnx"
Jul 24 15:48:01.098070 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:01.097990    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 15:48:01.098070 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.097988    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/437ecf30-7657-426a-80f2-ff44ed6e8767-crio-socket\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:01.098070 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.098015    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a6e88dd-033b-464c-b91d-358f9d663a6b-config-volume\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:01.098070 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:01.098037    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls podName:437ecf30-7657-426a-80f2-ff44ed6e8767 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:01.59802476 +0000 UTC m=+35.660473929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22qsx" (UID: "437ecf30-7657-426a-80f2-ff44ed6e8767") : secret "insights-runtime-extractor-tls" not found
Jul 24 15:48:01.098070 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.098070    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6e88dd-033b-464c-b91d-358f9d663a6b-tmp-dir\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:01.098699 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.098119    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/437ecf30-7657-426a-80f2-ff44ed6e8767-data-volume\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:01.098699 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.098371    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6e88dd-033b-464c-b91d-358f9d663a6b-tmp-dir\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:01.098699 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:01.098450    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 15:48:01.098699 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:01.098574    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm podName:437ecf30-7657-426a-80f2-ff44ed6e8767 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:01.598559821 +0000 UTC m=+35.661008986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm") pod "insights-runtime-extractor-22qsx" (UID: "437ecf30-7657-426a-80f2-ff44ed6e8767") : configmap "kube-rbac-proxy" not found
Jul 24 15:48:01.098699 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.098598    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a6e88dd-033b-464c-b91d-358f9d663a6b-config-volume\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:01.102367 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.102271    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b491a835-1499-44d8-a137-17d10e042f5c-cert\") pod \"ingress-canary-8bjnx\" (UID: \"b491a835-1499-44d8-a137-17d10e042f5c\") " pod="openshift-ingress-canary/ingress-canary-8bjnx"
Jul 24 15:48:01.107046 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.107022    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxttr\" (UniqueName: \"kubernetes.io/projected/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-api-access-sxttr\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:01.107318 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.107243    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kmh9\" (UniqueName: \"kubernetes.io/projected/b491a835-1499-44d8-a137-17d10e042f5c-kube-api-access-6kmh9\") pod \"ingress-canary-8bjnx\" (UID: \"b491a835-1499-44d8-a137-17d10e042f5c\") " pod="openshift-ingress-canary/ingress-canary-8bjnx"
Jul 24 15:48:01.107415 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.107340    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snpv8\" (UniqueName: \"kubernetes.io/projected/0a6e88dd-033b-464c-b91d-358f9d663a6b-kube-api-access-snpv8\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:01.113954 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.113935    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8bjnx"
Jul 24 15:48:01.469143 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.469020    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:48:01.469143 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.469059    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:48:01.469143 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.469063    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:48:01.472194 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.472142    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k45mm\""
Jul 24 15:48:01.472500 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.472480    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 15:48:01.472626 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.472519    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 15:48:01.473327 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.473309    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 15:48:01.473327 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.473318    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 15:48:01.473480 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.473318    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w7pwm\""
Jul 24 15:48:01.602806 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.602774    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:01.602980 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.602818    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:01.602980 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:01.602875    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:01.602980 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:01.602899    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 15:48:01.602980 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:01.602970    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm podName:437ecf30-7657-426a-80f2-ff44ed6e8767 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:02.602948075 +0000 UTC m=+36.665397241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm") pod "insights-runtime-extractor-22qsx" (UID: "437ecf30-7657-426a-80f2-ff44ed6e8767") : configmap "kube-rbac-proxy" not found
Jul 24 15:48:01.603221 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:01.602999    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 15:48:01.603221 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:01.603006    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 15:48:01.603221 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:01.603058    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls podName:437ecf30-7657-426a-80f2-ff44ed6e8767 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:02.603040739 +0000 UTC m=+36.665489905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22qsx" (UID: "437ecf30-7657-426a-80f2-ff44ed6e8767") : secret "insights-runtime-extractor-tls" not found
Jul 24 15:48:01.603221 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:01.603081    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls podName:0a6e88dd-033b-464c-b91d-358f9d663a6b nodeName:}" failed. No retries permitted until 2026-07-24 15:48:02.603069786 +0000 UTC m=+36.665518976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls") pod "dns-default-d2b52" (UID: "0a6e88dd-033b-464c-b91d-358f9d663a6b") : secret "dns-default-metrics-tls" not found
Jul 24 15:48:02.610097 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:02.610064    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:02.610454 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:02.610103    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:02.610454 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:02.610153    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:02.610454 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:02.610184    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 15:48:02.610454 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:02.610246    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 15:48:02.610454 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:02.610251    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm podName:437ecf30-7657-426a-80f2-ff44ed6e8767 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:04.610231358 +0000 UTC m=+38.672680524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm") pod "insights-runtime-extractor-22qsx" (UID: "437ecf30-7657-426a-80f2-ff44ed6e8767") : configmap "kube-rbac-proxy" not found
Jul 24 15:48:02.610454 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:02.610305    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 15:48:02.610454 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:02.610306    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls podName:437ecf30-7657-426a-80f2-ff44ed6e8767 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:04.610288446 +0000 UTC m=+38.672737619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22qsx" (UID: "437ecf30-7657-426a-80f2-ff44ed6e8767") : secret "insights-runtime-extractor-tls" not found
Jul 24 15:48:02.610454 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:02.610357    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls podName:0a6e88dd-033b-464c-b91d-358f9d663a6b nodeName:}" failed. No retries permitted until 2026-07-24 15:48:04.610346423 +0000 UTC m=+38.672795595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls") pod "dns-default-d2b52" (UID: "0a6e88dd-033b-464c-b91d-358f9d663a6b") : secret "dns-default-metrics-tls" not found
Jul 24 15:48:02.704002 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:02.703974    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8bjnx"]
Jul 24 15:48:02.708536 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:48:02.708510    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb491a835_1499_44d8_a137_17d10e042f5c.slice/crio-334e88eebff6126031f84745b8ed4cffe2cec2a8f37a46ca0a80fbd7c052d250 WatchSource:0}: Error finding container 334e88eebff6126031f84745b8ed4cffe2cec2a8f37a46ca0a80fbd7c052d250: Status 404 returned error can't find the container with id 334e88eebff6126031f84745b8ed4cffe2cec2a8f37a46ca0a80fbd7c052d250
Jul 24 15:48:02.874881 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:02.874847    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ljfg6_34acff67-e6d0-4c76-b011-4280b5935771/dns-node-resolver/0.log"
Jul 24 15:48:03.659162 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:03.658949    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8bjnx" event={"ID":"b491a835-1499-44d8-a137-17d10e042f5c","Type":"ContainerStarted","Data":"334e88eebff6126031f84745b8ed4cffe2cec2a8f37a46ca0a80fbd7c052d250"}
Jul 24 15:48:03.662348 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:03.662319    2553 generic.go:356] "Generic (PLEG): container finished" podID="464e984d-dae7-496c-a3b3-40bf169475c1" containerID="2cf3ea52c4cba5de03e81fd713f7478cec8fa4f17d3f16d7c2c6772e4ba2791a" exitCode=0
Jul 24 15:48:03.662474 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:03.662386    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4nr7" event={"ID":"464e984d-dae7-496c-a3b3-40bf169475c1","Type":"ContainerDied","Data":"2cf3ea52c4cba5de03e81fd713f7478cec8fa4f17d3f16d7c2c6772e4ba2791a"}
Jul 24 15:48:03.875064 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:03.875030    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j5x8q_e1c36bc9-7991-4a81-99ab-e00758772a24/node-ca/0.log"
Jul 24 15:48:04.210383 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.210350    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-bl22n"]
Jul 24 15:48:04.214157 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.214130    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bl22n"
Jul 24 15:48:04.217051 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.217028    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 24 15:48:04.217200 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.217028    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 24 15:48:04.217200 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.217113    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jdmc2\""
Jul 24 15:48:04.222058 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.222035    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-bl22n"]
Jul 24 15:48:04.224022 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.224000    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9kq6\" (UniqueName: \"kubernetes.io/projected/0f13ce96-2b3b-40e8-8547-4a9e44b25cbd-kube-api-access-t9kq6\") pod \"migrator-6865c9967-bl22n\" (UID: \"0f13ce96-2b3b-40e8-8547-4a9e44b25cbd\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bl22n"
Jul 24 15:48:04.324553 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.324516    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9kq6\" (UniqueName: \"kubernetes.io/projected/0f13ce96-2b3b-40e8-8547-4a9e44b25cbd-kube-api-access-t9kq6\") pod \"migrator-6865c9967-bl22n\" (UID: \"0f13ce96-2b3b-40e8-8547-4a9e44b25cbd\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bl22n"
Jul 24 15:48:04.335085 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.335052    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9kq6\" (UniqueName: \"kubernetes.io/projected/0f13ce96-2b3b-40e8-8547-4a9e44b25cbd-kube-api-access-t9kq6\") pod \"migrator-6865c9967-bl22n\" (UID: \"0f13ce96-2b3b-40e8-8547-4a9e44b25cbd\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bl22n"
Jul 24 15:48:04.524651 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.524612    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bl22n"
Jul 24 15:48:04.627219 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.627142    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:04.627219 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.627200    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:04.627488 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:04.627232    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 15:48:04.627488 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.627255    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:04.627488 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:04.627297    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm podName:437ecf30-7657-426a-80f2-ff44ed6e8767 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:08.627277574 +0000 UTC m=+42.689726759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm") pod "insights-runtime-extractor-22qsx" (UID: "437ecf30-7657-426a-80f2-ff44ed6e8767") : configmap "kube-rbac-proxy" not found
Jul 24 15:48:04.627488 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:04.627337    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 15:48:04.627488 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:04.627400    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls podName:437ecf30-7657-426a-80f2-ff44ed6e8767 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:08.627382097 +0000 UTC m=+42.689831265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22qsx" (UID: "437ecf30-7657-426a-80f2-ff44ed6e8767") : secret "insights-runtime-extractor-tls" not found
Jul 24 15:48:04.627488 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:04.627345    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 15:48:04.627488 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:04.627448    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls podName:0a6e88dd-033b-464c-b91d-358f9d663a6b nodeName:}" failed. No retries permitted until 2026-07-24 15:48:08.627437636 +0000 UTC m=+42.689886816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls") pod "dns-default-d2b52" (UID: "0a6e88dd-033b-464c-b91d-358f9d663a6b") : secret "dns-default-metrics-tls" not found
Jul 24 15:48:04.668258 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.668228    2553 generic.go:356] "Generic (PLEG): container finished" podID="464e984d-dae7-496c-a3b3-40bf169475c1" containerID="c7a493f612996c1143960aaa10417e43a0761fdef1ca2a5db264332e2a0a980a" exitCode=0
Jul 24 15:48:04.668860 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:04.668296    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4nr7" event={"ID":"464e984d-dae7-496c-a3b3-40bf169475c1","Type":"ContainerDied","Data":"c7a493f612996c1143960aaa10417e43a0761fdef1ca2a5db264332e2a0a980a"}
Jul 24 15:48:05.096724 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.096628    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-bl22n"]
Jul 24 15:48:05.099772 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:48:05.099743    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f13ce96_2b3b_40e8_8547_4a9e44b25cbd.slice/crio-eb4bdff4e7edfeb18bac05aba917f2e2cb3c8c723b380f925548226ce95a65e2 WatchSource:0}: Error finding container eb4bdff4e7edfeb18bac05aba917f2e2cb3c8c723b380f925548226ce95a65e2: Status 404 returned error can't find the container with id eb4bdff4e7edfeb18bac05aba917f2e2cb3c8c723b380f925548226ce95a65e2
Jul 24 15:48:05.672758 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.672658    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8bjnx" event={"ID":"b491a835-1499-44d8-a137-17d10e042f5c","Type":"ContainerStarted","Data":"d6d610c7b68562f02d596bd55fe4e42dca86f92b341b7a84456701275e41c185"}
Jul 24 15:48:05.673882 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.673850    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bl22n" event={"ID":"0f13ce96-2b3b-40e8-8547-4a9e44b25cbd","Type":"ContainerStarted","Data":"eb4bdff4e7edfeb18bac05aba917f2e2cb3c8c723b380f925548226ce95a65e2"}
Jul 24 15:48:05.676784 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.676764    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4nr7" event={"ID":"464e984d-dae7-496c-a3b3-40bf169475c1","Type":"ContainerStarted","Data":"c51a2325b474890562aad1ec950a7128923a41bf15e2995732ac47195e187e1c"}
Jul 24 15:48:05.691389 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.691348    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8bjnx" podStartSLOduration=3.093203184 podStartE2EDuration="5.69133489s" totalImagesPullingTime="2.598131706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:48:05.690434598 +0000 UTC m=+39.752883782" watchObservedRunningTime="2026-07-24 15:48:05.69133489 +0000 UTC m=+39.753784055"
Jul 24 15:48:05.697314 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.697290    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hdfbd"]
Jul 24 15:48:05.712894 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.712869    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hdfbd"]
Jul 24 15:48:05.713046 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.712979    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-hdfbd"
Jul 24 15:48:05.715878 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.715852    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zmbq6\""
Jul 24 15:48:05.716012 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.715901    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 24 15:48:05.716012 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.715895    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 24 15:48:05.716012 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.715879    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 24 15:48:05.716178 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.716016    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 24 15:48:05.721694 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.721643    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v4nr7" podStartSLOduration=9.177161999 podStartE2EDuration="39.721625863s" totalImagesPullingTime="30.544463864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:47:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:48:05.720307414 +0000 UTC m=+39.782756626" watchObservedRunningTime="2026-07-24 15:48:05.721625863 +0000 UTC m=+39.784075053"
Jul 24 15:48:05.737280 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.737247    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp7hz\" (UniqueName: \"kubernetes.io/projected/57d043d7-3db5-4cb7-bc06-28afa03257b5-kube-api-access-pp7hz\") pod \"service-ca-658d7b7c78-hdfbd\" (UID: \"57d043d7-3db5-4cb7-bc06-28afa03257b5\") " pod="openshift-service-ca/service-ca-658d7b7c78-hdfbd"
Jul 24 15:48:05.737457 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.737322    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/57d043d7-3db5-4cb7-bc06-28afa03257b5-signing-key\") pod \"service-ca-658d7b7c78-hdfbd\" (UID: \"57d043d7-3db5-4cb7-bc06-28afa03257b5\") " pod="openshift-service-ca/service-ca-658d7b7c78-hdfbd"
Jul 24 15:48:05.737564 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.737543    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/57d043d7-3db5-4cb7-bc06-28afa03257b5-signing-cabundle\") pod \"service-ca-658d7b7c78-hdfbd\" (UID: \"57d043d7-3db5-4cb7-bc06-28afa03257b5\") " pod="openshift-service-ca/service-ca-658d7b7c78-hdfbd"
Jul 24 15:48:05.838048 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.838011    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp7hz\" (UniqueName: \"kubernetes.io/projected/57d043d7-3db5-4cb7-bc06-28afa03257b5-kube-api-access-pp7hz\") pod \"service-ca-658d7b7c78-hdfbd\" (UID: \"57d043d7-3db5-4cb7-bc06-28afa03257b5\") " pod="openshift-service-ca/service-ca-658d7b7c78-hdfbd"
Jul 24 15:48:05.838048 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.838053    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/57d043d7-3db5-4cb7-bc06-28afa03257b5-signing-key\") pod \"service-ca-658d7b7c78-hdfbd\" (UID: \"57d043d7-3db5-4cb7-bc06-28afa03257b5\") " pod="openshift-service-ca/service-ca-658d7b7c78-hdfbd"
Jul 24 15:48:05.838301 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.838106    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/57d043d7-3db5-4cb7-bc06-28afa03257b5-signing-cabundle\") pod \"service-ca-658d7b7c78-hdfbd\" (UID: \"57d043d7-3db5-4cb7-bc06-28afa03257b5\") " pod="openshift-service-ca/service-ca-658d7b7c78-hdfbd"
Jul 24 15:48:05.838923 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.838897    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/57d043d7-3db5-4cb7-bc06-28afa03257b5-signing-cabundle\") pod \"service-ca-658d7b7c78-hdfbd\" (UID: \"57d043d7-3db5-4cb7-bc06-28afa03257b5\") " pod="openshift-service-ca/service-ca-658d7b7c78-hdfbd"
Jul 24 15:48:05.842065 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.842034    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/57d043d7-3db5-4cb7-bc06-28afa03257b5-signing-key\") pod \"service-ca-658d7b7c78-hdfbd\" (UID: \"57d043d7-3db5-4cb7-bc06-28afa03257b5\") " pod="openshift-service-ca/service-ca-658d7b7c78-hdfbd"
Jul 24 15:48:05.846515 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:05.846490    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp7hz\" (UniqueName: \"kubernetes.io/projected/57d043d7-3db5-4cb7-bc06-28afa03257b5-kube-api-access-pp7hz\") pod \"service-ca-658d7b7c78-hdfbd\" (UID: \"57d043d7-3db5-4cb7-bc06-28afa03257b5\") " pod="openshift-service-ca/service-ca-658d7b7c78-hdfbd"
Jul 24 15:48:06.023314 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:06.023275    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-hdfbd"
Jul 24 15:48:06.170363 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:06.170326    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hdfbd"]
Jul 24 15:48:06.423235 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:48:06.423169    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d043d7_3db5_4cb7_bc06_28afa03257b5.slice/crio-ef1a5ba1aff34e4d54ed53ff5e84c55f182b094108eba1cb4e095f0492b2ce19 WatchSource:0}: Error finding container ef1a5ba1aff34e4d54ed53ff5e84c55f182b094108eba1cb4e095f0492b2ce19: Status 404 returned error can't find the container with id ef1a5ba1aff34e4d54ed53ff5e84c55f182b094108eba1cb4e095f0492b2ce19
Jul 24 15:48:06.680567 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:06.680485    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-hdfbd" event={"ID":"57d043d7-3db5-4cb7-bc06-28afa03257b5","Type":"ContainerStarted","Data":"ef1a5ba1aff34e4d54ed53ff5e84c55f182b094108eba1cb4e095f0492b2ce19"}
Jul 24 15:48:07.685454 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:07.685415    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bl22n" event={"ID":"0f13ce96-2b3b-40e8-8547-4a9e44b25cbd","Type":"ContainerStarted","Data":"088a3dac69161b1dde3c5c1b7b1eb10b62c2b93c088c2bc293f1ff3ed3fa13d0"}
Jul 24 15:48:07.685928 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:07.685516    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bl22n" event={"ID":"0f13ce96-2b3b-40e8-8547-4a9e44b25cbd","Type":"ContainerStarted","Data":"ac31633a9163c198a8a87bff019c4757e3c8d4fcb7888568fa3fd1b6f6ab9fc3"}
Jul 24 15:48:07.701730 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:07.701668    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bl22n" podStartSLOduration=2.027716465 podStartE2EDuration="3.70165278s" totalImagesPullingTime="1.673936315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:48:07.700747293 +0000 UTC m=+41.763196480" watchObservedRunningTime="2026-07-24 15:48:07.70165278 +0000 UTC m=+41.764102024"
Jul 24 15:48:08.662661 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:08.662605    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:08.662661 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:08.662661    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:08.662909 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:08.662720    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:08.662909 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:08.662731    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 15:48:08.662909 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:08.662807    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm podName:437ecf30-7657-426a-80f2-ff44ed6e8767 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:16.662787122 +0000 UTC m=+50.725236351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm") pod "insights-runtime-extractor-22qsx" (UID: "437ecf30-7657-426a-80f2-ff44ed6e8767") : configmap "kube-rbac-proxy" not found
Jul 24 15:48:08.662909 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:08.662836    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 15:48:08.662909 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:08.662854    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 15:48:08.662909 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:08.662896    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls podName:0a6e88dd-033b-464c-b91d-358f9d663a6b nodeName:}" failed. No retries permitted until 2026-07-24 15:48:16.662881518 +0000 UTC m=+50.725330690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls") pod "dns-default-d2b52" (UID: "0a6e88dd-033b-464c-b91d-358f9d663a6b") : secret "dns-default-metrics-tls" not found
Jul 24 15:48:08.662909 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:08.662909    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls podName:437ecf30-7657-426a-80f2-ff44ed6e8767 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:16.662903039 +0000 UTC m=+50.725352207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22qsx" (UID: "437ecf30-7657-426a-80f2-ff44ed6e8767") : secret "insights-runtime-extractor-tls" not found
Jul 24 15:48:09.693687 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:09.693654    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-hdfbd" event={"ID":"57d043d7-3db5-4cb7-bc06-28afa03257b5","Type":"ContainerStarted","Data":"af3b7a615d2cdb690e02c4301cdd39a5a0df38b1039af301d501202e82ca1759"}
Jul 24 15:48:09.710668 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:09.710612    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-hdfbd" podStartSLOduration=1.918868016 podStartE2EDuration="4.710577133s" totalImagesPullingTime="2.791709117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:48:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:48:09.709830086 +0000 UTC m=+43.772279291" watchObservedRunningTime="2026-07-24 15:48:09.710577133 +0000 UTC m=+43.773026344"
Jul 24 15:48:16.725912 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:16.725867    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:16.725912 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:16.725914    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:16.726412 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:16.726026    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:16.726412 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:16.726156    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 15:48:16.726412 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:48:16.726220    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls podName:437ecf30-7657-426a-80f2-ff44ed6e8767 nodeName:}" failed. No retries permitted until 2026-07-24 15:48:32.726203971 +0000 UTC m=+66.788653135 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22qsx" (UID: "437ecf30-7657-426a-80f2-ff44ed6e8767") : secret "insights-runtime-extractor-tls" not found
Jul 24 15:48:16.726526 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:16.726488    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/437ecf30-7657-426a-80f2-ff44ed6e8767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:16.737426 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:16.737398    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a6e88dd-033b-464c-b91d-358f9d663a6b-metrics-tls\") pod \"dns-default-d2b52\" (UID: \"0a6e88dd-033b-464c-b91d-358f9d663a6b\") " pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:17.022029 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:17.021993    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:17.159959 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:17.159929    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d2b52"]
Jul 24 15:48:17.714182 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:17.714150    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d2b52" event={"ID":"0a6e88dd-033b-464c-b91d-358f9d663a6b","Type":"ContainerStarted","Data":"b9c88fd580679d02a44bbfdce82745d6e9fb04eaa776d67ab685ff43c9c7f9cc"}
Jul 24 15:48:19.722374 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:19.722349    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d2b52" event={"ID":"0a6e88dd-033b-464c-b91d-358f9d663a6b","Type":"ContainerStarted","Data":"eb44f56253842ae14fc44ce6c00820b9c72f69c1752c8e483f1129fdc26ba883"}
Jul 24 15:48:20.728033 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:20.727996    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d2b52" event={"ID":"0a6e88dd-033b-464c-b91d-358f9d663a6b","Type":"ContainerStarted","Data":"c384d9c05e57dde11ec6917f73b098ec48d439f58507b4f09967ae7a297b427c"}
Jul 24 15:48:20.728548 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:20.728125    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:20.744614 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:20.744543    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d2b52" podStartSLOduration=18.39121994 podStartE2EDuration="20.744525948s" totalImagesPullingTime="2.353306008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:48:20.744263177 +0000 UTC m=+54.806712382" watchObservedRunningTime="2026-07-24 15:48:20.744525948 +0000 UTC m=+54.806975137"
Jul 24 15:48:25.115357 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.115321    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665b584f78-d67lr"]
Jul 24 15:48:25.118116 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.118098    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665b584f78-d67lr"
Jul 24 15:48:25.121712 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.121688    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 15:48:25.123135 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.123111    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 15:48:25.123135 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.123124    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 24 15:48:25.123311 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.123126    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-v8kdr\""
Jul 24 15:48:25.123311 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.123215    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 15:48:25.124140 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.124121    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"]
Jul 24 15:48:25.126964 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.126948    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.130373 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.130321    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 24 15:48:25.130567 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.130555    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 24 15:48:25.130704 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.130689    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 24 15:48:25.131346 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.131333    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 24 15:48:25.140209 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.140188    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665b584f78-d67lr"]
Jul 24 15:48:25.150404 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.150378    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"]
Jul 24 15:48:25.189035 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.189000    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ec903772-938f-4bf2-8bc7-f3f08c4d5433-ca\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.189035 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.189038    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bjsd\" (UniqueName: \"kubernetes.io/projected/ec903772-938f-4bf2-8bc7-f3f08c4d5433-kube-api-access-7bjsd\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.189227 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.189122    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec903772-938f-4bf2-8bc7-f3f08c4d5433-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.189227 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.189157    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ec903772-938f-4bf2-8bc7-f3f08c4d5433-hub\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.189227 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.189177    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec903772-938f-4bf2-8bc7-f3f08c4d5433-additional-service-ca\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.189227 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.189194    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ec903772-938f-4bf2-8bc7-f3f08c4d5433-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.189227 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.189214    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fc6d60d5-a27a-4898-a53d-23358adf796d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-665b584f78-d67lr\" (UID: \"fc6d60d5-a27a-4898-a53d-23358adf796d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665b584f78-d67lr"
Jul 24 15:48:25.189375 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.189229    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvghk\" (UniqueName: \"kubernetes.io/projected/fc6d60d5-a27a-4898-a53d-23358adf796d-kube-api-access-gvghk\") pod \"managed-serviceaccount-addon-agent-665b584f78-d67lr\" (UID: \"fc6d60d5-a27a-4898-a53d-23358adf796d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665b584f78-d67lr"
Jul 24 15:48:25.290605 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.290551    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec903772-938f-4bf2-8bc7-f3f08c4d5433-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.290605 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.290597    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ec903772-938f-4bf2-8bc7-f3f08c4d5433-hub\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.290811 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.290620    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec903772-938f-4bf2-8bc7-f3f08c4d5433-additional-service-ca\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.290811 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.290663    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ec903772-938f-4bf2-8bc7-f3f08c4d5433-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.290811 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.290691    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fc6d60d5-a27a-4898-a53d-23358adf796d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-665b584f78-d67lr\" (UID: \"fc6d60d5-a27a-4898-a53d-23358adf796d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665b584f78-d67lr"
Jul 24 15:48:25.290811 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.290715    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvghk\" (UniqueName: \"kubernetes.io/projected/fc6d60d5-a27a-4898-a53d-23358adf796d-kube-api-access-gvghk\") pod \"managed-serviceaccount-addon-agent-665b584f78-d67lr\" (UID: \"fc6d60d5-a27a-4898-a53d-23358adf796d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665b584f78-d67lr"
Jul 24 15:48:25.291163 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.290976    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ec903772-938f-4bf2-8bc7-f3f08c4d5433-ca\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.291163 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.291028    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bjsd\" (UniqueName: \"kubernetes.io/projected/ec903772-938f-4bf2-8bc7-f3f08c4d5433-kube-api-access-7bjsd\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.291574 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.291540    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec903772-938f-4bf2-8bc7-f3f08c4d5433-additional-service-ca\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.293383 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.293360    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ec903772-938f-4bf2-8bc7-f3f08c4d5433-hub\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.293697 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.293676    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ec903772-938f-4bf2-8bc7-f3f08c4d5433-ca\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.293764 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.293747    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec903772-938f-4bf2-8bc7-f3f08c4d5433-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.293827 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.293809    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ec903772-938f-4bf2-8bc7-f3f08c4d5433-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.293892 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.293869    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fc6d60d5-a27a-4898-a53d-23358adf796d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-665b584f78-d67lr\" (UID: \"fc6d60d5-a27a-4898-a53d-23358adf796d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665b584f78-d67lr"
Jul 24 15:48:25.306711 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.306681    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvghk\" (UniqueName: \"kubernetes.io/projected/fc6d60d5-a27a-4898-a53d-23358adf796d-kube-api-access-gvghk\") pod \"managed-serviceaccount-addon-agent-665b584f78-d67lr\" (UID: \"fc6d60d5-a27a-4898-a53d-23358adf796d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665b584f78-d67lr"
Jul 24 15:48:25.306849 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.306762    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bjsd\" (UniqueName: \"kubernetes.io/projected/ec903772-938f-4bf2-8bc7-f3f08c4d5433-kube-api-access-7bjsd\") pod \"cluster-proxy-proxy-agent-544b8c7cd4-f6g9k\" (UID: \"ec903772-938f-4bf2-8bc7-f3f08c4d5433\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.439468 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.439387    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665b584f78-d67lr"
Jul 24 15:48:25.446560 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.446522    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"
Jul 24 15:48:25.612921 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.612888    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665b584f78-d67lr"]
Jul 24 15:48:25.616006 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:48:25.615977    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc6d60d5_a27a_4898_a53d_23358adf796d.slice/crio-ca8c0051db1a921c36b08934560c4e03d7a36812297806f7603849cd431c86dc WatchSource:0}: Error finding container ca8c0051db1a921c36b08934560c4e03d7a36812297806f7603849cd431c86dc: Status 404 returned error can't find the container with id ca8c0051db1a921c36b08934560c4e03d7a36812297806f7603849cd431c86dc
Jul 24 15:48:25.632891 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.632864    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k"]
Jul 24 15:48:25.635485 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:48:25.635452    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec903772_938f_4bf2_8bc7_f3f08c4d5433.slice/crio-0ab36c4e067a34d9d62bda3c792ba231fd122c151a3a646bb8ba60e80be301b0 WatchSource:0}: Error finding container 0ab36c4e067a34d9d62bda3c792ba231fd122c151a3a646bb8ba60e80be301b0: Status 404 returned error can't find the container with id 0ab36c4e067a34d9d62bda3c792ba231fd122c151a3a646bb8ba60e80be301b0
Jul 24 15:48:25.746629 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.746577    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k" event={"ID":"ec903772-938f-4bf2-8bc7-f3f08c4d5433","Type":"ContainerStarted","Data":"0ab36c4e067a34d9d62bda3c792ba231fd122c151a3a646bb8ba60e80be301b0"}
Jul 24 15:48:25.747638 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:25.747613    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665b584f78-d67lr" event={"ID":"fc6d60d5-a27a-4898-a53d-23358adf796d","Type":"ContainerStarted","Data":"ca8c0051db1a921c36b08934560c4e03d7a36812297806f7603849cd431c86dc"}
Jul 24 15:48:26.663774 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:26.663731    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2djb"
Jul 24 15:48:29.766773 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:29.766738    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665b584f78-d67lr" event={"ID":"fc6d60d5-a27a-4898-a53d-23358adf796d","Type":"ContainerStarted","Data":"0193afa8b7a7aa56e977964b668b7af9c9124d9edeffd1a82dc3221898e9c106"}
Jul 24 15:48:29.768871 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:29.768841    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k" event={"ID":"ec903772-938f-4bf2-8bc7-f3f08c4d5433","Type":"ContainerStarted","Data":"03c9a4a7258fd5b33ac19b352ca5ef3d5fe92c5e37ff4836554b27122a4ad1be"}
Jul 24 15:48:29.782336 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:29.782275    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665b584f78-d67lr" podStartSLOduration=0.711568802 podStartE2EDuration="4.782253904s" totalImagesPullingTime="4.070685102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:48:29.780647032 +0000 UTC m=+63.843096238" watchObservedRunningTime="2026-07-24 15:48:29.782253904 +0000 UTC m=+63.844703096"
Jul 24 15:48:30.736006 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:30.735972    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d2b52"
Jul 24 15:48:30.773925 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:30.773886    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k" event={"ID":"ec903772-938f-4bf2-8bc7-f3f08c4d5433","Type":"ContainerStarted","Data":"0d6b1369a01bdc85cc0c3bc85d0d69367b97087ef611b52046df4691ed392650"}
Jul 24 15:48:30.774291 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:30.773936    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k" event={"ID":"ec903772-938f-4bf2-8bc7-f3f08c4d5433","Type":"ContainerStarted","Data":"2bb532b107dd73c1f9638a2832573b922197bdde8ea97751bb6237e9cdd2ebc8"}
Jul 24 15:48:30.791922 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:30.791871    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-544b8c7cd4-f6g9k" podStartSLOduration=1.7301616850000001 podStartE2EDuration="5.791856275s" totalImagesPullingTime="4.06169459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:48:30.790903327 +0000 UTC m=+64.853352516" watchObservedRunningTime="2026-07-24 15:48:30.791856275 +0000 UTC m=+64.854305461"
Jul 24 15:48:32.148818 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.148773    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:48:32.148818 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.148822    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs\") pod \"network-metrics-daemon-r6vqh\" (UID: \"f5906871-c948-4d05-8433-4968968c6221\") " pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:48:32.151485 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.151469    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 15:48:32.152677 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.152662    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 15:48:32.162023 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.161994    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5906871-c948-4d05-8433-4968968c6221-metrics-certs\") pod \"network-metrics-daemon-r6vqh\" (UID: \"f5906871-c948-4d05-8433-4968968c6221\") " pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:48:32.162132 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.162020    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a99759ef-4eee-46cb-ac25-cce29b9395b9-original-pull-secret\") pod \"global-pull-secret-syncer-gfnfh\" (UID: \"a99759ef-4eee-46cb-ac25-cce29b9395b9\") " pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:48:32.350602 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.350544    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rcz8\" (UniqueName: \"kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8\") pod \"network-check-target-mq5hc\" (UID: \"46b9a741-240c-474f-8f54-323a430573bb\") " pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:48:32.353634 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.353615    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 15:48:32.363728 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.363707    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 15:48:32.374613 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.374563    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rcz8\" (UniqueName: \"kubernetes.io/projected/46b9a741-240c-474f-8f54-323a430573bb-kube-api-access-8rcz8\") pod \"network-check-target-mq5hc\" (UID: \"46b9a741-240c-474f-8f54-323a430573bb\") " pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:48:32.382717 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.382693    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k45mm\""
Jul 24 15:48:32.389440 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.389421    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w7pwm\""
Jul 24 15:48:32.390451 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.390432    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r6vqh"
Jul 24 15:48:32.393665 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.393648    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfnfh"
Jul 24 15:48:32.397905 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.397893    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:48:32.561673 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.561637    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r6vqh"]
Jul 24 15:48:32.564769 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:48:32.564617    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5906871_c948_4d05_8433_4968968c6221.slice/crio-2c74cf844fcf24ebf899454ff869b053264e0299ba32b2056cc493533c180360 WatchSource:0}: Error finding container 2c74cf844fcf24ebf899454ff869b053264e0299ba32b2056cc493533c180360: Status 404 returned error can't find the container with id 2c74cf844fcf24ebf899454ff869b053264e0299ba32b2056cc493533c180360
Jul 24 15:48:32.565295 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.565271    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gfnfh"]
Jul 24 15:48:32.568576 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:48:32.568554    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda99759ef_4eee_46cb_ac25_cce29b9395b9.slice/crio-9dd26190926fd7181dedd7c05fc5421028bb70a10b114e78318e3bb545b8dae8 WatchSource:0}: Error finding container 9dd26190926fd7181dedd7c05fc5421028bb70a10b114e78318e3bb545b8dae8: Status 404 returned error can't find the container with id 9dd26190926fd7181dedd7c05fc5421028bb70a10b114e78318e3bb545b8dae8
Jul 24 15:48:32.588899 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.588870    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mq5hc"]
Jul 24 15:48:32.592151 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:48:32.592125    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b9a741_240c_474f_8f54_323a430573bb.slice/crio-76ee75c7d98052b441ecdee38059a2215b5a03d94727d90df8f536d8557414d5 WatchSource:0}: Error finding container 76ee75c7d98052b441ecdee38059a2215b5a03d94727d90df8f536d8557414d5: Status 404 returned error can't find the container with id 76ee75c7d98052b441ecdee38059a2215b5a03d94727d90df8f536d8557414d5
Jul 24 15:48:32.754375 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.754339    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:32.756708 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.756685    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/437ecf30-7657-426a-80f2-ff44ed6e8767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22qsx\" (UID: \"437ecf30-7657-426a-80f2-ff44ed6e8767\") " pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:32.781330 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.781294    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gfnfh" event={"ID":"a99759ef-4eee-46cb-ac25-cce29b9395b9","Type":"ContainerStarted","Data":"9dd26190926fd7181dedd7c05fc5421028bb70a10b114e78318e3bb545b8dae8"}
Jul 24 15:48:32.782450 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.782422    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mq5hc" event={"ID":"46b9a741-240c-474f-8f54-323a430573bb","Type":"ContainerStarted","Data":"76ee75c7d98052b441ecdee38059a2215b5a03d94727d90df8f536d8557414d5"}
Jul 24 15:48:32.783476 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.783448    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r6vqh" event={"ID":"f5906871-c948-4d05-8433-4968968c6221","Type":"ContainerStarted","Data":"2c74cf844fcf24ebf899454ff869b053264e0299ba32b2056cc493533c180360"}
Jul 24 15:48:32.998942 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:32.998911    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qb9zg\""
Jul 24 15:48:33.006531 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:33.006450    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-22qsx"
Jul 24 15:48:33.186401 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:33.186310    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-22qsx"]
Jul 24 15:48:33.202904 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:48:33.202872    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod437ecf30_7657_426a_80f2_ff44ed6e8767.slice/crio-40387c85e0f72e2594dcbb98dd9d9b9b60c051c0bfb8852668120fb467867899 WatchSource:0}: Error finding container 40387c85e0f72e2594dcbb98dd9d9b9b60c051c0bfb8852668120fb467867899: Status 404 returned error can't find the container with id 40387c85e0f72e2594dcbb98dd9d9b9b60c051c0bfb8852668120fb467867899
Jul 24 15:48:33.789447 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:33.789410    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-22qsx" event={"ID":"437ecf30-7657-426a-80f2-ff44ed6e8767","Type":"ContainerStarted","Data":"40387c85e0f72e2594dcbb98dd9d9b9b60c051c0bfb8852668120fb467867899"}
Jul 24 15:48:34.815809 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:34.815762    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r6vqh" event={"ID":"f5906871-c948-4d05-8433-4968968c6221","Type":"ContainerStarted","Data":"685200d0a29c73fce05695a45321b37da2eb48de9fbdd13c65de85ebeef35635"}
Jul 24 15:48:34.816290 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:34.815875    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r6vqh" event={"ID":"f5906871-c948-4d05-8433-4968968c6221","Type":"ContainerStarted","Data":"daec4bd8fa65da333721ecf4834ccaaa1da2137f4730dc6c9aafd03e45dfb974"}
Jul 24 15:48:34.833352 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:34.833171    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r6vqh" podStartSLOduration=67.466579201 podStartE2EDuration="1m8.83314841s" totalImagesPullingTime="1.366569209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:48:34.830970668 +0000 UTC m=+68.893419856" watchObservedRunningTime="2026-07-24 15:48:34.83314841 +0000 UTC m=+68.895597600"
Jul 24 15:48:41.844710 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:41.844675    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gfnfh" event={"ID":"a99759ef-4eee-46cb-ac25-cce29b9395b9","Type":"ContainerStarted","Data":"79ad5c9b2fd66471a938fc89b8e48203dbcc93fb6dbe5f6714706c3544c735b6"}
Jul 24 15:48:41.846128 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:41.846102    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mq5hc" event={"ID":"46b9a741-240c-474f-8f54-323a430573bb","Type":"ContainerStarted","Data":"ba2010a34ee9355a022bc27c3344a78dd1d0378969985aba273949f9bd9a8c1b"}
Jul 24 15:48:41.846254 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:41.846156    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:48:41.847509 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:41.847487    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-22qsx" event={"ID":"437ecf30-7657-426a-80f2-ff44ed6e8767","Type":"ContainerStarted","Data":"3c42833d33139036019dd45667c011923644b47add6c1dcd3780db9fce89dec6"}
Jul 24 15:48:41.861629 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:41.861547    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gfnfh" podStartSLOduration=67.217845351 podStartE2EDuration="1m15.861531585s" totalImagesPullingTime="8.643686234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:48:41.861037579 +0000 UTC m=+75.923486767" watchObservedRunningTime="2026-07-24 15:48:41.861531585 +0000 UTC m=+75.923980771"
Jul 24 15:48:41.877363 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:41.877302    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mq5hc" podStartSLOduration=67.25717225 podStartE2EDuration="1m15.877282117s" totalImagesPullingTime="8.620109867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:48:41.876831635 +0000 UTC m=+75.939280836" watchObservedRunningTime="2026-07-24 15:48:41.877282117 +0000 UTC m=+75.939731308"
Jul 24 15:48:44.859660 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:44.859629    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-22qsx" event={"ID":"437ecf30-7657-426a-80f2-ff44ed6e8767","Type":"ContainerStarted","Data":"b55406e2e9298079a5ea1fafc02088f4cc61fb02f78ec39841f3f88d135cb589"}
Jul 24 15:48:48.877412 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:48.877373    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-22qsx" event={"ID":"437ecf30-7657-426a-80f2-ff44ed6e8767","Type":"ContainerStarted","Data":"e83bebf77b2a68a694d985c4e0bb71513567d920f461fa62dec1166388346a63"}
Jul 24 15:48:48.894547 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:48.894495    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-22qsx" podStartSLOduration=33.930152146 podStartE2EDuration="48.894480757s" totalImagesPullingTime="14.964328611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:48:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:48:48.893567134 +0000 UTC m=+82.956016341" watchObservedRunningTime="2026-07-24 15:48:48.894480757 +0000 UTC m=+82.956929952"
Jul 24 15:48:56.956037 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:56.955999    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j7dcq"]
Jul 24 15:48:56.960700 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:56.960662    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:56.963842 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:56.963818    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 15:48:56.964056 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:56.963877    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 15:48:56.964122 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:56.964074    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 15:48:56.964180 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:56.963958    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-twmxq\""
Jul 24 15:48:56.964232 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:56.963932    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 15:48:56.965087 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:56.965071    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 15:48:56.965243 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:56.965220    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 15:48:57.133863 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.133821    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-tls\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.134086 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.133881    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fgg8\" (UniqueName: \"kubernetes.io/projected/00caebbd-8641-46d4-b1c4-97eff53e1ad3-kube-api-access-6fgg8\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.134086 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.133971    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-textfile\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.134086 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.134009    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/00caebbd-8641-46d4-b1c4-97eff53e1ad3-root\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.134086 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.134044    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.134250 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.134103    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.134250 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.134163    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00caebbd-8641-46d4-b1c4-97eff53e1ad3-metrics-client-ca\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.134250 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.134202    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-wtmp\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.134250 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.134226    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00caebbd-8641-46d4-b1c4-97eff53e1ad3-sys\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.234889 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.234788    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.234889 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.234835    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00caebbd-8641-46d4-b1c4-97eff53e1ad3-metrics-client-ca\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.235119 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.234954    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-wtmp\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.235119 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.235001    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00caebbd-8641-46d4-b1c4-97eff53e1ad3-sys\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.235119 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.235027    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-tls\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.235119 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.235049    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgg8\" (UniqueName: \"kubernetes.io/projected/00caebbd-8641-46d4-b1c4-97eff53e1ad3-kube-api-access-6fgg8\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.235119 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.235092    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-textfile\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.235119 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.235101    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-wtmp\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.235119 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.235115    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/00caebbd-8641-46d4-b1c4-97eff53e1ad3-root\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.235476 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.235167    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.235476 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.235410    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00caebbd-8641-46d4-b1c4-97eff53e1ad3-sys\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.235476 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.235468    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/00caebbd-8641-46d4-b1c4-97eff53e1ad3-root\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.235880 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.235860    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.235947 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.235918    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00caebbd-8641-46d4-b1c4-97eff53e1ad3-metrics-client-ca\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.236000 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.235982    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-textfile\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.237786 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.237760    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-tls\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.237869 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.237848    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00caebbd-8641-46d4-b1c4-97eff53e1ad3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.243937 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.243913    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fgg8\" (UniqueName: \"kubernetes.io/projected/00caebbd-8641-46d4-b1c4-97eff53e1ad3-kube-api-access-6fgg8\") pod \"node-exporter-j7dcq\" (UID: \"00caebbd-8641-46d4-b1c4-97eff53e1ad3\") " pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.272056 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.272018    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j7dcq"
Jul 24 15:48:57.283518 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:48:57.283486    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00caebbd_8641_46d4_b1c4_97eff53e1ad3.slice/crio-a96af66dee792befdacdfbfbb7408ccd444ef571eee3333e01006b9ce182b3b2 WatchSource:0}: Error finding container a96af66dee792befdacdfbfbb7408ccd444ef571eee3333e01006b9ce182b3b2: Status 404 returned error can't find the container with id a96af66dee792befdacdfbfbb7408ccd444ef571eee3333e01006b9ce182b3b2
Jul 24 15:48:57.907324 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:57.907285    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7dcq" event={"ID":"00caebbd-8641-46d4-b1c4-97eff53e1ad3","Type":"ContainerStarted","Data":"a96af66dee792befdacdfbfbb7408ccd444ef571eee3333e01006b9ce182b3b2"}
Jul 24 15:48:58.912692 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:58.912656    2553 generic.go:356] "Generic (PLEG): container finished" podID="00caebbd-8641-46d4-b1c4-97eff53e1ad3" containerID="7924ee882ca663968a7ac6ac2e2bda94e18bc25a7888fe45e490f0da44ba544d" exitCode=0
Jul 24 15:48:58.913090 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:58.912702    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7dcq" event={"ID":"00caebbd-8641-46d4-b1c4-97eff53e1ad3","Type":"ContainerDied","Data":"7924ee882ca663968a7ac6ac2e2bda94e18bc25a7888fe45e490f0da44ba544d"}
Jul 24 15:48:59.919248 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:59.919203    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7dcq" event={"ID":"00caebbd-8641-46d4-b1c4-97eff53e1ad3","Type":"ContainerStarted","Data":"0e9afd3c1e0e9e64bfa3b20ad4770eee2b6d1bd05b680e9118b130e90b48f834"}
Jul 24 15:48:59.919709 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:59.919273    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7dcq" event={"ID":"00caebbd-8641-46d4-b1c4-97eff53e1ad3","Type":"ContainerStarted","Data":"1b47ed49271e950dca9bd2d6bb0c4c7457a8d7cbef75984460d68fadc15b85d1"}
Jul 24 15:48:59.940042 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:48:59.939989    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j7dcq" podStartSLOduration=3.013845413 podStartE2EDuration="3.939972192s" totalImagesPullingTime="860.830343ms" totalInitContainerRuntime="65.296436ms" isStatefulPod=true podCreationTimestamp="2026-07-24 15:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:48:59.937807106 +0000 UTC m=+94.000256296" watchObservedRunningTime="2026-07-24 15:48:59.939972192 +0000 UTC m=+94.002421416"
Jul 24 15:49:03.205718 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.205680    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:49:03.251204 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.251163    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:49:03.251375 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.251315    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.256084 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.256061    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 15:49:03.256230 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.256063    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 15:49:03.256417 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.256393    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 15:49:03.256515 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.256494    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 15:49:03.257494 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.257472    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b9huue2f2pp5r\""
Jul 24 15:49:03.257614 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.257496    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 15:49:03.257614 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.257510    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 15:49:03.257614 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.257546    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gqxl6\""
Jul 24 15:49:03.257614 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.257563    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 15:49:03.257614 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.257497    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 15:49:03.257876 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.257482    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 15:49:03.257876 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.257715    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 15:49:03.257876 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.257851    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 15:49:03.258371 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.258084    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 15:49:03.258510 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.258490    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 15:49:03.260505 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.260487    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 15:49:03.262731 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.262712    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 15:49:03.385324 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385286    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.385324 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385328    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.385555 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385354    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-config-out\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.385555 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385423    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.385555 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385455    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.385555 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385482    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.385555 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385503    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.385555 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385533    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.385802 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385623    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-config\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.385802 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385649    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.385802 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385666    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.385802 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385693    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.385802 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385721    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.385802 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385737    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsgxq\" (UniqueName: \"kubernetes.io/projected/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-kube-api-access-xsgxq\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.385802 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385757    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.386007 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385800    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.386007 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385840    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-web-config\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.386007 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385865    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.386007 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385881    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.386007 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.385896    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.486783 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.486696    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.486783 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.486736    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.486783 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.486757    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487038 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487012    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-config\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487098 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487060    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487098 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487088    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487200 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487119    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487200 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487133    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487200 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487156    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487200 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487183    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsgxq\" (UniqueName: \"kubernetes.io/projected/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-kube-api-access-xsgxq\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487385 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487215    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487385 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487248    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487385 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487295    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-web-config\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487385 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487328    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487385 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487354    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487670 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487383    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487670 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487421    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487670 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487450    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487670 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487483    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-config-out\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487670 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487512    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487670 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487538    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.487966 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.487794    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.488179 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.488157    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.490028 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.489973    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-config\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.490149 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.490090    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.490220 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.490168    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.490220 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.490207    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.490915 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.490615    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.490915 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.490675    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.490915 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.490772    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.490915 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.490827    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.491260 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.491238    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.491872 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.491804    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.492037 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.492017    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.492167 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.492142    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.492470 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.492450    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-config-out\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.492854 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.492832    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-web-config\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.493314 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.493296    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.493511 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.493491    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.496188 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.496165    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsgxq\" (UniqueName: \"kubernetes.io/projected/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-kube-api-access-xsgxq\") pod \"prometheus-k8s-0\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.561203 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.561165    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:49:03.757437 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.757409    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:49:03.760861 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:49:03.760835    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a305c7_f542_409d_b1ac_ec6fb6dd1bec.slice/crio-1edac18b2b5623aadd54b6a17893af94d8706e5ceb2a7e377fa4edfcf825ad10 WatchSource:0}: Error finding container 1edac18b2b5623aadd54b6a17893af94d8706e5ceb2a7e377fa4edfcf825ad10: Status 404 returned error can't find the container with id 1edac18b2b5623aadd54b6a17893af94d8706e5ceb2a7e377fa4edfcf825ad10
Jul 24 15:49:03.932654 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:03.932618    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerStarted","Data":"1edac18b2b5623aadd54b6a17893af94d8706e5ceb2a7e377fa4edfcf825ad10"}
Jul 24 15:49:05.941799 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:05.941759    2553 generic.go:356] "Generic (PLEG): container finished" podID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerID="c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f" exitCode=0
Jul 24 15:49:05.942177 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:05.941844    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerDied","Data":"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"}
Jul 24 15:49:09.959348 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:09.959306    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerStarted","Data":"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"}
Jul 24 15:49:09.959862 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:09.959379    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerStarted","Data":"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"}
Jul 24 15:49:10.968146 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:10.968117    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerStarted","Data":"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"}
Jul 24 15:49:11.975028 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:11.974986    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerStarted","Data":"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"}
Jul 24 15:49:11.975525 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:11.975052    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerStarted","Data":"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"}
Jul 24 15:49:11.975525 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:11.975078    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerStarted","Data":"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"}
Jul 24 15:49:12.008983 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:12.008879    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.586690327 podStartE2EDuration="9.00885989s" totalImagesPullingTime="6.402613444s" totalInitContainerRuntime="19.556119ms" isStatefulPod=false podCreationTimestamp="2026-07-24 15:49:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:49:12.005085191 +0000 UTC m=+106.067534392" watchObservedRunningTime="2026-07-24 15:49:12.00885989 +0000 UTC m=+106.071309055"
Jul 24 15:49:12.853659 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:12.853631    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mq5hc"
Jul 24 15:49:13.561340 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:49:13.561301    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:03.561574 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:03.561539    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:03.581377 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:03.581349    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:04.169478 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:04.169452    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:21.529868 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.529779    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:50:21.530393 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.530072    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="prometheus" containerID="cri-o://162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b" gracePeriod=600
Jul 24 15:50:21.530393 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.530101    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="thanos-sidecar" containerID="cri-o://414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211" gracePeriod=600
Jul 24 15:50:21.530393 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.530113    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="kube-rbac-proxy-web" containerID="cri-o://117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809" gracePeriod=600
Jul 24 15:50:21.530393 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.530159    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="config-reloader" containerID="cri-o://7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1" gracePeriod=600
Jul 24 15:50:21.530393 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.530165    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d" gracePeriod=600
Jul 24 15:50:21.530393 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.530081    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="kube-rbac-proxy" containerID="cri-o://b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84" gracePeriod=600
Jul 24 15:50:21.770968 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.770941    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:21.887574 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887475    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-1\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887574 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887519    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-trusted-ca-bundle\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887574 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887537    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-thanos-prometheus-http-client-file\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887574 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887566    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-metrics-client-ca\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887605    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-serving-certs-ca-bundle\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887644    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-tls\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887671    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-web-config\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887693    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-metrics-client-certs\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887719    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsgxq\" (UniqueName: \"kubernetes.io/projected/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-kube-api-access-xsgxq\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887739    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-config-out\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887757    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-config\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887773    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887807    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-kubelet-serving-ca-bundle\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887836    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-db\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887863    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-kube-rbac-proxy\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887912    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-2\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.887931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887938    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-tls-assets\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.888542 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887965    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-grpc-tls\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.888542 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.887964    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:50:21.888542 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.888002    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.888542 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.888020    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:50:21.888542 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.888047    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-0\") pod \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\" (UID: \"92a305c7-f542-409d-b1ac-ec6fb6dd1bec\") "
Jul 24 15:50:21.888542 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.888249    2553 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.888542 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.888268    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.888542 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.888336    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:50:21.888968 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.888565    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:50:21.889031 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.889004    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:50:21.889523 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.889495    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:50:21.891091 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.891062    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:50:21.891318 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.891289    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:50:21.891859 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.891837    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-kube-api-access-xsgxq" (OuterVolumeSpecName: "kube-api-access-xsgxq") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "kube-api-access-xsgxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:50:21.891976 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.891842    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:50:21.892525 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.892499    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:50:21.892652 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.892515    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:50:21.892652 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.892519    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:50:21.892652 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.892630    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-config-out" (OuterVolumeSpecName: "config-out") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:50:21.892770 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.892642    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:50:21.892770 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.892660    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:50:21.893232 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.893211    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:50:21.893500 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.893476    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:50:21.893794 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.893773    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-config" (OuterVolumeSpecName: "config") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:50:21.901236 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.901215    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-web-config" (OuterVolumeSpecName: "web-config") pod "92a305c7-f542-409d-b1ac-ec6fb6dd1bec" (UID: "92a305c7-f542-409d-b1ac-ec6fb6dd1bec"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:50:21.989137 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989100    2553 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989137 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989130    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-db\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989137 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989140    2553 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-kube-rbac-proxy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989137 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989149    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989158    2553 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-tls-assets\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989166    2553 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-grpc-tls\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989175    2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989183    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989191    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989201    2553 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989209    2553 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-configmap-metrics-client-ca\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989218    2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989225    2553 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-web-config\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989233    2553 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-metrics-client-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989242    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsgxq\" (UniqueName: \"kubernetes.io/projected/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-kube-api-access-xsgxq\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989250    2553 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-config-out\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989259    2553 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-config\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:21.989397 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:21.989266    2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92a305c7-f542-409d-b1ac-ec6fb6dd1bec-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:50:22.217924 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.217828    2553 generic.go:356] "Generic (PLEG): container finished" podID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerID="2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d" exitCode=0
Jul 24 15:50:22.217924 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.217852    2553 generic.go:356] "Generic (PLEG): container finished" podID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerID="b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84" exitCode=0
Jul 24 15:50:22.217924 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.217859    2553 generic.go:356] "Generic (PLEG): container finished" podID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerID="117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809" exitCode=0
Jul 24 15:50:22.217924 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.217866    2553 generic.go:356] "Generic (PLEG): container finished" podID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerID="414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211" exitCode=0
Jul 24 15:50:22.217924 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.217871    2553 generic.go:356] "Generic (PLEG): container finished" podID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerID="7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1" exitCode=0
Jul 24 15:50:22.217924 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.217876    2553 generic.go:356] "Generic (PLEG): container finished" podID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerID="162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b" exitCode=0
Jul 24 15:50:22.217924 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.217901    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerDied","Data":"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"}
Jul 24 15:50:22.218367 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.217941    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.218367 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.217987    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerDied","Data":"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"}
Jul 24 15:50:22.218367 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.218016    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerDied","Data":"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"}
Jul 24 15:50:22.218367 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.218041    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerDied","Data":"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"}
Jul 24 15:50:22.218367 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.218064    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerDied","Data":"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"}
Jul 24 15:50:22.218367 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.218071    2553 scope.go:117] "RemoveContainer" containerID="2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"
Jul 24 15:50:22.218367 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.218089    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerDied","Data":"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"}
Jul 24 15:50:22.218367 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.218112    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92a305c7-f542-409d-b1ac-ec6fb6dd1bec","Type":"ContainerDied","Data":"1edac18b2b5623aadd54b6a17893af94d8706e5ceb2a7e377fa4edfcf825ad10"}
Jul 24 15:50:22.225893 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.225784    2553 scope.go:117] "RemoveContainer" containerID="b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"
Jul 24 15:50:22.232320 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.232303    2553 scope.go:117] "RemoveContainer" containerID="117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"
Jul 24 15:50:22.238816 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.238797    2553 scope.go:117] "RemoveContainer" containerID="414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"
Jul 24 15:50:22.240758 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.240737    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:50:22.245913 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.245888    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:50:22.245976 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.245960    2553 scope.go:117] "RemoveContainer" containerID="7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"
Jul 24 15:50:22.252039 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.252023    2553 scope.go:117] "RemoveContainer" containerID="162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"
Jul 24 15:50:22.258575 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.258559    2553 scope.go:117] "RemoveContainer" containerID="c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"
Jul 24 15:50:22.264876 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.264861    2553 scope.go:117] "RemoveContainer" containerID="2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"
Jul 24 15:50:22.265136 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:50:22.265115    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d\": container with ID starting with 2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d not found: ID does not exist" containerID="2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"
Jul 24 15:50:22.265183 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.265144    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"} err="failed to get container status \"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d\": rpc error: code = NotFound desc = could not find container \"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d\": container with ID starting with 2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d not found: ID does not exist"
Jul 24 15:50:22.265183 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.265180    2553 scope.go:117] "RemoveContainer" containerID="b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"
Jul 24 15:50:22.265432 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:50:22.265413    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84\": container with ID starting with b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84 not found: ID does not exist" containerID="b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"
Jul 24 15:50:22.265500 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.265449    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"} err="failed to get container status \"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84\": rpc error: code = NotFound desc = could not find container \"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84\": container with ID starting with b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84 not found: ID does not exist"
Jul 24 15:50:22.265500 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.265473    2553 scope.go:117] "RemoveContainer" containerID="117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"
Jul 24 15:50:22.265736 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:50:22.265717    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809\": container with ID starting with 117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809 not found: ID does not exist" containerID="117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"
Jul 24 15:50:22.265787 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.265742    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"} err="failed to get container status \"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809\": rpc error: code = NotFound desc = could not find container \"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809\": container with ID starting with 117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809 not found: ID does not exist"
Jul 24 15:50:22.265787 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.265757    2553 scope.go:117] "RemoveContainer" containerID="414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"
Jul 24 15:50:22.266002 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:50:22.265980    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211\": container with ID starting with 414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211 not found: ID does not exist" containerID="414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"
Jul 24 15:50:22.266037 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.266008    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"} err="failed to get container status \"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211\": rpc error: code = NotFound desc = could not find container \"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211\": container with ID starting with 414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211 not found: ID does not exist"
Jul 24 15:50:22.266037 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.266024    2553 scope.go:117] "RemoveContainer" containerID="7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"
Jul 24 15:50:22.266244 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:50:22.266229    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1\": container with ID starting with 7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1 not found: ID does not exist" containerID="7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"
Jul 24 15:50:22.266286 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.266250    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"} err="failed to get container status \"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1\": rpc error: code = NotFound desc = could not find container \"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1\": container with ID starting with 7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1 not found: ID does not exist"
Jul 24 15:50:22.266286 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.266263    2553 scope.go:117] "RemoveContainer" containerID="162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"
Jul 24 15:50:22.266455 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:50:22.266440    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b\": container with ID starting with 162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b not found: ID does not exist" containerID="162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"
Jul 24 15:50:22.266490 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.266458    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"} err="failed to get container status \"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b\": rpc error: code = NotFound desc = could not find container \"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b\": container with ID starting with 162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b not found: ID does not exist"
Jul 24 15:50:22.266490 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.266471    2553 scope.go:117] "RemoveContainer" containerID="c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"
Jul 24 15:50:22.266714 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:50:22.266696    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f\": container with ID starting with c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f not found: ID does not exist" containerID="c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"
Jul 24 15:50:22.266763 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.266717    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"} err="failed to get container status \"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f\": rpc error: code = NotFound desc = could not find container \"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f\": container with ID starting with c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f not found: ID does not exist"
Jul 24 15:50:22.266763 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.266730    2553 scope.go:117] "RemoveContainer" containerID="2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"
Jul 24 15:50:22.267005 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.266969    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"} err="failed to get container status \"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d\": rpc error: code = NotFound desc = could not find container \"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d\": container with ID starting with 2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d not found: ID does not exist"
Jul 24 15:50:22.267005 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.266998    2553 scope.go:117] "RemoveContainer" containerID="b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"
Jul 24 15:50:22.267252 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.267217    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"} err="failed to get container status \"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84\": rpc error: code = NotFound desc = could not find container \"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84\": container with ID starting with b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84 not found: ID does not exist"
Jul 24 15:50:22.267252 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.267238    2553 scope.go:117] "RemoveContainer" containerID="117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"
Jul 24 15:50:22.267526 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.267464    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"} err="failed to get container status \"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809\": rpc error: code = NotFound desc = could not find container \"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809\": container with ID starting with 117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809 not found: ID does not exist"
Jul 24 15:50:22.267526 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.267492    2553 scope.go:117] "RemoveContainer" containerID="414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"
Jul 24 15:50:22.267870 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.267851    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"} err="failed to get container status \"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211\": rpc error: code = NotFound desc = could not find container \"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211\": container with ID starting with 414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211 not found: ID does not exist"
Jul 24 15:50:22.267945 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.267872    2553 scope.go:117] "RemoveContainer" containerID="7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"
Jul 24 15:50:22.268187 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.268157    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"} err="failed to get container status \"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1\": rpc error: code = NotFound desc = could not find container \"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1\": container with ID starting with 7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1 not found: ID does not exist"
Jul 24 15:50:22.268187 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.268187    2553 scope.go:117] "RemoveContainer" containerID="162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"
Jul 24 15:50:22.268432 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.268414    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"} err="failed to get container status \"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b\": rpc error: code = NotFound desc = could not find container \"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b\": container with ID starting with 162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b not found: ID does not exist"
Jul 24 15:50:22.268480 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.268434    2553 scope.go:117] "RemoveContainer" containerID="c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"
Jul 24 15:50:22.268687 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.268670    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"} err="failed to get container status \"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f\": rpc error: code = NotFound desc = could not find container \"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f\": container with ID starting with c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f not found: ID does not exist"
Jul 24 15:50:22.268752 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.268687    2553 scope.go:117] "RemoveContainer" containerID="2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"
Jul 24 15:50:22.268934 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.268913    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"} err="failed to get container status \"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d\": rpc error: code = NotFound desc = could not find container \"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d\": container with ID starting with 2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d not found: ID does not exist"
Jul 24 15:50:22.269011 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.268934    2553 scope.go:117] "RemoveContainer" containerID="b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"
Jul 24 15:50:22.269156 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269139    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"} err="failed to get container status \"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84\": rpc error: code = NotFound desc = could not find container \"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84\": container with ID starting with b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84 not found: ID does not exist"
Jul 24 15:50:22.269199 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269156    2553 scope.go:117] "RemoveContainer" containerID="117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"
Jul 24 15:50:22.269199 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269180    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:50:22.269350 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269333    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"} err="failed to get container status \"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809\": rpc error: code = NotFound desc = could not find container \"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809\": container with ID starting with 117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809 not found: ID does not exist"
Jul 24 15:50:22.269392 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269350    2553 scope.go:117] "RemoveContainer" containerID="414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"
Jul 24 15:50:22.269439 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269422    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="thanos-sidecar"
Jul 24 15:50:22.269439 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269433    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="thanos-sidecar"
Jul 24 15:50:22.269528 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269441    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="kube-rbac-proxy-thanos"
Jul 24 15:50:22.269528 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269447    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="kube-rbac-proxy-thanos"
Jul 24 15:50:22.269528 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269458    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="kube-rbac-proxy"
Jul 24 15:50:22.269528 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269467    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="kube-rbac-proxy"
Jul 24 15:50:22.269528 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269480    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="init-config-reloader"
Jul 24 15:50:22.269528 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269489    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="init-config-reloader"
Jul 24 15:50:22.269528 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269495    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="prometheus"
Jul 24 15:50:22.269528 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269500    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="prometheus"
Jul 24 15:50:22.269528 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269508    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="config-reloader"
Jul 24 15:50:22.269528 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269514    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="config-reloader"
Jul 24 15:50:22.269528 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269520    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="kube-rbac-proxy-web"
Jul 24 15:50:22.269528 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269524    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="kube-rbac-proxy-web"
Jul 24 15:50:22.269960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269549    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"} err="failed to get container status \"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211\": rpc error: code = NotFound desc = could not find container \"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211\": container with ID starting with 414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211 not found: ID does not exist"
Jul 24 15:50:22.269960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269562    2553 scope.go:117] "RemoveContainer" containerID="7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"
Jul 24 15:50:22.269960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269569    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="prometheus"
Jul 24 15:50:22.269960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269578    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="config-reloader"
Jul 24 15:50:22.269960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269598    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="kube-rbac-proxy"
Jul 24 15:50:22.269960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269606    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="kube-rbac-proxy-thanos"
Jul 24 15:50:22.269960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269612    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="kube-rbac-proxy-web"
Jul 24 15:50:22.269960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269619    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" containerName="thanos-sidecar"
Jul 24 15:50:22.269960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269811    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"} err="failed to get container status \"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1\": rpc error: code = NotFound desc = could not find container \"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1\": container with ID starting with 7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1 not found: ID does not exist"
Jul 24 15:50:22.269960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.269833    2553 scope.go:117] "RemoveContainer" containerID="162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"
Jul 24 15:50:22.270305 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.270046    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"} err="failed to get container status \"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b\": rpc error: code = NotFound desc = could not find container \"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b\": container with ID starting with 162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b not found: ID does not exist"
Jul 24 15:50:22.270305 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.270060    2553 scope.go:117] "RemoveContainer" containerID="c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"
Jul 24 15:50:22.270305 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.270265    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"} err="failed to get container status \"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f\": rpc error: code = NotFound desc = could not find container \"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f\": container with ID starting with c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f not found: ID does not exist"
Jul 24 15:50:22.270305 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.270282    2553 scope.go:117] "RemoveContainer" containerID="2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"
Jul 24 15:50:22.270527 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.270508    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"} err="failed to get container status \"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d\": rpc error: code = NotFound desc = could not find container \"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d\": container with ID starting with 2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d not found: ID does not exist"
Jul 24 15:50:22.270568 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.270528    2553 scope.go:117] "RemoveContainer" containerID="b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"
Jul 24 15:50:22.270765 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.270747    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"} err="failed to get container status \"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84\": rpc error: code = NotFound desc = could not find container \"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84\": container with ID starting with b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84 not found: ID does not exist"
Jul 24 15:50:22.270825 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.270766    2553 scope.go:117] "RemoveContainer" containerID="117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"
Jul 24 15:50:22.270998 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.270979    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"} err="failed to get container status \"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809\": rpc error: code = NotFound desc = could not find container \"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809\": container with ID starting with 117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809 not found: ID does not exist"
Jul 24 15:50:22.271043 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.270998    2553 scope.go:117] "RemoveContainer" containerID="414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"
Jul 24 15:50:22.271237 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.271221    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"} err="failed to get container status \"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211\": rpc error: code = NotFound desc = could not find container \"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211\": container with ID starting with 414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211 not found: ID does not exist"
Jul 24 15:50:22.271289 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.271236    2553 scope.go:117] "RemoveContainer" containerID="7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"
Jul 24 15:50:22.271415 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.271400    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"} err="failed to get container status \"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1\": rpc error: code = NotFound desc = could not find container \"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1\": container with ID starting with 7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1 not found: ID does not exist"
Jul 24 15:50:22.271454 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.271414    2553 scope.go:117] "RemoveContainer" containerID="162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"
Jul 24 15:50:22.271601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.271571    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"} err="failed to get container status \"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b\": rpc error: code = NotFound desc = could not find container \"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b\": container with ID starting with 162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b not found: ID does not exist"
Jul 24 15:50:22.271601 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.271598    2553 scope.go:117] "RemoveContainer" containerID="c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"
Jul 24 15:50:22.271776 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.271761    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"} err="failed to get container status \"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f\": rpc error: code = NotFound desc = could not find container \"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f\": container with ID starting with c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f not found: ID does not exist"
Jul 24 15:50:22.271826 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.271775    2553 scope.go:117] "RemoveContainer" containerID="2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"
Jul 24 15:50:22.271932 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.271918    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"} err="failed to get container status \"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d\": rpc error: code = NotFound desc = could not find container \"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d\": container with ID starting with 2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d not found: ID does not exist"
Jul 24 15:50:22.271984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.271931    2553 scope.go:117] "RemoveContainer" containerID="b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"
Jul 24 15:50:22.272152 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.272128    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"} err="failed to get container status \"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84\": rpc error: code = NotFound desc = could not find container \"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84\": container with ID starting with b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84 not found: ID does not exist"
Jul 24 15:50:22.272209 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.272152    2553 scope.go:117] "RemoveContainer" containerID="117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"
Jul 24 15:50:22.272395 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.272379    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"} err="failed to get container status \"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809\": rpc error: code = NotFound desc = could not find container \"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809\": container with ID starting with 117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809 not found: ID does not exist"
Jul 24 15:50:22.272437 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.272395    2553 scope.go:117] "RemoveContainer" containerID="414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"
Jul 24 15:50:22.272577 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.272557    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"} err="failed to get container status \"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211\": rpc error: code = NotFound desc = could not find container \"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211\": container with ID starting with 414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211 not found: ID does not exist"
Jul 24 15:50:22.272651 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.272577    2553 scope.go:117] "RemoveContainer" containerID="7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"
Jul 24 15:50:22.272796 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.272777    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"} err="failed to get container status \"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1\": rpc error: code = NotFound desc = could not find container \"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1\": container with ID starting with 7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1 not found: ID does not exist"
Jul 24 15:50:22.272856 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.272795    2553 scope.go:117] "RemoveContainer" containerID="162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"
Jul 24 15:50:22.272991 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.272975    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"} err="failed to get container status \"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b\": rpc error: code = NotFound desc = could not find container \"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b\": container with ID starting with 162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b not found: ID does not exist"
Jul 24 15:50:22.273049 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.272990    2553 scope.go:117] "RemoveContainer" containerID="c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"
Jul 24 15:50:22.273160 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.273146    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"} err="failed to get container status \"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f\": rpc error: code = NotFound desc = could not find container \"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f\": container with ID starting with c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f not found: ID does not exist"
Jul 24 15:50:22.273210 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.273159    2553 scope.go:117] "RemoveContainer" containerID="2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"
Jul 24 15:50:22.273354 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.273335    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d"} err="failed to get container status \"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d\": rpc error: code = NotFound desc = could not find container \"2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d\": container with ID starting with 2c89b240b5dec26c08a24e76a857599d9434eed39568f930cf7dcb81ebfda50d not found: ID does not exist"
Jul 24 15:50:22.273354 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.273351    2553 scope.go:117] "RemoveContainer" containerID="b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"
Jul 24 15:50:22.273480 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.273465    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.273537 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.273515    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84"} err="failed to get container status \"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84\": rpc error: code = NotFound desc = could not find container \"b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84\": container with ID starting with b450535294823e97bf47eedc5da670fcadc00e6a33ce1d83a30177bfb4daaa84 not found: ID does not exist"
Jul 24 15:50:22.273573 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.273538    2553 scope.go:117] "RemoveContainer" containerID="117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"
Jul 24 15:50:22.273943 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.273729    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809"} err="failed to get container status \"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809\": rpc error: code = NotFound desc = could not find container \"117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809\": container with ID starting with 117aed0608d0f854b23f1481f6912f5347d749adf2e4bd0eb1c058e07e302809 not found: ID does not exist"
Jul 24 15:50:22.273943 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.273759    2553 scope.go:117] "RemoveContainer" containerID="414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"
Jul 24 15:50:22.274139 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.274042    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211"} err="failed to get container status \"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211\": rpc error: code = NotFound desc = could not find container \"414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211\": container with ID starting with 414ea2d2100811f71109fc1b9c03ea76d57580d25fe364b942c7ec042d9cc211 not found: ID does not exist"
Jul 24 15:50:22.274139 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.274065    2553 scope.go:117] "RemoveContainer" containerID="7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"
Jul 24 15:50:22.274318 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.274300    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1"} err="failed to get container status \"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1\": rpc error: code = NotFound desc = could not find container \"7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1\": container with ID starting with 7e9985b3ba373a8e5f375c0d8950c7dd2f926a41951d372b4ad042a4ee1ed6b1 not found: ID does not exist"
Jul 24 15:50:22.274357 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.274320    2553 scope.go:117] "RemoveContainer" containerID="162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"
Jul 24 15:50:22.274542 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.274525    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b"} err="failed to get container status \"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b\": rpc error: code = NotFound desc = could not find container \"162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b\": container with ID starting with 162b454fecc1353a5d3cc08904058f04054db386d1605e1a049e6f3486bc647b not found: ID does not exist"
Jul 24 15:50:22.274542 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.274540    2553 scope.go:117] "RemoveContainer" containerID="c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"
Jul 24 15:50:22.274780 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.274761    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f"} err="failed to get container status \"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f\": rpc error: code = NotFound desc = could not find container \"c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f\": container with ID starting with c60f6cc55c45817ef1d58dd1813b40097a1163fea118cafaf481a4ebe1d1ef2f not found: ID does not exist"
Jul 24 15:50:22.276329 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.276306    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 15:50:22.276447 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.276430    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 15:50:22.276505 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.276480    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 15:50:22.276579 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.276561    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gqxl6\""
Jul 24 15:50:22.276706 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.276689    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 15:50:22.277931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.277769    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 15:50:22.277931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.277794    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 15:50:22.277931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.277810    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 15:50:22.277931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.277829    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 15:50:22.277931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.277849    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 15:50:22.277931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.277869    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 15:50:22.277931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.277776    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 15:50:22.278303 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.278055    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b9huue2f2pp5r\""
Jul 24 15:50:22.278741 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.278720    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 15:50:22.278844 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.278720    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 15:50:22.281420 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.281401    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 15:50:22.282540 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.282521    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 15:50:22.291303 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291276    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:50:22.291445 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291426    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hd4n\" (UniqueName: \"kubernetes.io/projected/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-kube-api-access-8hd4n\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.291513 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291468    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.291575 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291535    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.291668 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291576    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.291668 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291643    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.291772 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291669    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-web-config\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.291772 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291742    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-config\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.291881 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291771    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.291881 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291795    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.291881 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291819    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.291881 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291860    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.292064 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291903    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.292064 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291927    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.292064 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291955    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.292064 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.291981    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-config-out\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.292064 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.292005    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.292064 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.292044    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.292287 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.292072    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.292287 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.292101    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.292287 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.292136    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393049 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393015    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393049 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393051    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-web-config\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393339 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393070    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-config\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393339 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393107    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393339 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393123    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393339 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393139    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393339 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393161    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393339 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393189    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393339 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393249    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393339 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393291    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393339 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393339    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-config-out\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393796 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393365    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393796 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393433    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393796 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393465    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393796 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393523    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393796 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393607    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.393796 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393653    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.394220 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393660    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hd4n\" (UniqueName: \"kubernetes.io/projected/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-kube-api-access-8hd4n\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.394220 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393881    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.394220 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.393910    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.394436 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.394318    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.394827 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.394707    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.394827 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.394753    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.395075 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.395049    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.395646 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.395611    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.398067 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.398037    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-web-config\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.398227 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.398207    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-config\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.398296 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.398255    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.398296 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.398279    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.398432 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.398410    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.398519 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.398494    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.399174 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.398721    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.399174 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.398798    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.399174 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.398930    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.399174 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.398964    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.399174 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.398983    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.399174 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.399122    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.399468 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.399364    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.399504 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.399489    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-config-out\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.401788 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.401772    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hd4n\" (UniqueName: \"kubernetes.io/projected/dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10-kube-api-access-8hd4n\") pod \"prometheus-k8s-0\" (UID: \"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.473148 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.473076    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92a305c7-f542-409d-b1ac-ec6fb6dd1bec" path="/var/lib/kubelet/pods/92a305c7-f542-409d-b1ac-ec6fb6dd1bec/volumes"
Jul 24 15:50:22.583618 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.583566    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:50:22.722922 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:22.722887    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 15:50:22.726946 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:50:22.726916    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfaa6cc1_4fec_49ce_ae78_91e1e1cd2e10.slice/crio-03359d70007af09d56a794e49fe81c11f073a85bba3d7fe88e90c0626ea94e9b WatchSource:0}: Error finding container 03359d70007af09d56a794e49fe81c11f073a85bba3d7fe88e90c0626ea94e9b: Status 404 returned error can't find the container with id 03359d70007af09d56a794e49fe81c11f073a85bba3d7fe88e90c0626ea94e9b
Jul 24 15:50:23.223058 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:23.223022    2553 generic.go:356] "Generic (PLEG): container finished" podID="dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10" containerID="35b9d5c544a9f2791a5ca03ea57b2f854045edf292f1d994649564b00ddeaa22" exitCode=0
Jul 24 15:50:23.223217 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:23.223098    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10","Type":"ContainerDied","Data":"35b9d5c544a9f2791a5ca03ea57b2f854045edf292f1d994649564b00ddeaa22"}
Jul 24 15:50:23.223217 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:23.223166    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10","Type":"ContainerStarted","Data":"03359d70007af09d56a794e49fe81c11f073a85bba3d7fe88e90c0626ea94e9b"}
Jul 24 15:50:24.231924 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:24.231887    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10","Type":"ContainerStarted","Data":"15b0835d51a9111486a0b17f60b5ef9e3cbdca2d1a916fe67bae99b054b2468e"}
Jul 24 15:50:24.232400 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:24.231986    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10","Type":"ContainerStarted","Data":"592567b83ec1649ada256518d2abc6621c9ab7eb2727793dc8fa818c8e391be6"}
Jul 24 15:50:24.232400 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:24.232017    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10","Type":"ContainerStarted","Data":"4ddce5ac72ed316ca8b5ed88efb7e518c8fc7eff43baecff8caa8ff72470d13e"}
Jul 24 15:50:24.232400 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:24.232050    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10","Type":"ContainerStarted","Data":"d05a25722ab365eaca8ba63c8f6a8e6a3e7a144719a0eb9ef2e6429e6c96f350"}
Jul 24 15:50:24.232400 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:24.232077    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10","Type":"ContainerStarted","Data":"5fddf1c1d297494a8555e5229f8cc32c00e2c474245570a10decd33e2fa50819"}
Jul 24 15:50:24.232400 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:24.232100    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10","Type":"ContainerStarted","Data":"6ed3e0b0a2188f41644a749de63f97245a6dbd548b83a55aedc575f40b0113d3"}
Jul 24 15:50:24.260839 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:24.260782    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.242639071 podStartE2EDuration="2.260766312s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.127241ms" isStatefulPod=false podCreationTimestamp="2026-07-24 15:50:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:50:24.25905745 +0000 UTC m=+178.321506637" watchObservedRunningTime="2026-07-24 15:50:24.260766312 +0000 UTC m=+178.323215526"
Jul 24 15:50:27.584262 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:50:27.584214    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:51:22.583924 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:51:22.583871    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:51:22.599072 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:51:22.599046    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:51:23.459297 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:51:23.459260    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 15:52:26.319005 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:26.318968    2553 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 15:52:58.253258 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.253217    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"]
Jul 24 15:52:58.256597 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.256567    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.262938 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.262486    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 15:52:58.262938 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.262493    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 15:52:58.262938 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.262512    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 15:52:58.263364 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.263343    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 15:52:58.263722 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.263706    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9glrs\""
Jul 24 15:52:58.303492 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.303461    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"]
Jul 24 15:52:58.349464 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.349424    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-manifests\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.349464 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.349467    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-tmp\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.349701 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.349492    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5gqh\" (UniqueName: \"kubernetes.io/projected/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-kube-api-access-t5gqh\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.349701 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.349567    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.349701 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.349614    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.450947 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.450905    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-tmp\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.450947 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.450943    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5gqh\" (UniqueName: \"kubernetes.io/projected/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-kube-api-access-t5gqh\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.451180 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.450971    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.451180 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.450987    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.451180 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.451024    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-manifests\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.451404 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.451382    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-manifests\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.453143 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.453108    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-tmp\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.453333 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.453312    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.453490 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.453472    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.460114 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.460078    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5gqh\" (UniqueName: \"kubernetes.io/projected/29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f-kube-api-access-t5gqh\") pod \"opendatahub-operator-controller-manager-749946f7d7-ghg7h\" (UID: \"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f\") " pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.566714 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.566622    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:52:58.698955 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.698923    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"]
Jul 24 15:52:58.703429 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:52:58.703396    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29aef38e_b0c6_42d2_a21e_fb0a6aa46d9f.slice/crio-56ba0dcba947aa21d44cb5ef0fa904720198d4bdc2b7606cd0be25e5e6a1dd2a WatchSource:0}: Error finding container 56ba0dcba947aa21d44cb5ef0fa904720198d4bdc2b7606cd0be25e5e6a1dd2a: Status 404 returned error can't find the container with id 56ba0dcba947aa21d44cb5ef0fa904720198d4bdc2b7606cd0be25e5e6a1dd2a
Jul 24 15:52:58.705112 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.705094    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:52:58.756767 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:52:58.756730    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h" event={"ID":"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f","Type":"ContainerStarted","Data":"56ba0dcba947aa21d44cb5ef0fa904720198d4bdc2b7606cd0be25e5e6a1dd2a"}
Jul 24 15:53:01.770730 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:01.770694    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h" event={"ID":"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f","Type":"ContainerStarted","Data":"07982245af1ce814499b42ae41a49d8e70187e1ab9ba4cb70479008d211816c8"}
Jul 24 15:53:02.778380 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:02.778343    2553 generic.go:356] "Generic (PLEG): container finished" podID="29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f" containerID="07982245af1ce814499b42ae41a49d8e70187e1ab9ba4cb70479008d211816c8" exitCode=0
Jul 24 15:53:02.778380 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:02.778384    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h" event={"ID":"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f","Type":"ContainerDied","Data":"07982245af1ce814499b42ae41a49d8e70187e1ab9ba4cb70479008d211816c8"}
Jul 24 15:53:03.784704 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:03.784656    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h" event={"ID":"29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f","Type":"ContainerStarted","Data":"b0de39fb3ab987da341c74be1fff8221f93b577c6aaa44b799841e9c9ca5a228"}
Jul 24 15:53:03.785097 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:03.784795    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:53:03.808511 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:03.808456    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h" podStartSLOduration=1.358619579 podStartE2EDuration="5.808439206s" totalImagesPullingTime="3.396502893s" totalInitContainerRuntime="1.053316734s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:52:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:53:03.806776944 +0000 UTC m=+337.869226181" watchObservedRunningTime="2026-07-24 15:53:03.808439206 +0000 UTC m=+337.870888394"
Jul 24 15:53:14.790077 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:14.790044    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-749946f7d7-ghg7h"
Jul 24 15:53:17.918203 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:17.918156    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wxmsk"]
Jul 24 15:53:17.928372 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:17.928342    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wxmsk"
Jul 24 15:53:17.931043 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:17.931015    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 24 15:53:17.931161 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:17.931041    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hpgrn\""
Jul 24 15:53:17.935492 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:17.935461    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wxmsk"]
Jul 24 15:53:18.000055 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.000018    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24cmp\" (UniqueName: \"kubernetes.io/projected/4beae04b-21db-4d9a-b539-87d182241c2b-kube-api-access-24cmp\") pod \"odh-model-controller-7998c67dc4-wxmsk\" (UID: \"4beae04b-21db-4d9a-b539-87d182241c2b\") " pod="opendatahub/odh-model-controller-7998c67dc4-wxmsk"
Jul 24 15:53:18.000055 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.000068    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4beae04b-21db-4d9a-b539-87d182241c2b-cert\") pod \"odh-model-controller-7998c67dc4-wxmsk\" (UID: \"4beae04b-21db-4d9a-b539-87d182241c2b\") " pod="opendatahub/odh-model-controller-7998c67dc4-wxmsk"
Jul 24 15:53:18.101058 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.101022    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24cmp\" (UniqueName: \"kubernetes.io/projected/4beae04b-21db-4d9a-b539-87d182241c2b-kube-api-access-24cmp\") pod \"odh-model-controller-7998c67dc4-wxmsk\" (UID: \"4beae04b-21db-4d9a-b539-87d182241c2b\") " pod="opendatahub/odh-model-controller-7998c67dc4-wxmsk"
Jul 24 15:53:18.101058 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.101061    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4beae04b-21db-4d9a-b539-87d182241c2b-cert\") pod \"odh-model-controller-7998c67dc4-wxmsk\" (UID: \"4beae04b-21db-4d9a-b539-87d182241c2b\") " pod="opendatahub/odh-model-controller-7998c67dc4-wxmsk"
Jul 24 15:53:18.101251 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:53:18.101210    2553 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 24 15:53:18.101288 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:53:18.101282    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4beae04b-21db-4d9a-b539-87d182241c2b-cert podName:4beae04b-21db-4d9a-b539-87d182241c2b nodeName:}" failed. No retries permitted until 2026-07-24 15:53:18.601261165 +0000 UTC m=+352.663710342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4beae04b-21db-4d9a-b539-87d182241c2b-cert") pod "odh-model-controller-7998c67dc4-wxmsk" (UID: "4beae04b-21db-4d9a-b539-87d182241c2b") : secret "odh-model-controller-webhook-cert" not found
Jul 24 15:53:18.109777 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.109755    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24cmp\" (UniqueName: \"kubernetes.io/projected/4beae04b-21db-4d9a-b539-87d182241c2b-kube-api-access-24cmp\") pod \"odh-model-controller-7998c67dc4-wxmsk\" (UID: \"4beae04b-21db-4d9a-b539-87d182241c2b\") " pod="opendatahub/odh-model-controller-7998c67dc4-wxmsk"
Jul 24 15:53:18.546291 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.546254    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sjsnf"]
Jul 24 15:53:18.548450 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.548427    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sjsnf"
Jul 24 15:53:18.552809 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.552780    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 24 15:53:18.581539 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.581504    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sjsnf"]
Jul 24 15:53:18.605077 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.605040    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45kkn\" (UniqueName: \"kubernetes.io/projected/acd2fce5-a2e9-4a7f-8cb8-c2d85795db58-kube-api-access-45kkn\") pod \"model-serving-api-54d89bd5fc-sjsnf\" (UID: \"acd2fce5-a2e9-4a7f-8cb8-c2d85795db58\") " pod="opendatahub/model-serving-api-54d89bd5fc-sjsnf"
Jul 24 15:53:18.605272 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.605095    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acd2fce5-a2e9-4a7f-8cb8-c2d85795db58-tls-certs\") pod \"model-serving-api-54d89bd5fc-sjsnf\" (UID: \"acd2fce5-a2e9-4a7f-8cb8-c2d85795db58\") " pod="opendatahub/model-serving-api-54d89bd5fc-sjsnf"
Jul 24 15:53:18.605272 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.605208    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4beae04b-21db-4d9a-b539-87d182241c2b-cert\") pod \"odh-model-controller-7998c67dc4-wxmsk\" (UID: \"4beae04b-21db-4d9a-b539-87d182241c2b\") " pod="opendatahub/odh-model-controller-7998c67dc4-wxmsk"
Jul 24 15:53:18.607702 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.607673    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4beae04b-21db-4d9a-b539-87d182241c2b-cert\") pod \"odh-model-controller-7998c67dc4-wxmsk\" (UID: \"4beae04b-21db-4d9a-b539-87d182241c2b\") " pod="opendatahub/odh-model-controller-7998c67dc4-wxmsk"
Jul 24 15:53:18.705849 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.705804    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45kkn\" (UniqueName: \"kubernetes.io/projected/acd2fce5-a2e9-4a7f-8cb8-c2d85795db58-kube-api-access-45kkn\") pod \"model-serving-api-54d89bd5fc-sjsnf\" (UID: \"acd2fce5-a2e9-4a7f-8cb8-c2d85795db58\") " pod="opendatahub/model-serving-api-54d89bd5fc-sjsnf"
Jul 24 15:53:18.705849 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.705856    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acd2fce5-a2e9-4a7f-8cb8-c2d85795db58-tls-certs\") pod \"model-serving-api-54d89bd5fc-sjsnf\" (UID: \"acd2fce5-a2e9-4a7f-8cb8-c2d85795db58\") " pod="opendatahub/model-serving-api-54d89bd5fc-sjsnf"
Jul 24 15:53:18.706069 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:53:18.705976    2553 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 24 15:53:18.706069 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:53:18.706029    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acd2fce5-a2e9-4a7f-8cb8-c2d85795db58-tls-certs podName:acd2fce5-a2e9-4a7f-8cb8-c2d85795db58 nodeName:}" failed. No retries permitted until 2026-07-24 15:53:19.206013218 +0000 UTC m=+353.268462386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/acd2fce5-a2e9-4a7f-8cb8-c2d85795db58-tls-certs") pod "model-serving-api-54d89bd5fc-sjsnf" (UID: "acd2fce5-a2e9-4a7f-8cb8-c2d85795db58") : secret "model-serving-api-tls" not found
Jul 24 15:53:18.714863 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.714840    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45kkn\" (UniqueName: \"kubernetes.io/projected/acd2fce5-a2e9-4a7f-8cb8-c2d85795db58-kube-api-access-45kkn\") pod \"model-serving-api-54d89bd5fc-sjsnf\" (UID: \"acd2fce5-a2e9-4a7f-8cb8-c2d85795db58\") " pod="opendatahub/model-serving-api-54d89bd5fc-sjsnf"
Jul 24 15:53:18.842174 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.842068    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wxmsk"
Jul 24 15:53:18.985482 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:18.985450    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wxmsk"]
Jul 24 15:53:18.988125 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:53:18.988094    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4beae04b_21db_4d9a_b539_87d182241c2b.slice/crio-1c9bde36c00499f4fcc07ea5553f2571b8a5047c99bf110c72192b1715d7fa77 WatchSource:0}: Error finding container 1c9bde36c00499f4fcc07ea5553f2571b8a5047c99bf110c72192b1715d7fa77: Status 404 returned error can't find the container with id 1c9bde36c00499f4fcc07ea5553f2571b8a5047c99bf110c72192b1715d7fa77
Jul 24 15:53:19.209979 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:19.209876    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acd2fce5-a2e9-4a7f-8cb8-c2d85795db58-tls-certs\") pod \"model-serving-api-54d89bd5fc-sjsnf\" (UID: \"acd2fce5-a2e9-4a7f-8cb8-c2d85795db58\") " pod="opendatahub/model-serving-api-54d89bd5fc-sjsnf"
Jul 24 15:53:19.212439 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:19.212408    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acd2fce5-a2e9-4a7f-8cb8-c2d85795db58-tls-certs\") pod \"model-serving-api-54d89bd5fc-sjsnf\" (UID: \"acd2fce5-a2e9-4a7f-8cb8-c2d85795db58\") " pod="opendatahub/model-serving-api-54d89bd5fc-sjsnf"
Jul 24 15:53:19.459572 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:19.459528    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sjsnf"
Jul 24 15:53:19.611076 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:19.610899    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sjsnf"]
Jul 24 15:53:19.615019 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:53:19.614985    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd2fce5_a2e9_4a7f_8cb8_c2d85795db58.slice/crio-f43b50a4b1fb4685ddf84095067ad4b95ab92120c81e3b94b3c348e0ac775b1a WatchSource:0}: Error finding container f43b50a4b1fb4685ddf84095067ad4b95ab92120c81e3b94b3c348e0ac775b1a: Status 404 returned error can't find the container with id f43b50a4b1fb4685ddf84095067ad4b95ab92120c81e3b94b3c348e0ac775b1a
Jul 24 15:53:19.841987 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:19.841946    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sjsnf" event={"ID":"acd2fce5-a2e9-4a7f-8cb8-c2d85795db58","Type":"ContainerStarted","Data":"f43b50a4b1fb4685ddf84095067ad4b95ab92120c81e3b94b3c348e0ac775b1a"}
Jul 24 15:53:19.844260 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:19.844187    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wxmsk" event={"ID":"4beae04b-21db-4d9a-b539-87d182241c2b","Type":"ContainerStarted","Data":"1c9bde36c00499f4fcc07ea5553f2571b8a5047c99bf110c72192b1715d7fa77"}
Jul 24 15:53:22.857051 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:22.857008    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sjsnf" event={"ID":"acd2fce5-a2e9-4a7f-8cb8-c2d85795db58","Type":"ContainerStarted","Data":"32cf5b8659e3867b0e4a720d711b34d9a92a78d74bd697daa57cede4e5fa8c95"}
Jul 24 15:53:22.857535 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:22.857201    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-sjsnf"
Jul 24 15:53:22.858746 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:22.858722    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wxmsk" event={"ID":"4beae04b-21db-4d9a-b539-87d182241c2b","Type":"ContainerStarted","Data":"37b424a4c49903a48d914005de857f362eaaa2fbe2d3171eb39373668fc77a13"}
Jul 24 15:53:22.858884 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:22.858871    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-wxmsk"
Jul 24 15:53:22.877327 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:22.877264    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-sjsnf" podStartSLOduration=2.295396861 podStartE2EDuration="4.877245138s" totalImagesPullingTime="2.581848277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:53:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:53:22.876327199 +0000 UTC m=+356.938776386" watchObservedRunningTime="2026-07-24 15:53:22.877245138 +0000 UTC m=+356.939694327"
Jul 24 15:53:22.892228 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:22.892170    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-wxmsk" podStartSLOduration=2.678264698 podStartE2EDuration="5.89215029s" totalImagesPullingTime="3.213885592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:53:22.891665493 +0000 UTC m=+356.954114699" watchObservedRunningTime="2026-07-24 15:53:22.89215029 +0000 UTC m=+356.954599477"
Jul 24 15:53:23.206813 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.206725    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-545786b4d4-68cww"]
Jul 24 15:53:23.209130 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.209106    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545786b4d4-68cww"
Jul 24 15:53:23.211994 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.211969    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9blfk\""
Jul 24 15:53:23.211994 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.211983    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 15:53:23.212176 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.212030    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 15:53:23.212176 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.212162    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 15:53:23.212277 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.212183    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 15:53:23.223454 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.223422    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545786b4d4-68cww"]
Jul 24 15:53:23.349255 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.349217    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c72a80f-277c-4c83-a169-b0670927582a-tls-certs\") pod \"kube-auth-proxy-545786b4d4-68cww\" (UID: \"5c72a80f-277c-4c83-a169-b0670927582a\") " pod="openshift-ingress/kube-auth-proxy-545786b4d4-68cww"
Jul 24 15:53:23.349426 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.349297    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c72a80f-277c-4c83-a169-b0670927582a-tmp\") pod \"kube-auth-proxy-545786b4d4-68cww\" (UID: \"5c72a80f-277c-4c83-a169-b0670927582a\") " pod="openshift-ingress/kube-auth-proxy-545786b4d4-68cww"
Jul 24 15:53:23.349426 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.349340    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6lks\" (UniqueName: \"kubernetes.io/projected/5c72a80f-277c-4c83-a169-b0670927582a-kube-api-access-b6lks\") pod \"kube-auth-proxy-545786b4d4-68cww\" (UID: \"5c72a80f-277c-4c83-a169-b0670927582a\") " pod="openshift-ingress/kube-auth-proxy-545786b4d4-68cww"
Jul 24 15:53:23.450234 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.450200    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c72a80f-277c-4c83-a169-b0670927582a-tls-certs\") pod \"kube-auth-proxy-545786b4d4-68cww\" (UID: \"5c72a80f-277c-4c83-a169-b0670927582a\") " pod="openshift-ingress/kube-auth-proxy-545786b4d4-68cww"
Jul 24 15:53:23.450421 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.450257    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c72a80f-277c-4c83-a169-b0670927582a-tmp\") pod \"kube-auth-proxy-545786b4d4-68cww\" (UID: \"5c72a80f-277c-4c83-a169-b0670927582a\") " pod="openshift-ingress/kube-auth-proxy-545786b4d4-68cww"
Jul 24 15:53:23.450421 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.450293    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6lks\" (UniqueName: \"kubernetes.io/projected/5c72a80f-277c-4c83-a169-b0670927582a-kube-api-access-b6lks\") pod \"kube-auth-proxy-545786b4d4-68cww\" (UID: \"5c72a80f-277c-4c83-a169-b0670927582a\") " pod="openshift-ingress/kube-auth-proxy-545786b4d4-68cww"
Jul 24 15:53:23.452733 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.452699    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c72a80f-277c-4c83-a169-b0670927582a-tmp\") pod \"kube-auth-proxy-545786b4d4-68cww\" (UID: \"5c72a80f-277c-4c83-a169-b0670927582a\") " pod="openshift-ingress/kube-auth-proxy-545786b4d4-68cww"
Jul 24 15:53:23.452887 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.452869    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c72a80f-277c-4c83-a169-b0670927582a-tls-certs\") pod \"kube-auth-proxy-545786b4d4-68cww\" (UID: \"5c72a80f-277c-4c83-a169-b0670927582a\") " pod="openshift-ingress/kube-auth-proxy-545786b4d4-68cww"
Jul 24 15:53:23.459564 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.459478    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6lks\" (UniqueName: \"kubernetes.io/projected/5c72a80f-277c-4c83-a169-b0670927582a-kube-api-access-b6lks\") pod \"kube-auth-proxy-545786b4d4-68cww\" (UID: \"5c72a80f-277c-4c83-a169-b0670927582a\") " pod="openshift-ingress/kube-auth-proxy-545786b4d4-68cww"
Jul 24 15:53:23.518540 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.518501    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545786b4d4-68cww"
Jul 24 15:53:23.662499 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.662462    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545786b4d4-68cww"]
Jul 24 15:53:23.665714 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:53:23.665684    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c72a80f_277c_4c83_a169_b0670927582a.slice/crio-3c3286a9506b9551c71d18422cf85cdafc50fa518e25a2dc7ca2c3a75bec3fa5 WatchSource:0}: Error finding container 3c3286a9506b9551c71d18422cf85cdafc50fa518e25a2dc7ca2c3a75bec3fa5: Status 404 returned error can't find the container with id 3c3286a9506b9551c71d18422cf85cdafc50fa518e25a2dc7ca2c3a75bec3fa5
Jul 24 15:53:23.863607 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:23.863545    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545786b4d4-68cww" event={"ID":"5c72a80f-277c-4c83-a169-b0670927582a","Type":"ContainerStarted","Data":"3c3286a9506b9551c71d18422cf85cdafc50fa518e25a2dc7ca2c3a75bec3fa5"}
Jul 24 15:53:24.182755 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.182665    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"]
Jul 24 15:53:24.185976 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.185952    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.188824 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.188799    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 15:53:24.188949 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.188828    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 15:53:24.188949 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.188799    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 15:53:24.189064 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.188960    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 15:53:24.189192 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.189171    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6rkhw\""
Jul 24 15:53:24.199786 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.199762    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"]
Jul 24 15:53:24.257580 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.257545    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.257580 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.257597    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ca95e0-116f-4768-8346-144b4fb814cc-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.257880 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.257682    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ca95e0-116f-4768-8346-144b4fb814cc-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.257880 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.257720    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdcsh\" (UniqueName: \"kubernetes.io/projected/73ca95e0-116f-4768-8346-144b4fb814cc-kube-api-access-bdcsh\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.257880 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.257752    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.257880 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.257770    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.257880 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.257838    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73ca95e0-116f-4768-8346-144b4fb814cc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.358982 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.358931    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ca95e0-116f-4768-8346-144b4fb814cc-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.359169 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.358995    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdcsh\" (UniqueName: \"kubernetes.io/projected/73ca95e0-116f-4768-8346-144b4fb814cc-kube-api-access-bdcsh\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.359169 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.359036    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.359169 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.359063    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.359169 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.359112    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73ca95e0-116f-4768-8346-144b4fb814cc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.359169 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.359151    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.359414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.359177    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ca95e0-116f-4768-8346-144b4fb814cc-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.360096 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.360045    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73ca95e0-116f-4768-8346-144b4fb814cc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.362107 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.362079    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.362234 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.362091    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.362651 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.362629    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.362983 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.362958    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ca95e0-116f-4768-8346-144b4fb814cc-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.367501 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.367474    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdcsh\" (UniqueName: \"kubernetes.io/projected/73ca95e0-116f-4768-8346-144b4fb814cc-kube-api-access-bdcsh\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.367857 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.367831    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ca95e0-116f-4768-8346-144b4fb814cc-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-6xbpv\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.497782 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.497752    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:24.659442 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.659403    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"]
Jul 24 15:53:24.869206 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:24.869113    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv" event={"ID":"73ca95e0-116f-4768-8346-144b4fb814cc","Type":"ContainerStarted","Data":"2231bd489b94ef7b8f20f2442d8de5a4ffc0b08cd86cf00548c35c65999b90f6"}
Jul 24 15:53:27.119565 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:27.119537    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 15:53:27.146993 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:27.146958    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 15:53:27.147114 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:27.147020    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 15:53:27.884679 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:27.884633    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545786b4d4-68cww" event={"ID":"5c72a80f-277c-4c83-a169-b0670927582a","Type":"ContainerStarted","Data":"3d54ce8813da4f4377a388d551e52f4501d07594c11db9592e4bf1bc61a2a55a"}
Jul 24 15:53:27.886159 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:27.886131    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv" event={"ID":"73ca95e0-116f-4768-8346-144b4fb814cc","Type":"ContainerStarted","Data":"aebed05bf6de6e64e1ed4b46e0ed0b01361bf6a310c97c5085dfc1ee5b961d94"}
Jul 24 15:53:27.886265 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:27.886191    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:27.906360 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:27.906304    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-545786b4d4-68cww" podStartSLOduration=1.457545327 podStartE2EDuration="4.906287761s" totalImagesPullingTime="3.448742434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:53:27.904706013 +0000 UTC m=+361.967155225" watchObservedRunningTime="2026-07-24 15:53:27.906287761 +0000 UTC m=+361.968736984"
Jul 24 15:53:27.931140 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:27.931078    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv" podStartSLOduration=1.449263441 podStartE2EDuration="3.931057119s" totalImagesPullingTime="2.481793678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:53:27.930637319 +0000 UTC m=+361.993086532" watchObservedRunningTime="2026-07-24 15:53:27.931057119 +0000 UTC m=+361.993506307"
Jul 24 15:53:28.803426 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.803389    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"]
Jul 24 15:53:28.806119 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.806090    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:28.811352 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.811327    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7l7pr\""
Jul 24 15:53:28.844725 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.844688    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"]
Jul 24 15:53:28.892228 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.892193    2553 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-6xbpv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 15:53:28.892400 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.892258    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv" podUID="73ca95e0-116f-4768-8346-144b4fb814cc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 15:53:28.898653 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.898627    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:28.898762 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.898661    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:28.898762 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.898694    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:28.898762 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.898747    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch59r\" (UniqueName: \"kubernetes.io/projected/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-kube-api-access-ch59r\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:28.898862 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.898765    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:28.898862 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.898785    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:28.898862 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.898801    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:28.898952 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.898896    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:28.898952 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.898933    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:28.999944 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.999907    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:28.999944 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:28.999947    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.000210 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.000023    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.000210 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.000042    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.000210 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.000089    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.000210 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.000105    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.000210 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.000161    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.000522 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.000247    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch59r\" (UniqueName: \"kubernetes.io/projected/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-kube-api-access-ch59r\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.000522 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.000283    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.000677 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.000553    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.000802 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.000775    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.001039 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.001002    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.001164 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.001046    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.001228 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.001159    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.002933 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.002907    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.003039 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.002971    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.011422 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.011396    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.013706 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.013687    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch59r\" (UniqueName: \"kubernetes.io/projected/e813bdf7-8c74-4f62-b0fc-5a3c22ad2147-kube-api-access-ch59r\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f\" (UID: \"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.117710 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.117621    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:29.274622 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.274579    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"]
Jul 24 15:53:29.277849 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:53:29.277805    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode813bdf7_8c74_4f62_b0fc_5a3c22ad2147.slice/crio-c07a8d929d1f6fc33460fa8ee85cee2c8a41db4e9c7d7d2e71f1e7cc39529bbe WatchSource:0}: Error finding container c07a8d929d1f6fc33460fa8ee85cee2c8a41db4e9c7d7d2e71f1e7cc39529bbe: Status 404 returned error can't find the container with id c07a8d929d1f6fc33460fa8ee85cee2c8a41db4e9c7d7d2e71f1e7cc39529bbe
Jul 24 15:53:29.355765 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.355726    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-n47dv"]
Jul 24 15:53:29.360173 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.360150    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n47dv"
Jul 24 15:53:29.363820 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.363796    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 24 15:53:29.364266 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.364250    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6kvf6\""
Jul 24 15:53:29.376443 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.376413    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-n47dv"]
Jul 24 15:53:29.377791 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.377766    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz"]
Jul 24 15:53:29.381055 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.381034    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz"
Jul 24 15:53:29.384796 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.384504    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 24 15:53:29.384796 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.384637    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-kxb67\""
Jul 24 15:53:29.395095 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.395022    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz"]
Jul 24 15:53:29.510768 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.510732    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t4jsz\" (UID: \"1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz"
Jul 24 15:53:29.510963 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.510780    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsbh6\" (UniqueName: \"kubernetes.io/projected/1052acd7-34b5-4b6d-8fa1-f981c4436b44-kube-api-access-fsbh6\") pod \"kserve-controller-manager-d6f4b65b8-n47dv\" (UID: \"1052acd7-34b5-4b6d-8fa1-f981c4436b44\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n47dv"
Jul 24 15:53:29.510963 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.510873    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1052acd7-34b5-4b6d-8fa1-f981c4436b44-cert\") pod \"kserve-controller-manager-d6f4b65b8-n47dv\" (UID: \"1052acd7-34b5-4b6d-8fa1-f981c4436b44\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n47dv"
Jul 24 15:53:29.510963 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.510904    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdmd8\" (UniqueName: \"kubernetes.io/projected/1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94-kube-api-access-sdmd8\") pod \"llmisvc-controller-manager-777c6bd7d5-t4jsz\" (UID: \"1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz"
Jul 24 15:53:29.612026 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.611992    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t4jsz\" (UID: \"1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz"
Jul 24 15:53:29.612026 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.612032    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsbh6\" (UniqueName: \"kubernetes.io/projected/1052acd7-34b5-4b6d-8fa1-f981c4436b44-kube-api-access-fsbh6\") pod \"kserve-controller-manager-d6f4b65b8-n47dv\" (UID: \"1052acd7-34b5-4b6d-8fa1-f981c4436b44\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n47dv"
Jul 24 15:53:29.612234 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.612066    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1052acd7-34b5-4b6d-8fa1-f981c4436b44-cert\") pod \"kserve-controller-manager-d6f4b65b8-n47dv\" (UID: \"1052acd7-34b5-4b6d-8fa1-f981c4436b44\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n47dv"
Jul 24 15:53:29.612234 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:53:29.612170    2553 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 24 15:53:29.612327 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.612171    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdmd8\" (UniqueName: \"kubernetes.io/projected/1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94-kube-api-access-sdmd8\") pod \"llmisvc-controller-manager-777c6bd7d5-t4jsz\" (UID: \"1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz"
Jul 24 15:53:29.612327 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:53:29.612241    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94-cert podName:1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94 nodeName:}" failed. No retries permitted until 2026-07-24 15:53:30.112220459 +0000 UTC m=+364.174669630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94-cert") pod "llmisvc-controller-manager-777c6bd7d5-t4jsz" (UID: "1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94") : secret "llmisvc-webhook-server-cert" not found
Jul 24 15:53:29.614555 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.614534    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1052acd7-34b5-4b6d-8fa1-f981c4436b44-cert\") pod \"kserve-controller-manager-d6f4b65b8-n47dv\" (UID: \"1052acd7-34b5-4b6d-8fa1-f981c4436b44\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n47dv"
Jul 24 15:53:29.627345 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.627278    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdmd8\" (UniqueName: \"kubernetes.io/projected/1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94-kube-api-access-sdmd8\") pod \"llmisvc-controller-manager-777c6bd7d5-t4jsz\" (UID: \"1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz"
Jul 24 15:53:29.629293 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.629274    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsbh6\" (UniqueName: \"kubernetes.io/projected/1052acd7-34b5-4b6d-8fa1-f981c4436b44-kube-api-access-fsbh6\") pod \"kserve-controller-manager-d6f4b65b8-n47dv\" (UID: \"1052acd7-34b5-4b6d-8fa1-f981c4436b44\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n47dv"
Jul 24 15:53:29.673124 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.673087    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n47dv"
Jul 24 15:53:29.808395 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.808346    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-n47dv"]
Jul 24 15:53:29.810916 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:53:29.810883    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1052acd7_34b5_4b6d_8fa1_f981c4436b44.slice/crio-db4bbdccfe07f5c30662b24c745cf9583aa3a4cc666e69c181b78aa73ac04d31 WatchSource:0}: Error finding container db4bbdccfe07f5c30662b24c745cf9583aa3a4cc666e69c181b78aa73ac04d31: Status 404 returned error can't find the container with id db4bbdccfe07f5c30662b24c745cf9583aa3a4cc666e69c181b78aa73ac04d31
Jul 24 15:53:29.896642 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.896526    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f" event={"ID":"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147","Type":"ContainerStarted","Data":"c07a8d929d1f6fc33460fa8ee85cee2c8a41db4e9c7d7d2e71f1e7cc39529bbe"}
Jul 24 15:53:29.897621 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:29.897595    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n47dv" event={"ID":"1052acd7-34b5-4b6d-8fa1-f981c4436b44","Type":"ContainerStarted","Data":"db4bbdccfe07f5c30662b24c745cf9583aa3a4cc666e69c181b78aa73ac04d31"}
Jul 24 15:53:30.117950 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:30.117907    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t4jsz\" (UID: \"1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz"
Jul 24 15:53:30.120635 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:30.120608    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t4jsz\" (UID: \"1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz"
Jul 24 15:53:30.293732 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:30.293695    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz"
Jul 24 15:53:30.448456 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:30.448420    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz"]
Jul 24 15:53:30.452133 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:53:30.452089    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1ef4d6c7_7fe4_4cbc_b215_d7b46b223a94.slice/crio-e598de0982dc7c4ced18afd733b51dbf53117f6fe02fe88062368ae7e23f7b61 WatchSource:0}: Error finding container e598de0982dc7c4ced18afd733b51dbf53117f6fe02fe88062368ae7e23f7b61: Status 404 returned error can't find the container with id e598de0982dc7c4ced18afd733b51dbf53117f6fe02fe88062368ae7e23f7b61
Jul 24 15:53:30.903727 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:30.903689    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz" event={"ID":"1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94","Type":"ContainerStarted","Data":"e598de0982dc7c4ced18afd733b51dbf53117f6fe02fe88062368ae7e23f7b61"}
Jul 24 15:53:31.255341 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:31.255304    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"]
Jul 24 15:53:31.256400 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:31.255561    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv" podUID="73ca95e0-116f-4768-8346-144b4fb814cc" containerName="discovery" containerID="cri-o://aebed05bf6de6e64e1ed4b46e0ed0b01361bf6a310c97c5085dfc1ee5b961d94" gracePeriod=30
Jul 24 15:53:31.257120 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:31.257096    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:32.700795 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.700725    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 15:53:32.701246 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.700852    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 15:53:32.701246 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.700901    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 15:53:32.721313 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.721217    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:32.844935 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.844848    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-cacerts\") pod \"73ca95e0-116f-4768-8346-144b4fb814cc\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") "
Jul 24 15:53:32.844935 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.844893    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73ca95e0-116f-4768-8346-144b4fb814cc-istio-csr-ca-configmap\") pod \"73ca95e0-116f-4768-8346-144b4fb814cc\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") "
Jul 24 15:53:32.845157 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.844956    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-istio-csr-dns-cert\") pod \"73ca95e0-116f-4768-8346-144b4fb814cc\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") "
Jul 24 15:53:32.845157 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.845086    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdcsh\" (UniqueName: \"kubernetes.io/projected/73ca95e0-116f-4768-8346-144b4fb814cc-kube-api-access-bdcsh\") pod \"73ca95e0-116f-4768-8346-144b4fb814cc\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") "
Jul 24 15:53:32.845157 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.845135    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ca95e0-116f-4768-8346-144b4fb814cc-istio-token\") pod \"73ca95e0-116f-4768-8346-144b4fb814cc\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") "
Jul 24 15:53:32.845326 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.845190    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ca95e0-116f-4768-8346-144b4fb814cc-local-certs\") pod \"73ca95e0-116f-4768-8346-144b4fb814cc\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") "
Jul 24 15:53:32.845326 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.845223    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-istio-kubeconfig\") pod \"73ca95e0-116f-4768-8346-144b4fb814cc\" (UID: \"73ca95e0-116f-4768-8346-144b4fb814cc\") "
Jul 24 15:53:32.845690 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.845658    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73ca95e0-116f-4768-8346-144b4fb814cc-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "73ca95e0-116f-4768-8346-144b4fb814cc" (UID: "73ca95e0-116f-4768-8346-144b4fb814cc"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:53:32.847786 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.847755    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-cacerts" (OuterVolumeSpecName: "cacerts") pod "73ca95e0-116f-4768-8346-144b4fb814cc" (UID: "73ca95e0-116f-4768-8346-144b4fb814cc"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:53:32.847891 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.847806    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ca95e0-116f-4768-8346-144b4fb814cc-local-certs" (OuterVolumeSpecName: "local-certs") pod "73ca95e0-116f-4768-8346-144b4fb814cc" (UID: "73ca95e0-116f-4768-8346-144b4fb814cc"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:53:32.847891 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.847848    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "73ca95e0-116f-4768-8346-144b4fb814cc" (UID: "73ca95e0-116f-4768-8346-144b4fb814cc"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:53:32.848036 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.848006    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73ca95e0-116f-4768-8346-144b4fb814cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "73ca95e0-116f-4768-8346-144b4fb814cc" (UID: "73ca95e0-116f-4768-8346-144b4fb814cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:53:32.848101 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.848078    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73ca95e0-116f-4768-8346-144b4fb814cc-kube-api-access-bdcsh" (OuterVolumeSpecName: "kube-api-access-bdcsh") pod "73ca95e0-116f-4768-8346-144b4fb814cc" (UID: "73ca95e0-116f-4768-8346-144b4fb814cc"). InnerVolumeSpecName "kube-api-access-bdcsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:53:32.848252 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.848234    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "73ca95e0-116f-4768-8346-144b4fb814cc" (UID: "73ca95e0-116f-4768-8346-144b4fb814cc"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:53:32.913920 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.913888    2553 generic.go:356] "Generic (PLEG): container finished" podID="73ca95e0-116f-4768-8346-144b4fb814cc" containerID="aebed05bf6de6e64e1ed4b46e0ed0b01361bf6a310c97c5085dfc1ee5b961d94" exitCode=0
Jul 24 15:53:32.914093 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.913937    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"
Jul 24 15:53:32.914093 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.913947    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv" event={"ID":"73ca95e0-116f-4768-8346-144b4fb814cc","Type":"ContainerDied","Data":"aebed05bf6de6e64e1ed4b46e0ed0b01361bf6a310c97c5085dfc1ee5b961d94"}
Jul 24 15:53:32.914093 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.913988    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv" event={"ID":"73ca95e0-116f-4768-8346-144b4fb814cc","Type":"ContainerDied","Data":"2231bd489b94ef7b8f20f2442d8de5a4ffc0b08cd86cf00548c35c65999b90f6"}
Jul 24 15:53:32.914093 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.914008    2553 scope.go:117] "RemoveContainer" containerID="aebed05bf6de6e64e1ed4b46e0ed0b01361bf6a310c97c5085dfc1ee5b961d94"
Jul 24 15:53:32.931692 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.931633    2553 scope.go:117] "RemoveContainer" containerID="aebed05bf6de6e64e1ed4b46e0ed0b01361bf6a310c97c5085dfc1ee5b961d94"
Jul 24 15:53:32.931953 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:53:32.931930    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aebed05bf6de6e64e1ed4b46e0ed0b01361bf6a310c97c5085dfc1ee5b961d94\": container with ID starting with aebed05bf6de6e64e1ed4b46e0ed0b01361bf6a310c97c5085dfc1ee5b961d94 not found: ID does not exist" containerID="aebed05bf6de6e64e1ed4b46e0ed0b01361bf6a310c97c5085dfc1ee5b961d94"
Jul 24 15:53:32.932006 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.931961    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebed05bf6de6e64e1ed4b46e0ed0b01361bf6a310c97c5085dfc1ee5b961d94"} err="failed to get container status \"aebed05bf6de6e64e1ed4b46e0ed0b01361bf6a310c97c5085dfc1ee5b961d94\": rpc error: code = NotFound desc = could not find container \"aebed05bf6de6e64e1ed4b46e0ed0b01361bf6a310c97c5085dfc1ee5b961d94\": container with ID starting with aebed05bf6de6e64e1ed4b46e0ed0b01361bf6a310c97c5085dfc1ee5b961d94 not found: ID does not exist"
Jul 24 15:53:32.938407 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.938382    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"]
Jul 24 15:53:32.942879 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.942844    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6xbpv"]
Jul 24 15:53:32.946732 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.946710    2553 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ca95e0-116f-4768-8346-144b4fb814cc-local-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:53:32.946732 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.946732    2553 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-istio-kubeconfig\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:53:32.946878 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.946741    2553 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-cacerts\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:53:32.946878 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.946758    2553 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73ca95e0-116f-4768-8346-144b4fb814cc-istio-csr-ca-configmap\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:53:32.946878 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.946768    2553 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73ca95e0-116f-4768-8346-144b4fb814cc-istio-csr-dns-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:53:32.946878 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.946777    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdcsh\" (UniqueName: \"kubernetes.io/projected/73ca95e0-116f-4768-8346-144b4fb814cc-kube-api-access-bdcsh\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:53:32.946878 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:32.946785    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ca95e0-116f-4768-8346-144b4fb814cc-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:53:33.866480 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:33.866449    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-wxmsk"
Jul 24 15:53:33.869132 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:33.869101    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-sjsnf"
Jul 24 15:53:33.932159 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:33.932115    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f" event={"ID":"e813bdf7-8c74-4f62-b0fc-5a3c22ad2147","Type":"ContainerStarted","Data":"35ba5cfbf1cd2f7a598fbe38877e1a01b8a34f59801f613f4f39bf3b805e4a76"}
Jul 24 15:53:33.933962 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:33.933923    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n47dv" event={"ID":"1052acd7-34b5-4b6d-8fa1-f981c4436b44","Type":"ContainerStarted","Data":"b247c69ef001a33daac14db4119a4a09246177c89beb344a418771c6839bd649"}
Jul 24 15:53:33.934084 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:33.934064    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n47dv"
Jul 24 15:53:33.954649 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:33.954580    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f" podStartSLOduration=2.534378056 podStartE2EDuration="5.954562664s" totalImagesPullingTime="3.420184608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:53:33.953603656 +0000 UTC m=+368.016052864" watchObservedRunningTime="2026-07-24 15:53:33.954562664 +0000 UTC m=+368.017011885"
Jul 24 15:53:33.969486 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:33.969426    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n47dv" podStartSLOduration=2.08126764 podStartE2EDuration="4.969409636s" totalImagesPullingTime="2.888141996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:53:33.968930218 +0000 UTC m=+368.031379406" watchObservedRunningTime="2026-07-24 15:53:33.969409636 +0000 UTC m=+368.031858826"
Jul 24 15:53:34.118223 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:34.118137    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:34.123565 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:34.123523    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:34.475271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:34.475178    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73ca95e0-116f-4768-8346-144b4fb814cc" path="/var/lib/kubelet/pods/73ca95e0-116f-4768-8346-144b4fb814cc/volumes"
Jul 24 15:53:34.940354 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:34.940316    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz" event={"ID":"1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94","Type":"ContainerStarted","Data":"6dd441dd0361dd985709e02c6116a7967e1f0afa234ea9b191ca073efe377804"}
Jul 24 15:53:34.940887 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:34.940779    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:34.941806 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:34.941784    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f"
Jul 24 15:53:34.958691 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:34.958636    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz" podStartSLOduration=1.866790486 podStartE2EDuration="5.95862061s" totalImagesPullingTime="4.091830124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:53:34.957423668 +0000 UTC m=+369.019872868" watchObservedRunningTime="2026-07-24 15:53:34.95862061 +0000 UTC m=+369.021069796"
Jul 24 15:53:35.945900 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:53:35.945870    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz"
Jul 24 15:54:04.945282 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:04.945253    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n47dv"
Jul 24 15:54:06.951989 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:06.951958    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t4jsz"
Jul 24 15:54:18.757031 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:18.756995    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c28fg"]
Jul 24 15:54:18.757469 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:18.757334    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ca95e0-116f-4768-8346-144b4fb814cc" containerName="discovery"
Jul 24 15:54:18.757469 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:18.757347    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ca95e0-116f-4768-8346-144b4fb814cc" containerName="discovery"
Jul 24 15:54:18.757469 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:18.757416    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ca95e0-116f-4768-8346-144b4fb814cc" containerName="discovery"
Jul 24 15:54:18.759977 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:18.759953    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c28fg"
Jul 24 15:54:18.762749 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:18.762723    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 15:54:18.763939 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:18.763919    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 15:54:18.764060 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:18.763925    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hhdnq\""
Jul 24 15:54:18.770934 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:18.770903    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c28fg"]
Jul 24 15:54:18.824130 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:18.824090    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtv9p\" (UniqueName: \"kubernetes.io/projected/14be49db-3436-4c86-82a3-bff3c57e1a49-kube-api-access-vtv9p\") pod \"kuadrant-operator-catalog-c28fg\" (UID: \"14be49db-3436-4c86-82a3-bff3c57e1a49\") " pod="kuadrant-system/kuadrant-operator-catalog-c28fg"
Jul 24 15:54:18.924940 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:18.924901    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtv9p\" (UniqueName: \"kubernetes.io/projected/14be49db-3436-4c86-82a3-bff3c57e1a49-kube-api-access-vtv9p\") pod \"kuadrant-operator-catalog-c28fg\" (UID: \"14be49db-3436-4c86-82a3-bff3c57e1a49\") " pod="kuadrant-system/kuadrant-operator-catalog-c28fg"
Jul 24 15:54:18.943491 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:18.943453    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtv9p\" (UniqueName: \"kubernetes.io/projected/14be49db-3436-4c86-82a3-bff3c57e1a49-kube-api-access-vtv9p\") pod \"kuadrant-operator-catalog-c28fg\" (UID: \"14be49db-3436-4c86-82a3-bff3c57e1a49\") " pod="kuadrant-system/kuadrant-operator-catalog-c28fg"
Jul 24 15:54:19.071244 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:19.071144    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c28fg"
Jul 24 15:54:19.125508 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:19.125475    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c28fg"]
Jul 24 15:54:19.204709 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:19.204679    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c28fg"]
Jul 24 15:54:19.207033 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:54:19.207005    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14be49db_3436_4c86_82a3_bff3c57e1a49.slice/crio-1e9b0def5a22d643cc5d06d765b0d4c4e5d5009b5e99c16af4c730b0b308ada2 WatchSource:0}: Error finding container 1e9b0def5a22d643cc5d06d765b0d4c4e5d5009b5e99c16af4c730b0b308ada2: Status 404 returned error can't find the container with id 1e9b0def5a22d643cc5d06d765b0d4c4e5d5009b5e99c16af4c730b0b308ada2
Jul 24 15:54:19.334885 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:19.334805    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mxszz"]
Jul 24 15:54:19.338133 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:19.338110    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mxszz"
Jul 24 15:54:19.350461 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:19.350435    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mxszz"]
Jul 24 15:54:19.428737 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:19.428700    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frj7k\" (UniqueName: \"kubernetes.io/projected/361e7292-814e-4f73-ba80-0e717f5fd5d0-kube-api-access-frj7k\") pod \"kuadrant-operator-catalog-mxszz\" (UID: \"361e7292-814e-4f73-ba80-0e717f5fd5d0\") " pod="kuadrant-system/kuadrant-operator-catalog-mxszz"
Jul 24 15:54:19.529646 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:19.529606    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frj7k\" (UniqueName: \"kubernetes.io/projected/361e7292-814e-4f73-ba80-0e717f5fd5d0-kube-api-access-frj7k\") pod \"kuadrant-operator-catalog-mxszz\" (UID: \"361e7292-814e-4f73-ba80-0e717f5fd5d0\") " pod="kuadrant-system/kuadrant-operator-catalog-mxszz"
Jul 24 15:54:19.538401 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:19.538370    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frj7k\" (UniqueName: \"kubernetes.io/projected/361e7292-814e-4f73-ba80-0e717f5fd5d0-kube-api-access-frj7k\") pod \"kuadrant-operator-catalog-mxszz\" (UID: \"361e7292-814e-4f73-ba80-0e717f5fd5d0\") " pod="kuadrant-system/kuadrant-operator-catalog-mxszz"
Jul 24 15:54:19.647551 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:19.647463    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mxszz"
Jul 24 15:54:19.779142 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:19.779118    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mxszz"]
Jul 24 15:54:19.781102 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:54:19.781073    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361e7292_814e_4f73_ba80_0e717f5fd5d0.slice/crio-d5f1d0fc86efebd41d60a119501994d647a3b61b37f49bcd5be42dd97bd1d153 WatchSource:0}: Error finding container d5f1d0fc86efebd41d60a119501994d647a3b61b37f49bcd5be42dd97bd1d153: Status 404 returned error can't find the container with id d5f1d0fc86efebd41d60a119501994d647a3b61b37f49bcd5be42dd97bd1d153
Jul 24 15:54:20.126939 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:20.126907    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c28fg" event={"ID":"14be49db-3436-4c86-82a3-bff3c57e1a49","Type":"ContainerStarted","Data":"1e9b0def5a22d643cc5d06d765b0d4c4e5d5009b5e99c16af4c730b0b308ada2"}
Jul 24 15:54:20.128178 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:20.128153    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mxszz" event={"ID":"361e7292-814e-4f73-ba80-0e717f5fd5d0","Type":"ContainerStarted","Data":"d5f1d0fc86efebd41d60a119501994d647a3b61b37f49bcd5be42dd97bd1d153"}
Jul 24 15:54:22.138941 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:22.138891    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c28fg" event={"ID":"14be49db-3436-4c86-82a3-bff3c57e1a49","Type":"ContainerStarted","Data":"087c89276107233cd99f0231ea9965ac822c5fe5f367d05455a6ce8d64611272"}
Jul 24 15:54:22.139385 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:22.138948    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-c28fg" podUID="14be49db-3436-4c86-82a3-bff3c57e1a49" containerName="registry-server" containerID="cri-o://087c89276107233cd99f0231ea9965ac822c5fe5f367d05455a6ce8d64611272" gracePeriod=2
Jul 24 15:54:22.140407 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:22.140377    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mxszz" event={"ID":"361e7292-814e-4f73-ba80-0e717f5fd5d0","Type":"ContainerStarted","Data":"fc6609eb6a45f18d9dab266a2cbe6e74de1eca59b99e5fcfd3c31529c82c9e5f"}
Jul 24 15:54:22.154024 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:22.153973    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-c28fg" podStartSLOduration=2.07544504 podStartE2EDuration="4.153957898s" totalImagesPullingTime="2.078512858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:54:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:54:22.153413002 +0000 UTC m=+416.215862190" watchObservedRunningTime="2026-07-24 15:54:22.153957898 +0000 UTC m=+416.216407111"
Jul 24 15:54:22.169297 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:22.169246    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mxszz" podStartSLOduration=1.663998487 podStartE2EDuration="3.169230346s" totalImagesPullingTime="1.505231859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:54:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:54:22.167260932 +0000 UTC m=+416.229710137" watchObservedRunningTime="2026-07-24 15:54:22.169230346 +0000 UTC m=+416.231679532"
Jul 24 15:54:22.378962 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:22.378931    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c28fg"
Jul 24 15:54:22.459937 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:22.459843    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtv9p\" (UniqueName: \"kubernetes.io/projected/14be49db-3436-4c86-82a3-bff3c57e1a49-kube-api-access-vtv9p\") pod \"14be49db-3436-4c86-82a3-bff3c57e1a49\" (UID: \"14be49db-3436-4c86-82a3-bff3c57e1a49\") "
Jul 24 15:54:22.462036 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:22.462003    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14be49db-3436-4c86-82a3-bff3c57e1a49-kube-api-access-vtv9p" (OuterVolumeSpecName: "kube-api-access-vtv9p") pod "14be49db-3436-4c86-82a3-bff3c57e1a49" (UID: "14be49db-3436-4c86-82a3-bff3c57e1a49"). InnerVolumeSpecName "kube-api-access-vtv9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:54:22.560726 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:22.560684    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtv9p\" (UniqueName: \"kubernetes.io/projected/14be49db-3436-4c86-82a3-bff3c57e1a49-kube-api-access-vtv9p\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:54:23.146711 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:23.146677    2553 generic.go:356] "Generic (PLEG): container finished" podID="14be49db-3436-4c86-82a3-bff3c57e1a49" containerID="087c89276107233cd99f0231ea9965ac822c5fe5f367d05455a6ce8d64611272" exitCode=0
Jul 24 15:54:23.147156 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:23.146721    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c28fg"
Jul 24 15:54:23.147156 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:23.146764    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c28fg" event={"ID":"14be49db-3436-4c86-82a3-bff3c57e1a49","Type":"ContainerDied","Data":"087c89276107233cd99f0231ea9965ac822c5fe5f367d05455a6ce8d64611272"}
Jul 24 15:54:23.147156 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:23.146815    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c28fg" event={"ID":"14be49db-3436-4c86-82a3-bff3c57e1a49","Type":"ContainerDied","Data":"1e9b0def5a22d643cc5d06d765b0d4c4e5d5009b5e99c16af4c730b0b308ada2"}
Jul 24 15:54:23.147156 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:23.146840    2553 scope.go:117] "RemoveContainer" containerID="087c89276107233cd99f0231ea9965ac822c5fe5f367d05455a6ce8d64611272"
Jul 24 15:54:23.155407 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:23.155386    2553 scope.go:117] "RemoveContainer" containerID="087c89276107233cd99f0231ea9965ac822c5fe5f367d05455a6ce8d64611272"
Jul 24 15:54:23.155701 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:54:23.155678    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"087c89276107233cd99f0231ea9965ac822c5fe5f367d05455a6ce8d64611272\": container with ID starting with 087c89276107233cd99f0231ea9965ac822c5fe5f367d05455a6ce8d64611272 not found: ID does not exist" containerID="087c89276107233cd99f0231ea9965ac822c5fe5f367d05455a6ce8d64611272"
Jul 24 15:54:23.155754 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:23.155715    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"087c89276107233cd99f0231ea9965ac822c5fe5f367d05455a6ce8d64611272"} err="failed to get container status \"087c89276107233cd99f0231ea9965ac822c5fe5f367d05455a6ce8d64611272\": rpc error: code = NotFound desc = could not find container \"087c89276107233cd99f0231ea9965ac822c5fe5f367d05455a6ce8d64611272\": container with ID starting with 087c89276107233cd99f0231ea9965ac822c5fe5f367d05455a6ce8d64611272 not found: ID does not exist"
Jul 24 15:54:23.163693 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:23.163657    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c28fg"]
Jul 24 15:54:23.169302 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:23.169278    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c28fg"]
Jul 24 15:54:24.474287 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:24.474250    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14be49db-3436-4c86-82a3-bff3c57e1a49" path="/var/lib/kubelet/pods/14be49db-3436-4c86-82a3-bff3c57e1a49/volumes"
Jul 24 15:54:29.648320 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:29.648284    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mxszz"
Jul 24 15:54:29.648753 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:29.648342    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mxszz"
Jul 24 15:54:29.669633 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:29.669602    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mxszz"
Jul 24 15:54:30.198379 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:30.198354    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mxszz"
Jul 24 15:54:44.043606 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:44.043547    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6s7r"]
Jul 24 15:54:44.044086 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:44.043899    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14be49db-3436-4c86-82a3-bff3c57e1a49" containerName="registry-server"
Jul 24 15:54:44.044086 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:44.043912    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="14be49db-3436-4c86-82a3-bff3c57e1a49" containerName="registry-server"
Jul 24 15:54:44.044086 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:44.043971    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="14be49db-3436-4c86-82a3-bff3c57e1a49" containerName="registry-server"
Jul 24 15:54:44.047280 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:44.047259    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6s7r"
Jul 24 15:54:44.050025 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:44.049999    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 24 15:54:44.050149 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:44.050107    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-s6g2v\""
Jul 24 15:54:44.055478 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:44.055455    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6s7r"]
Jul 24 15:54:44.147735 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:44.147697    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th2hc\" (UniqueName: \"kubernetes.io/projected/0688651d-6d18-43ef-bfb8-f829e79de727-kube-api-access-th2hc\") pod \"dns-operator-controller-manager-864dd78c4c-k6s7r\" (UID: \"0688651d-6d18-43ef-bfb8-f829e79de727\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6s7r"
Jul 24 15:54:44.248665 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:44.248630    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th2hc\" (UniqueName: \"kubernetes.io/projected/0688651d-6d18-43ef-bfb8-f829e79de727-kube-api-access-th2hc\") pod \"dns-operator-controller-manager-864dd78c4c-k6s7r\" (UID: \"0688651d-6d18-43ef-bfb8-f829e79de727\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6s7r"
Jul 24 15:54:44.258769 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:44.258739    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th2hc\" (UniqueName: \"kubernetes.io/projected/0688651d-6d18-43ef-bfb8-f829e79de727-kube-api-access-th2hc\") pod \"dns-operator-controller-manager-864dd78c4c-k6s7r\" (UID: \"0688651d-6d18-43ef-bfb8-f829e79de727\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6s7r"
Jul 24 15:54:44.357528 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:44.357429    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6s7r"
Jul 24 15:54:44.495182 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:44.495154    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6s7r"]
Jul 24 15:54:44.497885 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:54:44.497854    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0688651d_6d18_43ef_bfb8_f829e79de727.slice/crio-c0a19833537391a4b8239b60dfa5de0dde50552c6f4947d93bdbae212057af86 WatchSource:0}: Error finding container c0a19833537391a4b8239b60dfa5de0dde50552c6f4947d93bdbae212057af86: Status 404 returned error can't find the container with id c0a19833537391a4b8239b60dfa5de0dde50552c6f4947d93bdbae212057af86
Jul 24 15:54:45.241604 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:45.241543    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6s7r" event={"ID":"0688651d-6d18-43ef-bfb8-f829e79de727","Type":"ContainerStarted","Data":"c0a19833537391a4b8239b60dfa5de0dde50552c6f4947d93bdbae212057af86"}
Jul 24 15:54:46.247917 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:46.247879    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6s7r" event={"ID":"0688651d-6d18-43ef-bfb8-f829e79de727","Type":"ContainerStarted","Data":"a18faf486719b95751558528495329006e632e6e5fb9ab22c7d36e5c74afac14"}
Jul 24 15:54:46.248400 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:46.248012    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6s7r"
Jul 24 15:54:46.266322 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:46.266267    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6s7r" podStartSLOduration=0.648671127 podStartE2EDuration="2.266251694s" totalImagesPullingTime="1.617580567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:54:46.264944059 +0000 UTC m=+440.327393245" watchObservedRunningTime="2026-07-24 15:54:46.266251694 +0000 UTC m=+440.328700880"
Jul 24 15:54:49.420650 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:49.420544    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"]
Jul 24 15:54:49.423453 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:49.423425    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:54:49.426102 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:49.426082    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-92pjk\""
Jul 24 15:54:49.437322 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:49.437293    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"]
Jul 24 15:54:49.493986 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:49.493947    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs2gb\" (UniqueName: \"kubernetes.io/projected/0358aaef-d28c-4a5e-8a91-a537e255f72f-kube-api-access-fs2gb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" (UID: \"0358aaef-d28c-4a5e-8a91-a537e255f72f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:54:49.493986 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:49.493984    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0358aaef-d28c-4a5e-8a91-a537e255f72f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" (UID: \"0358aaef-d28c-4a5e-8a91-a537e255f72f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:54:49.594861 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:49.594814    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs2gb\" (UniqueName: \"kubernetes.io/projected/0358aaef-d28c-4a5e-8a91-a537e255f72f-kube-api-access-fs2gb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" (UID: \"0358aaef-d28c-4a5e-8a91-a537e255f72f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:54:49.595035 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:49.594867    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0358aaef-d28c-4a5e-8a91-a537e255f72f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" (UID: \"0358aaef-d28c-4a5e-8a91-a537e255f72f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:54:49.595271 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:49.595251    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0358aaef-d28c-4a5e-8a91-a537e255f72f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" (UID: \"0358aaef-d28c-4a5e-8a91-a537e255f72f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:54:49.603791 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:49.603756    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs2gb\" (UniqueName: \"kubernetes.io/projected/0358aaef-d28c-4a5e-8a91-a537e255f72f-kube-api-access-fs2gb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" (UID: \"0358aaef-d28c-4a5e-8a91-a537e255f72f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:54:49.735008 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:49.734908    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:54:49.869514 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:49.869483    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"]
Jul 24 15:54:49.872628 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:54:49.872593    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0358aaef_d28c_4a5e_8a91_a537e255f72f.slice/crio-55024a5c8b4f27fbbcbd4a2fa348cf2d3f34c95840bb1880fb69b10b6ea9479b WatchSource:0}: Error finding container 55024a5c8b4f27fbbcbd4a2fa348cf2d3f34c95840bb1880fb69b10b6ea9479b: Status 404 returned error can't find the container with id 55024a5c8b4f27fbbcbd4a2fa348cf2d3f34c95840bb1880fb69b10b6ea9479b
Jul 24 15:54:50.265985 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:50.265952    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx" event={"ID":"0358aaef-d28c-4a5e-8a91-a537e255f72f","Type":"ContainerStarted","Data":"55024a5c8b4f27fbbcbd4a2fa348cf2d3f34c95840bb1880fb69b10b6ea9479b"}
Jul 24 15:54:53.413140 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:53.413104    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pvkxt"]
Jul 24 15:54:53.416008 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:53.415975    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvkxt"
Jul 24 15:54:53.419982 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:53.419927    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pzbks\""
Jul 24 15:54:53.426163 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:53.426067    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d9sp\" (UniqueName: \"kubernetes.io/projected/b1a17010-bfae-41b8-a10a-3915a6c02c15-kube-api-access-6d9sp\") pod \"authorino-operator-75cc8d5cb7-pvkxt\" (UID: \"b1a17010-bfae-41b8-a10a-3915a6c02c15\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvkxt"
Jul 24 15:54:53.426736 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:53.426714    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pvkxt"]
Jul 24 15:54:53.526792 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:53.526731    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d9sp\" (UniqueName: \"kubernetes.io/projected/b1a17010-bfae-41b8-a10a-3915a6c02c15-kube-api-access-6d9sp\") pod \"authorino-operator-75cc8d5cb7-pvkxt\" (UID: \"b1a17010-bfae-41b8-a10a-3915a6c02c15\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvkxt"
Jul 24 15:54:53.543508 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:53.543472    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d9sp\" (UniqueName: \"kubernetes.io/projected/b1a17010-bfae-41b8-a10a-3915a6c02c15-kube-api-access-6d9sp\") pod \"authorino-operator-75cc8d5cb7-pvkxt\" (UID: \"b1a17010-bfae-41b8-a10a-3915a6c02c15\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvkxt"
Jul 24 15:54:53.729231 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:53.729141    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvkxt"
Jul 24 15:54:54.392974 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:54.392927    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pvkxt"]
Jul 24 15:54:54.395338 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:54:54.395313    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a17010_bfae_41b8_a10a_3915a6c02c15.slice/crio-7c64df6442e53e4c084f859db00cb1ee54366680f8b33f2bcc3559c8d561286f WatchSource:0}: Error finding container 7c64df6442e53e4c084f859db00cb1ee54366680f8b33f2bcc3559c8d561286f: Status 404 returned error can't find the container with id 7c64df6442e53e4c084f859db00cb1ee54366680f8b33f2bcc3559c8d561286f
Jul 24 15:54:55.294617 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:55.293647    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx" event={"ID":"0358aaef-d28c-4a5e-8a91-a537e255f72f","Type":"ContainerStarted","Data":"212653577d6e48f28dc28f52dfd859dbda6c21efac1c1afab35d1c62ffb4fb0d"}
Jul 24 15:54:55.294617 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:55.294047    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:54:55.300941 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:55.300902    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvkxt" event={"ID":"b1a17010-bfae-41b8-a10a-3915a6c02c15","Type":"ContainerStarted","Data":"7c64df6442e53e4c084f859db00cb1ee54366680f8b33f2bcc3559c8d561286f"}
Jul 24 15:54:55.317949 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:55.317885    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx" podStartSLOduration=1.894565641 podStartE2EDuration="6.317862644s" totalImagesPullingTime="4.423297003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:54:55.316736718 +0000 UTC m=+449.379185915" watchObservedRunningTime="2026-07-24 15:54:55.317862644 +0000 UTC m=+449.380311832"
Jul 24 15:54:56.276656 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:56.276613    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"]
Jul 24 15:54:56.283714 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:56.283684    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:54:56.286498 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:56.286471    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pw92b\""
Jul 24 15:54:56.290434 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:56.290365    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"]
Jul 24 15:54:56.353170 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:56.353123    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llw8q\" (UniqueName: \"kubernetes.io/projected/78d96e4f-951d-499f-a9cb-455391f36065-kube-api-access-llw8q\") pod \"limitador-operator-controller-manager-859d7b78bd-f749w\" (UID: \"78d96e4f-951d-499f-a9cb-455391f36065\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:54:56.454149 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:56.454112    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llw8q\" (UniqueName: \"kubernetes.io/projected/78d96e4f-951d-499f-a9cb-455391f36065-kube-api-access-llw8q\") pod \"limitador-operator-controller-manager-859d7b78bd-f749w\" (UID: \"78d96e4f-951d-499f-a9cb-455391f36065\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:54:56.463655 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:56.463563    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llw8q\" (UniqueName: \"kubernetes.io/projected/78d96e4f-951d-499f-a9cb-455391f36065-kube-api-access-llw8q\") pod \"limitador-operator-controller-manager-859d7b78bd-f749w\" (UID: \"78d96e4f-951d-499f-a9cb-455391f36065\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:54:56.596750 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:56.596660    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:54:57.083491 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:57.083386    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"]
Jul 24 15:54:57.085811 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:54:57.085779    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d96e4f_951d_499f_a9cb_455391f36065.slice/crio-db7c3280f21277f867b3bba26917d3f0de3940f2542d50a0ed4090909abd5d1d WatchSource:0}: Error finding container db7c3280f21277f867b3bba26917d3f0de3940f2542d50a0ed4090909abd5d1d: Status 404 returned error can't find the container with id db7c3280f21277f867b3bba26917d3f0de3940f2542d50a0ed4090909abd5d1d
Jul 24 15:54:57.254182 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:57.254143    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6s7r"
Jul 24 15:54:57.313394 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:57.313355    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvkxt" event={"ID":"b1a17010-bfae-41b8-a10a-3915a6c02c15","Type":"ContainerStarted","Data":"54f3e50a748348b9f496a27e58fe1b7433b895e215d8912194a63c912bc42312"}
Jul 24 15:54:57.313556 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:57.313530    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvkxt"
Jul 24 15:54:57.314948 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:57.314918    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w" event={"ID":"78d96e4f-951d-499f-a9cb-455391f36065","Type":"ContainerStarted","Data":"db7c3280f21277f867b3bba26917d3f0de3940f2542d50a0ed4090909abd5d1d"}
Jul 24 15:54:57.332470 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:57.332410    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvkxt" podStartSLOduration=1.746462787 podStartE2EDuration="4.332387893s" totalImagesPullingTime="2.585925106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:54:57.331558058 +0000 UTC m=+451.394007246" watchObservedRunningTime="2026-07-24 15:54:57.332387893 +0000 UTC m=+451.394837083"
Jul 24 15:54:59.325711 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:59.325662    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w" event={"ID":"78d96e4f-951d-499f-a9cb-455391f36065","Type":"ContainerStarted","Data":"fc967b8b0cb41e33934f19ce64799f69f23d5a5338db19d30f3070d87288a53f"}
Jul 24 15:54:59.326108 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:59.325773    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:54:59.344191 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:54:59.344132    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w" podStartSLOduration=2.061859468 podStartE2EDuration="3.344116676s" totalImagesPullingTime="1.282257208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:54:59.342574136 +0000 UTC m=+453.405023322" watchObservedRunningTime="2026-07-24 15:54:59.344116676 +0000 UTC m=+453.406565862"
Jul 24 15:55:06.307405 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:06.307370    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:55:07.827193 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:07.827159    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"]
Jul 24 15:55:07.829681 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:07.829663    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"
Jul 24 15:55:07.853762 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:07.853723    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"]
Jul 24 15:55:07.954050 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:07.954004    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ea74e52-c418-4390-a756-08c616285a67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bmwxt\" (UID: \"6ea74e52-c418-4390-a756-08c616285a67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"
Jul 24 15:55:07.954050 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:07.954059    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk9jf\" (UniqueName: \"kubernetes.io/projected/6ea74e52-c418-4390-a756-08c616285a67-kube-api-access-mk9jf\") pod \"kuadrant-operator-controller-manager-55467d9f7-bmwxt\" (UID: \"6ea74e52-c418-4390-a756-08c616285a67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"
Jul 24 15:55:07.995865 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:07.995831    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"]
Jul 24 15:55:07.996114 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:07.996096    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-mk9jf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt" podUID="6ea74e52-c418-4390-a756-08c616285a67"
Jul 24 15:55:08.006137 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.006106    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"]
Jul 24 15:55:08.018655 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.018618    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"]
Jul 24 15:55:08.018878 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.018850    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" containerName="manager" containerID="cri-o://212653577d6e48f28dc28f52dfd859dbda6c21efac1c1afab35d1c62ffb4fb0d" gracePeriod=2
Jul 24 15:55:08.025147 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.025119    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"]
Jul 24 15:55:08.030105 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.030078    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"]
Jul 24 15:55:08.030560 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.030540    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" containerName="manager"
Jul 24 15:55:08.030670 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.030562    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" containerName="manager"
Jul 24 15:55:08.030741 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.030675    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" containerName="manager"
Jul 24 15:55:08.035146 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.035125    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"
Jul 24 15:55:08.038422 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.038390    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:55:08.042037 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.042014    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"]
Jul 24 15:55:08.042198 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.042179    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w" podUID="78d96e4f-951d-499f-a9cb-455391f36065" containerName="manager" containerID="cri-o://fc967b8b0cb41e33934f19ce64799f69f23d5a5338db19d30f3070d87288a53f" gracePeriod=2
Jul 24 15:55:08.044147 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.044117    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:55:08.048226 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.048199    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"]
Jul 24 15:55:08.052569 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.052537    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"]
Jul 24 15:55:08.052729 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.052710    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"
Jul 24 15:55:08.052788 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.052730    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"]
Jul 24 15:55:08.055274 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.055250    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9jf\" (UniqueName: \"kubernetes.io/projected/6ea74e52-c418-4390-a756-08c616285a67-kube-api-access-mk9jf\") pod \"kuadrant-operator-controller-manager-55467d9f7-bmwxt\" (UID: \"6ea74e52-c418-4390-a756-08c616285a67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"
Jul 24 15:55:08.055380 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.055363    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ea74e52-c418-4390-a756-08c616285a67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bmwxt\" (UID: \"6ea74e52-c418-4390-a756-08c616285a67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"
Jul 24 15:55:08.055751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.055733    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ea74e52-c418-4390-a756-08c616285a67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bmwxt\" (UID: \"6ea74e52-c418-4390-a756-08c616285a67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"
Jul 24 15:55:08.060153 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.060137    2553 projected.go:196] Error preparing data for projected volume kube-api-access-mk9jf for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-bmwxt" not found
Jul 24 15:55:08.060233 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.060220    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ea74e52-c418-4390-a756-08c616285a67-kube-api-access-mk9jf podName:6ea74e52-c418-4390-a756-08c616285a67 nodeName:}" failed. No retries permitted until 2026-07-24 15:55:08.560200916 +0000 UTC m=+462.622650082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mk9jf" (UniqueName: "kubernetes.io/projected/6ea74e52-c418-4390-a756-08c616285a67-kube-api-access-mk9jf") pod "kuadrant-operator-controller-manager-55467d9f7-bmwxt" (UID: "6ea74e52-c418-4390-a756-08c616285a67") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-bmwxt" not found
Jul 24 15:55:08.065652 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.065628    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"]
Jul 24 15:55:08.070778 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.070749    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcql7"]
Jul 24 15:55:08.071110 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.071098    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78d96e4f-951d-499f-a9cb-455391f36065" containerName="manager"
Jul 24 15:55:08.071169 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.071113    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="78d96e4f-951d-499f-a9cb-455391f36065" containerName="manager"
Jul 24 15:55:08.071169 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.071168    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="78d96e4f-951d-499f-a9cb-455391f36065" containerName="manager"
Jul 24 15:55:08.077139 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.077108    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcql7"
Jul 24 15:55:08.078817 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.078748    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:55:08.098881 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.098852    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcql7"]
Jul 24 15:55:08.104656 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.104625    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"]
Jul 24 15:55:08.133516 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.133480    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f749w\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="78d96e4f-951d-499f-a9cb-455391f36065" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:55:08.136076 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.136050    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:55:08.138273 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.138252    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f749w\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="78d96e4f-951d-499f-a9cb-455391f36065" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:55:08.146019 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.145990    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"]
Jul 24 15:55:08.148776 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.148760    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"
Jul 24 15:55:08.156532 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.156185    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s69rw\" (UniqueName: \"kubernetes.io/projected/20aaa390-de98-4744-b987-7f9a655f34b2-kube-api-access-s69rw\") pod \"kuadrant-operator-controller-manager-55467d9f7-x9b84\" (UID: \"20aaa390-de98-4744-b987-7f9a655f34b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"
Jul 24 15:55:08.156532 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.156290    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9e61c29-3f50-413b-9445-d9032ce4149f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s2pht\" (UID: \"f9e61c29-3f50-413b-9445-d9032ce4149f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"
Jul 24 15:55:08.156532 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.156377    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpg5h\" (UniqueName: \"kubernetes.io/projected/f9e61c29-3f50-413b-9445-d9032ce4149f-kube-api-access-zpg5h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s2pht\" (UID: \"f9e61c29-3f50-413b-9445-d9032ce4149f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"
Jul 24 15:55:08.156532 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.156441    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57qz4\" (UniqueName: \"kubernetes.io/projected/09d15212-0071-4805-8415-d4327e0dc30b-kube-api-access-57qz4\") pod \"limitador-operator-controller-manager-859d7b78bd-jcql7\" (UID: \"09d15212-0071-4805-8415-d4327e0dc30b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcql7"
Jul 24 15:55:08.156929 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.156551    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20aaa390-de98-4744-b987-7f9a655f34b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-x9b84\" (UID: \"20aaa390-de98-4744-b987-7f9a655f34b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"
Jul 24 15:55:08.158901 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.158742    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:55:08.159825 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.159388    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-zpg5h], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht" podUID="f9e61c29-3f50-413b-9445-d9032ce4149f"
Jul 24 15:55:08.162679 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.162559    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"]
Jul 24 15:55:08.181114 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.181079    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f749w\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="78d96e4f-951d-499f-a9cb-455391f36065" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:55:08.258488 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.257750    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20aaa390-de98-4744-b987-7f9a655f34b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-x9b84\" (UID: \"20aaa390-de98-4744-b987-7f9a655f34b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"
Jul 24 15:55:08.258488 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.257817    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s69rw\" (UniqueName: \"kubernetes.io/projected/20aaa390-de98-4744-b987-7f9a655f34b2-kube-api-access-s69rw\") pod \"kuadrant-operator-controller-manager-55467d9f7-x9b84\" (UID: \"20aaa390-de98-4744-b987-7f9a655f34b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"
Jul 24 15:55:08.258488 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.257867    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9e61c29-3f50-413b-9445-d9032ce4149f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s2pht\" (UID: \"f9e61c29-3f50-413b-9445-d9032ce4149f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"
Jul 24 15:55:08.258488 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.257930    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpg5h\" (UniqueName: \"kubernetes.io/projected/f9e61c29-3f50-413b-9445-d9032ce4149f-kube-api-access-zpg5h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s2pht\" (UID: \"f9e61c29-3f50-413b-9445-d9032ce4149f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"
Jul 24 15:55:08.258488 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.257965    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rj68\" (UniqueName: \"kubernetes.io/projected/556783ee-892b-4682-bd8c-168e7a4cf8bd-kube-api-access-4rj68\") pod \"kuadrant-operator-controller-manager-86878c769f-6lwgw\" (UID: \"556783ee-892b-4682-bd8c-168e7a4cf8bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"
Jul 24 15:55:08.258488 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.258005    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/556783ee-892b-4682-bd8c-168e7a4cf8bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6lwgw\" (UID: \"556783ee-892b-4682-bd8c-168e7a4cf8bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"
Jul 24 15:55:08.258488 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.258034    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57qz4\" (UniqueName: \"kubernetes.io/projected/09d15212-0071-4805-8415-d4327e0dc30b-kube-api-access-57qz4\") pod \"limitador-operator-controller-manager-859d7b78bd-jcql7\" (UID: \"09d15212-0071-4805-8415-d4327e0dc30b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcql7"
Jul 24 15:55:08.258488 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.258202    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20aaa390-de98-4744-b987-7f9a655f34b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-x9b84\" (UID: \"20aaa390-de98-4744-b987-7f9a655f34b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"
Jul 24 15:55:08.259015 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.258710    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9e61c29-3f50-413b-9445-d9032ce4149f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s2pht\" (UID: \"f9e61c29-3f50-413b-9445-d9032ce4149f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"
Jul 24 15:55:08.274443 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.274394    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpg5h\" (UniqueName: \"kubernetes.io/projected/f9e61c29-3f50-413b-9445-d9032ce4149f-kube-api-access-zpg5h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s2pht\" (UID: \"f9e61c29-3f50-413b-9445-d9032ce4149f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"
Jul 24 15:55:08.275966 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.275940    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57qz4\" (UniqueName: \"kubernetes.io/projected/09d15212-0071-4805-8415-d4327e0dc30b-kube-api-access-57qz4\") pod \"limitador-operator-controller-manager-859d7b78bd-jcql7\" (UID: \"09d15212-0071-4805-8415-d4327e0dc30b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcql7"
Jul 24 15:55:08.277234 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.277208    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s69rw\" (UniqueName: \"kubernetes.io/projected/20aaa390-de98-4744-b987-7f9a655f34b2-kube-api-access-s69rw\") pod \"kuadrant-operator-controller-manager-55467d9f7-x9b84\" (UID: \"20aaa390-de98-4744-b987-7f9a655f34b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"
Jul 24 15:55:08.299080 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.299049    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:55:08.303372 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.303345    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:55:08.308604 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.308562    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f749w\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="78d96e4f-951d-499f-a9cb-455391f36065" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:55:08.322212 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.322186    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvkxt"
Jul 24 15:55:08.322322 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.322259    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:55:08.325033 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.325013    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:55:08.345903 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.345819    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f749w\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="78d96e4f-951d-499f-a9cb-455391f36065" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:55:08.348081 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.348057    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f749w\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="78d96e4f-951d-499f-a9cb-455391f36065" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:55:08.350113 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.350094    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:55:08.359171 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.359142    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llw8q\" (UniqueName: \"kubernetes.io/projected/78d96e4f-951d-499f-a9cb-455391f36065-kube-api-access-llw8q\") pod \"78d96e4f-951d-499f-a9cb-455391f36065\" (UID: \"78d96e4f-951d-499f-a9cb-455391f36065\") "
Jul 24 15:55:08.359311 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.359200    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0358aaef-d28c-4a5e-8a91-a537e255f72f-extensions-socket-volume\") pod \"0358aaef-d28c-4a5e-8a91-a537e255f72f\" (UID: \"0358aaef-d28c-4a5e-8a91-a537e255f72f\") "
Jul 24 15:55:08.359311 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.359296    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs2gb\" (UniqueName: \"kubernetes.io/projected/0358aaef-d28c-4a5e-8a91-a537e255f72f-kube-api-access-fs2gb\") pod \"0358aaef-d28c-4a5e-8a91-a537e255f72f\" (UID: \"0358aaef-d28c-4a5e-8a91-a537e255f72f\") "
Jul 24 15:55:08.359445 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.359414    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rj68\" (UniqueName: \"kubernetes.io/projected/556783ee-892b-4682-bd8c-168e7a4cf8bd-kube-api-access-4rj68\") pod \"kuadrant-operator-controller-manager-86878c769f-6lwgw\" (UID: \"556783ee-892b-4682-bd8c-168e7a4cf8bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"
Jul 24 15:55:08.359511 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.359487    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/556783ee-892b-4682-bd8c-168e7a4cf8bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6lwgw\" (UID: \"556783ee-892b-4682-bd8c-168e7a4cf8bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"
Jul 24 15:55:08.359858 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.359786    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0358aaef-d28c-4a5e-8a91-a537e255f72f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0358aaef-d28c-4a5e-8a91-a537e255f72f" (UID: "0358aaef-d28c-4a5e-8a91-a537e255f72f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:55:08.360069 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.360050    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/556783ee-892b-4682-bd8c-168e7a4cf8bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6lwgw\" (UID: \"556783ee-892b-4682-bd8c-168e7a4cf8bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"
Jul 24 15:55:08.361347 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.361321    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78d96e4f-951d-499f-a9cb-455391f36065-kube-api-access-llw8q" (OuterVolumeSpecName: "kube-api-access-llw8q") pod "78d96e4f-951d-499f-a9cb-455391f36065" (UID: "78d96e4f-951d-499f-a9cb-455391f36065"). InnerVolumeSpecName "kube-api-access-llw8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:55:08.361722 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.361699    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0358aaef-d28c-4a5e-8a91-a537e255f72f-kube-api-access-fs2gb" (OuterVolumeSpecName: "kube-api-access-fs2gb") pod "0358aaef-d28c-4a5e-8a91-a537e255f72f" (UID: "0358aaef-d28c-4a5e-8a91-a537e255f72f"). InnerVolumeSpecName "kube-api-access-fs2gb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:55:08.369999 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.369975    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rj68\" (UniqueName: \"kubernetes.io/projected/556783ee-892b-4682-bd8c-168e7a4cf8bd-kube-api-access-4rj68\") pod \"kuadrant-operator-controller-manager-86878c769f-6lwgw\" (UID: \"556783ee-892b-4682-bd8c-168e7a4cf8bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"
Jul 24 15:55:08.385791 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.385762    2553 generic.go:356] "Generic (PLEG): container finished" podID="0358aaef-d28c-4a5e-8a91-a537e255f72f" containerID="212653577d6e48f28dc28f52dfd859dbda6c21efac1c1afab35d1c62ffb4fb0d" exitCode=0
Jul 24 15:55:08.385977 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.385828    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:55:08.385977 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.385872    2553 scope.go:117] "RemoveContainer" containerID="212653577d6e48f28dc28f52dfd859dbda6c21efac1c1afab35d1c62ffb4fb0d"
Jul 24 15:55:08.387312 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.387292    2553 generic.go:356] "Generic (PLEG): container finished" podID="78d96e4f-951d-499f-a9cb-455391f36065" containerID="fc967b8b0cb41e33934f19ce64799f69f23d5a5338db19d30f3070d87288a53f" exitCode=0
Jul 24 15:55:08.387427 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.387346    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:55:08.387509 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.387492    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"
Jul 24 15:55:08.387720 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.387693    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"
Jul 24 15:55:08.388732 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.388706    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f749w\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="78d96e4f-951d-499f-a9cb-455391f36065" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:55:08.391186 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.391154    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:55:08.393766 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.393736    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:55:08.397031 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.397004    2553 scope.go:117] "RemoveContainer" containerID="212653577d6e48f28dc28f52dfd859dbda6c21efac1c1afab35d1c62ffb4fb0d"
Jul 24 15:55:08.397163 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.397141    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"
Jul 24 15:55:08.397325 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.397307    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"212653577d6e48f28dc28f52dfd859dbda6c21efac1c1afab35d1c62ffb4fb0d\": container with ID starting with 212653577d6e48f28dc28f52dfd859dbda6c21efac1c1afab35d1c62ffb4fb0d not found: ID does not exist" containerID="212653577d6e48f28dc28f52dfd859dbda6c21efac1c1afab35d1c62ffb4fb0d"
Jul 24 15:55:08.397400 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.397333    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"212653577d6e48f28dc28f52dfd859dbda6c21efac1c1afab35d1c62ffb4fb0d"} err="failed to get container status \"212653577d6e48f28dc28f52dfd859dbda6c21efac1c1afab35d1c62ffb4fb0d\": rpc error: code = NotFound desc = could not find container \"212653577d6e48f28dc28f52dfd859dbda6c21efac1c1afab35d1c62ffb4fb0d\": container with ID starting with 212653577d6e48f28dc28f52dfd859dbda6c21efac1c1afab35d1c62ffb4fb0d not found: ID does not exist"
Jul 24 15:55:08.397400 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.397350    2553 scope.go:117] "RemoveContainer" containerID="fc967b8b0cb41e33934f19ce64799f69f23d5a5338db19d30f3070d87288a53f"
Jul 24 15:55:08.400919 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.400899    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"
Jul 24 15:55:08.406868 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.406850    2553 scope.go:117] "RemoveContainer" containerID="fc967b8b0cb41e33934f19ce64799f69f23d5a5338db19d30f3070d87288a53f"
Jul 24 15:55:08.407168 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.407150    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc967b8b0cb41e33934f19ce64799f69f23d5a5338db19d30f3070d87288a53f\": container with ID starting with fc967b8b0cb41e33934f19ce64799f69f23d5a5338db19d30f3070d87288a53f not found: ID does not exist" containerID="fc967b8b0cb41e33934f19ce64799f69f23d5a5338db19d30f3070d87288a53f"
Jul 24 15:55:08.407233 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.407180    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc967b8b0cb41e33934f19ce64799f69f23d5a5338db19d30f3070d87288a53f"} err="failed to get container status \"fc967b8b0cb41e33934f19ce64799f69f23d5a5338db19d30f3070d87288a53f\": rpc error: code = NotFound desc = could not find container \"fc967b8b0cb41e33934f19ce64799f69f23d5a5338db19d30f3070d87288a53f\": container with ID starting with fc967b8b0cb41e33934f19ce64799f69f23d5a5338db19d30f3070d87288a53f not found: ID does not exist"
Jul 24 15:55:08.421509 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.421468    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f749w\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="78d96e4f-951d-499f-a9cb-455391f36065" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:55:08.423744 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.423717    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bmwxt\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="6ea74e52-c418-4390-a756-08c616285a67" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"
Jul 24 15:55:08.425978 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.425956    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fcqcx\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcqcx"
Jul 24 15:55:08.432788 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.432760    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f749w\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="78d96e4f-951d-499f-a9cb-455391f36065" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f749w"
Jul 24 15:55:08.434821 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:08.434801    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bmwxt\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="6ea74e52-c418-4390-a756-08c616285a67" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"
Jul 24 15:55:08.451447 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.451422    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"
Jul 24 15:55:08.460614 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.460565    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ea74e52-c418-4390-a756-08c616285a67-extensions-socket-volume\") pod \"6ea74e52-c418-4390-a756-08c616285a67\" (UID: \"6ea74e52-c418-4390-a756-08c616285a67\") "
Jul 24 15:55:08.460742 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.460667    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpg5h\" (UniqueName: \"kubernetes.io/projected/f9e61c29-3f50-413b-9445-d9032ce4149f-kube-api-access-zpg5h\") pod \"f9e61c29-3f50-413b-9445-d9032ce4149f\" (UID: \"f9e61c29-3f50-413b-9445-d9032ce4149f\") "
Jul 24 15:55:08.460742 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.460715    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9e61c29-3f50-413b-9445-d9032ce4149f-extensions-socket-volume\") pod \"f9e61c29-3f50-413b-9445-d9032ce4149f\" (UID: \"f9e61c29-3f50-413b-9445-d9032ce4149f\") "
Jul 24 15:55:08.460852 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.460807    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ea74e52-c418-4390-a756-08c616285a67-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6ea74e52-c418-4390-a756-08c616285a67" (UID: "6ea74e52-c418-4390-a756-08c616285a67"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:55:08.460975 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.460957    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e61c29-3f50-413b-9445-d9032ce4149f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f9e61c29-3f50-413b-9445-d9032ce4149f" (UID: "f9e61c29-3f50-413b-9445-d9032ce4149f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:55:08.461023 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.460994    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llw8q\" (UniqueName: \"kubernetes.io/projected/78d96e4f-951d-499f-a9cb-455391f36065-kube-api-access-llw8q\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:55:08.461023 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.461013    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0358aaef-d28c-4a5e-8a91-a537e255f72f-extensions-socket-volume\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:55:08.461092 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.461024    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ea74e52-c418-4390-a756-08c616285a67-extensions-socket-volume\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:55:08.461092 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.461035    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs2gb\" (UniqueName: \"kubernetes.io/projected/0358aaef-d28c-4a5e-8a91-a537e255f72f-kube-api-access-fs2gb\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:55:08.461092 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.461044    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk9jf\" (UniqueName: \"kubernetes.io/projected/6ea74e52-c418-4390-a756-08c616285a67-kube-api-access-mk9jf\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:55:08.465030 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.465004    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e61c29-3f50-413b-9445-d9032ce4149f-kube-api-access-zpg5h" (OuterVolumeSpecName: "kube-api-access-zpg5h") pod "f9e61c29-3f50-413b-9445-d9032ce4149f" (UID: "f9e61c29-3f50-413b-9445-d9032ce4149f"). InnerVolumeSpecName "kube-api-access-zpg5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:55:08.469206 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.469173    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcql7"
Jul 24 15:55:08.475003 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.474976    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0358aaef-d28c-4a5e-8a91-a537e255f72f" path="/var/lib/kubelet/pods/0358aaef-d28c-4a5e-8a91-a537e255f72f/volumes"
Jul 24 15:55:08.475371 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.475347    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ea74e52-c418-4390-a756-08c616285a67" path="/var/lib/kubelet/pods/6ea74e52-c418-4390-a756-08c616285a67/volumes"
Jul 24 15:55:08.475676 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.475655    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78d96e4f-951d-499f-a9cb-455391f36065" path="/var/lib/kubelet/pods/78d96e4f-951d-499f-a9cb-455391f36065/volumes"
Jul 24 15:55:08.476152 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.476133    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"
Jul 24 15:55:08.562261 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.562227    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpg5h\" (UniqueName: \"kubernetes.io/projected/f9e61c29-3f50-413b-9445-d9032ce4149f-kube-api-access-zpg5h\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:55:08.562261 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.562262    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9e61c29-3f50-413b-9445-d9032ce4149f-extensions-socket-volume\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:55:08.619310 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.619282    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"]
Jul 24 15:55:08.622216 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:55:08.622179    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20aaa390_de98_4744_b987_7f9a655f34b2.slice/crio-b851e088c9e423a059ece7759fe64014db597bdad3d833e914acf3d36af664a6 WatchSource:0}: Error finding container b851e088c9e423a059ece7759fe64014db597bdad3d833e914acf3d36af664a6: Status 404 returned error can't find the container with id b851e088c9e423a059ece7759fe64014db597bdad3d833e914acf3d36af664a6
Jul 24 15:55:08.857305 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.857269    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcql7"]
Jul 24 15:55:08.859405 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:08.859369    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"]
Jul 24 15:55:08.862100 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:55:08.862076    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d15212_0071_4805_8415_d4327e0dc30b.slice/crio-9a21db7b00cda47354eb27123b24e722b9effbdaf4506ef0c9825ae05e9ca365 WatchSource:0}: Error finding container 9a21db7b00cda47354eb27123b24e722b9effbdaf4506ef0c9825ae05e9ca365: Status 404 returned error can't find the container with id 9a21db7b00cda47354eb27123b24e722b9effbdaf4506ef0c9825ae05e9ca365
Jul 24 15:55:08.862268 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:55:08.862254    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556783ee_892b_4682_bd8c_168e7a4cf8bd.slice/crio-46883a4c6f254ce9c50966010b2ab6fa50df1636224e02fccecc4376099fd757 WatchSource:0}: Error finding container 46883a4c6f254ce9c50966010b2ab6fa50df1636224e02fccecc4376099fd757: Status 404 returned error can't find the container with id 46883a4c6f254ce9c50966010b2ab6fa50df1636224e02fccecc4376099fd757
Jul 24 15:55:09.398311 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.398271    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcql7" event={"ID":"09d15212-0071-4805-8415-d4327e0dc30b","Type":"ContainerStarted","Data":"b916d6aec0adfa8b9ee66bb72e17643e7c3c19d03895012c62ba64775dcf931b"}
Jul 24 15:55:09.398517 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.398330    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcql7" event={"ID":"09d15212-0071-4805-8415-d4327e0dc30b","Type":"ContainerStarted","Data":"9a21db7b00cda47354eb27123b24e722b9effbdaf4506ef0c9825ae05e9ca365"}
Jul 24 15:55:09.398517 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.398388    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcql7"
Jul 24 15:55:09.400164 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.400140    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84" event={"ID":"20aaa390-de98-4744-b987-7f9a655f34b2","Type":"ContainerStarted","Data":"37ff42648982c5ee784a6505accd492e0c9f6cca07eaf116193fc19f22a40a85"}
Jul 24 15:55:09.400313 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.400182    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84" event={"ID":"20aaa390-de98-4744-b987-7f9a655f34b2","Type":"ContainerStarted","Data":"b851e088c9e423a059ece7759fe64014db597bdad3d833e914acf3d36af664a6"}
Jul 24 15:55:09.400313 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.400256    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"
Jul 24 15:55:09.402457 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.402438    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"
Jul 24 15:55:09.402457 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.402455    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"
Jul 24 15:55:09.402619 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.402434    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw" event={"ID":"556783ee-892b-4682-bd8c-168e7a4cf8bd","Type":"ContainerStarted","Data":"61ca03fe52489d812d0d7bc89f921fba4022cc151a41552b0e9ff0c44f44d7d9"}
Jul 24 15:55:09.402619 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.402512    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw" event={"ID":"556783ee-892b-4682-bd8c-168e7a4cf8bd","Type":"ContainerStarted","Data":"46883a4c6f254ce9c50966010b2ab6fa50df1636224e02fccecc4376099fd757"}
Jul 24 15:55:09.421025 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.420968    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcql7" podStartSLOduration=1.420954079 podStartE2EDuration="1.420954079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:55:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:55:09.419393663 +0000 UTC m=+463.481842850" watchObservedRunningTime="2026-07-24 15:55:09.420954079 +0000 UTC m=+463.483403265"
Jul 24 15:55:09.438217 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.438155    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84" podStartSLOduration=1.438137712 podStartE2EDuration="1.438137712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:55:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:55:09.437837304 +0000 UTC m=+463.500286508" watchObservedRunningTime="2026-07-24 15:55:09.438137712 +0000 UTC m=+463.500586902"
Jul 24 15:55:09.468857 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.468823    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"]
Jul 24 15:55:09.474486 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.474459    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s2pht"]
Jul 24 15:55:09.499797 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:09.499748    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw" podStartSLOduration=1.499730898 podStartE2EDuration="1.499730898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:55:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:55:09.499080186 +0000 UTC m=+463.561529373" watchObservedRunningTime="2026-07-24 15:55:09.499730898 +0000 UTC m=+463.562180085"
Jul 24 15:55:09.501302 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:09.501273    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bmwxt\" is forbidden: User \"system:node:ip-10-0-136-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-199.ec2.internal' and this object" podUID="6ea74e52-c418-4390-a756-08c616285a67" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bmwxt"
Jul 24 15:55:10.407468 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:10.407438    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"
Jul 24 15:55:10.481065 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:10.481028    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9e61c29-3f50-413b-9445-d9032ce4149f" path="/var/lib/kubelet/pods/f9e61c29-3f50-413b-9445-d9032ce4149f/volumes"
Jul 24 15:55:20.409448 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:20.409413    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"
Jul 24 15:55:20.409943 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:20.409609    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jcql7"
Jul 24 15:55:21.414383 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:21.414354    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"
Jul 24 15:55:21.473649 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:21.473618    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"]
Jul 24 15:55:21.473855 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:21.473801    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84" podUID="20aaa390-de98-4744-b987-7f9a655f34b2" containerName="manager" containerID="cri-o://37ff42648982c5ee784a6505accd492e0c9f6cca07eaf116193fc19f22a40a85" gracePeriod=10
Jul 24 15:55:21.718217 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:21.718192    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"
Jul 24 15:55:21.881813 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:21.881779    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20aaa390-de98-4744-b987-7f9a655f34b2-extensions-socket-volume\") pod \"20aaa390-de98-4744-b987-7f9a655f34b2\" (UID: \"20aaa390-de98-4744-b987-7f9a655f34b2\") "
Jul 24 15:55:21.881984 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:21.881879    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s69rw\" (UniqueName: \"kubernetes.io/projected/20aaa390-de98-4744-b987-7f9a655f34b2-kube-api-access-s69rw\") pod \"20aaa390-de98-4744-b987-7f9a655f34b2\" (UID: \"20aaa390-de98-4744-b987-7f9a655f34b2\") "
Jul 24 15:55:21.882177 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:21.882150    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20aaa390-de98-4744-b987-7f9a655f34b2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "20aaa390-de98-4744-b987-7f9a655f34b2" (UID: "20aaa390-de98-4744-b987-7f9a655f34b2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:55:21.883969 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:21.883944    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20aaa390-de98-4744-b987-7f9a655f34b2-kube-api-access-s69rw" (OuterVolumeSpecName: "kube-api-access-s69rw") pod "20aaa390-de98-4744-b987-7f9a655f34b2" (UID: "20aaa390-de98-4744-b987-7f9a655f34b2"). InnerVolumeSpecName "kube-api-access-s69rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:55:21.982897 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:21.982802    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20aaa390-de98-4744-b987-7f9a655f34b2-extensions-socket-volume\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:55:21.982897 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:21.982838    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s69rw\" (UniqueName: \"kubernetes.io/projected/20aaa390-de98-4744-b987-7f9a655f34b2-kube-api-access-s69rw\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:55:22.463629 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:22.463566    2553 generic.go:356] "Generic (PLEG): container finished" podID="20aaa390-de98-4744-b987-7f9a655f34b2" containerID="37ff42648982c5ee784a6505accd492e0c9f6cca07eaf116193fc19f22a40a85" exitCode=0
Jul 24 15:55:22.463629 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:22.463619    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84" event={"ID":"20aaa390-de98-4744-b987-7f9a655f34b2","Type":"ContainerDied","Data":"37ff42648982c5ee784a6505accd492e0c9f6cca07eaf116193fc19f22a40a85"}
Jul 24 15:55:22.464152 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:22.463658    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"
Jul 24 15:55:22.464152 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:22.463720    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84" event={"ID":"20aaa390-de98-4744-b987-7f9a655f34b2","Type":"ContainerDied","Data":"b851e088c9e423a059ece7759fe64014db597bdad3d833e914acf3d36af664a6"}
Jul 24 15:55:22.464152 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:22.463757    2553 scope.go:117] "RemoveContainer" containerID="37ff42648982c5ee784a6505accd492e0c9f6cca07eaf116193fc19f22a40a85"
Jul 24 15:55:22.472961 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:22.472942    2553 scope.go:117] "RemoveContainer" containerID="37ff42648982c5ee784a6505accd492e0c9f6cca07eaf116193fc19f22a40a85"
Jul 24 15:55:22.473183 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:55:22.473162    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37ff42648982c5ee784a6505accd492e0c9f6cca07eaf116193fc19f22a40a85\": container with ID starting with 37ff42648982c5ee784a6505accd492e0c9f6cca07eaf116193fc19f22a40a85 not found: ID does not exist" containerID="37ff42648982c5ee784a6505accd492e0c9f6cca07eaf116193fc19f22a40a85"
Jul 24 15:55:22.473228 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:22.473192    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37ff42648982c5ee784a6505accd492e0c9f6cca07eaf116193fc19f22a40a85"} err="failed to get container status \"37ff42648982c5ee784a6505accd492e0c9f6cca07eaf116193fc19f22a40a85\": rpc error: code = NotFound desc = could not find container \"37ff42648982c5ee784a6505accd492e0c9f6cca07eaf116193fc19f22a40a85\": container with ID starting with 37ff42648982c5ee784a6505accd492e0c9f6cca07eaf116193fc19f22a40a85 not found: ID does not exist"
Jul 24 15:55:22.486966 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:22.486943    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"]
Jul 24 15:55:22.490846 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:22.490827    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-x9b84"]
Jul 24 15:55:24.474311 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:24.474281    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20aaa390-de98-4744-b987-7f9a655f34b2" path="/var/lib/kubelet/pods/20aaa390-de98-4744-b987-7f9a655f34b2/volumes"
Jul 24 15:55:37.802147 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.802109    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"]
Jul 24 15:55:37.802659 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.802641    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20aaa390-de98-4744-b987-7f9a655f34b2" containerName="manager"
Jul 24 15:55:37.802747 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.802662    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="20aaa390-de98-4744-b987-7f9a655f34b2" containerName="manager"
Jul 24 15:55:37.802806 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.802754    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="20aaa390-de98-4744-b987-7f9a655f34b2" containerName="manager"
Jul 24 15:55:37.807985 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.807962    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.810737 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.810706    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4jwln\""
Jul 24 15:55:37.819129 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.819104    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"]
Jul 24 15:55:37.825249 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.825220    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd09ada3-9556-463b-8928-af7dfcbf9feb-istio-token\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.825364 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.825269    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-workload-socket\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.825364 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.825305    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd09ada3-9556-463b-8928-af7dfcbf9feb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.825364 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.825359    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlth6\" (UniqueName: \"kubernetes.io/projected/dd09ada3-9556-463b-8928-af7dfcbf9feb-kube-api-access-zlth6\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.825486 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.825386    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-istio-envoy\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.825486 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.825406    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-workload-certs\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.825486 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.825429    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd09ada3-9556-463b-8928-af7dfcbf9feb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.825610 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.825499    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-credential-socket\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.825610 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.825539    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-istio-data\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.925926 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.925890    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd09ada3-9556-463b-8928-af7dfcbf9feb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.925926 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.925931    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlth6\" (UniqueName: \"kubernetes.io/projected/dd09ada3-9556-463b-8928-af7dfcbf9feb-kube-api-access-zlth6\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.926178 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.925954    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-istio-envoy\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.926178 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.925980    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-workload-certs\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.926178 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.926014    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd09ada3-9556-463b-8928-af7dfcbf9feb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.926178 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.926048    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-credential-socket\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.926178 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.926077    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-istio-data\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.926178 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.926112    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd09ada3-9556-463b-8928-af7dfcbf9feb-istio-token\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.926178 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.926169    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-workload-socket\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.926629 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.926480    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-istio-data\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.926629 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.926535    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-credential-socket\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.926629 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.926573    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-workload-socket\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.926796 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.926750    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-workload-certs\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.926857 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.926843    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd09ada3-9556-463b-8928-af7dfcbf9feb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.928312 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.928289    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd09ada3-9556-463b-8928-af7dfcbf9feb-istio-envoy\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.928439 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.928420    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd09ada3-9556-463b-8928-af7dfcbf9feb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.933846 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.933825    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd09ada3-9556-463b-8928-af7dfcbf9feb-istio-token\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:37.934546 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:37.934520    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlth6\" (UniqueName: \"kubernetes.io/projected/dd09ada3-9556-463b-8928-af7dfcbf9feb-kube-api-access-zlth6\") pod \"maas-default-gateway-openshift-default-df6776dd6-slckn\" (UID: \"dd09ada3-9556-463b-8928-af7dfcbf9feb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:38.119414 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:38.119327    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:38.264690 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:38.264647    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"]
Jul 24 15:55:38.266963 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:55:38.266937    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd09ada3_9556_463b_8928_af7dfcbf9feb.slice/crio-e9c3fffa2ee76a5268899d9e49c713247eebc5176e57109027a0629456027f49 WatchSource:0}: Error finding container e9c3fffa2ee76a5268899d9e49c713247eebc5176e57109027a0629456027f49: Status 404 returned error can't find the container with id e9c3fffa2ee76a5268899d9e49c713247eebc5176e57109027a0629456027f49
Jul 24 15:55:38.269023 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:38.268992    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 15:55:38.269099 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:38.269055    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 15:55:38.269099 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:38.269090    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 15:55:38.534932 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:38.534894    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn" event={"ID":"dd09ada3-9556-463b-8928-af7dfcbf9feb","Type":"ContainerStarted","Data":"599d043fb0df862a241ab0426a12bb6980ac451923b800379eb4b6477d22b079"}
Jul 24 15:55:38.535135 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:38.534955    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn" event={"ID":"dd09ada3-9556-463b-8928-af7dfcbf9feb","Type":"ContainerStarted","Data":"e9c3fffa2ee76a5268899d9e49c713247eebc5176e57109027a0629456027f49"}
Jul 24 15:55:38.556419 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:38.556358    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn" podStartSLOduration=1.556342848 podStartE2EDuration="1.556342848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:55:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:55:38.554376171 +0000 UTC m=+492.616825357" watchObservedRunningTime="2026-07-24 15:55:38.556342848 +0000 UTC m=+492.618792034"
Jul 24 15:55:39.119658 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:39.119619    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:39.124316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:39.124288    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:39.539238 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:39.539202    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:39.540231 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:39.540213    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:55:40.479075 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:40.479038    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xx74t"]
Jul 24 15:55:40.481625 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:40.481576    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xx74t"
Jul 24 15:55:40.485608 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:40.485573    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kwhg4\""
Jul 24 15:55:40.503323 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:40.503283    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xx74t"]
Jul 24 15:55:40.555721 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:40.555690    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr47s\" (UniqueName: \"kubernetes.io/projected/ef1535d6-edb7-4d48-bf9e-f50f3286ab62-kube-api-access-wr47s\") pod \"authorino-75d556bd77-xx74t\" (UID: \"ef1535d6-edb7-4d48-bf9e-f50f3286ab62\") " pod="kuadrant-system/authorino-75d556bd77-xx74t"
Jul 24 15:55:40.656762 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:40.656729    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr47s\" (UniqueName: \"kubernetes.io/projected/ef1535d6-edb7-4d48-bf9e-f50f3286ab62-kube-api-access-wr47s\") pod \"authorino-75d556bd77-xx74t\" (UID: \"ef1535d6-edb7-4d48-bf9e-f50f3286ab62\") " pod="kuadrant-system/authorino-75d556bd77-xx74t"
Jul 24 15:55:40.664894 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:40.664869    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr47s\" (UniqueName: \"kubernetes.io/projected/ef1535d6-edb7-4d48-bf9e-f50f3286ab62-kube-api-access-wr47s\") pod \"authorino-75d556bd77-xx74t\" (UID: \"ef1535d6-edb7-4d48-bf9e-f50f3286ab62\") " pod="kuadrant-system/authorino-75d556bd77-xx74t"
Jul 24 15:55:40.790633 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:40.790573    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xx74t"
Jul 24 15:55:40.923776 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:40.923747    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xx74t"]
Jul 24 15:55:40.926211 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:55:40.926183    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef1535d6_edb7_4d48_bf9e_f50f3286ab62.slice/crio-b314ab45df7c9f6f5af8dc693d9991604d637ef1928b5ac60c3f23695b03c26e WatchSource:0}: Error finding container b314ab45df7c9f6f5af8dc693d9991604d637ef1928b5ac60c3f23695b03c26e: Status 404 returned error can't find the container with id b314ab45df7c9f6f5af8dc693d9991604d637ef1928b5ac60c3f23695b03c26e
Jul 24 15:55:41.552127 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:41.552001    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xx74t" event={"ID":"ef1535d6-edb7-4d48-bf9e-f50f3286ab62","Type":"ContainerStarted","Data":"b314ab45df7c9f6f5af8dc693d9991604d637ef1928b5ac60c3f23695b03c26e"}
Jul 24 15:55:44.568698 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:44.568663    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xx74t" event={"ID":"ef1535d6-edb7-4d48-bf9e-f50f3286ab62","Type":"ContainerStarted","Data":"ffc5d003d5b2c255761f2d7dea3691cbb10cc22bd7ff75d53c7390197b9ed640"}
Jul 24 15:55:44.585719 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:55:44.585669    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xx74t" podStartSLOduration=1.6688976210000002 podStartE2EDuration="4.585653069s" totalImagesPullingTime="2.916755448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:55:44.584489495 +0000 UTC m=+498.646938695" watchObservedRunningTime="2026-07-24 15:55:44.585653069 +0000 UTC m=+498.648102271"
Jul 24 15:56:14.310926 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:14.310885    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f7cf95f4d-dqtk5"]
Jul 24 15:56:14.314562 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:14.314538    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f7cf95f4d-dqtk5"
Jul 24 15:56:14.317163 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:14.317143    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 24 15:56:14.322524 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:14.322500    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f7cf95f4d-dqtk5"]
Jul 24 15:56:14.460890 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:14.460856    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a31412a-a8e1-4e77-bd1c-f8c4954b83dd-tls-cert\") pod \"authorino-f7cf95f4d-dqtk5\" (UID: \"9a31412a-a8e1-4e77-bd1c-f8c4954b83dd\") " pod="kuadrant-system/authorino-f7cf95f4d-dqtk5"
Jul 24 15:56:14.461040 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:14.460984    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ktch\" (UniqueName: \"kubernetes.io/projected/9a31412a-a8e1-4e77-bd1c-f8c4954b83dd-kube-api-access-7ktch\") pod \"authorino-f7cf95f4d-dqtk5\" (UID: \"9a31412a-a8e1-4e77-bd1c-f8c4954b83dd\") " pod="kuadrant-system/authorino-f7cf95f4d-dqtk5"
Jul 24 15:56:14.562030 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:14.561938    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ktch\" (UniqueName: \"kubernetes.io/projected/9a31412a-a8e1-4e77-bd1c-f8c4954b83dd-kube-api-access-7ktch\") pod \"authorino-f7cf95f4d-dqtk5\" (UID: \"9a31412a-a8e1-4e77-bd1c-f8c4954b83dd\") " pod="kuadrant-system/authorino-f7cf95f4d-dqtk5"
Jul 24 15:56:14.562030 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:14.561986    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a31412a-a8e1-4e77-bd1c-f8c4954b83dd-tls-cert\") pod \"authorino-f7cf95f4d-dqtk5\" (UID: \"9a31412a-a8e1-4e77-bd1c-f8c4954b83dd\") " pod="kuadrant-system/authorino-f7cf95f4d-dqtk5"
Jul 24 15:56:14.564344 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:14.564325    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a31412a-a8e1-4e77-bd1c-f8c4954b83dd-tls-cert\") pod \"authorino-f7cf95f4d-dqtk5\" (UID: \"9a31412a-a8e1-4e77-bd1c-f8c4954b83dd\") " pod="kuadrant-system/authorino-f7cf95f4d-dqtk5"
Jul 24 15:56:14.570072 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:14.570046    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ktch\" (UniqueName: \"kubernetes.io/projected/9a31412a-a8e1-4e77-bd1c-f8c4954b83dd-kube-api-access-7ktch\") pod \"authorino-f7cf95f4d-dqtk5\" (UID: \"9a31412a-a8e1-4e77-bd1c-f8c4954b83dd\") " pod="kuadrant-system/authorino-f7cf95f4d-dqtk5"
Jul 24 15:56:14.624059 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:14.624020    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f7cf95f4d-dqtk5"
Jul 24 15:56:14.763506 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:14.763465    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f7cf95f4d-dqtk5"]
Jul 24 15:56:14.765935 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:56:14.765906    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a31412a_a8e1_4e77_bd1c_f8c4954b83dd.slice/crio-b3c3451d80790c126bd879547fc1cad3418ff94fe84a9db0ff0e31b82ddb63aa WatchSource:0}: Error finding container b3c3451d80790c126bd879547fc1cad3418ff94fe84a9db0ff0e31b82ddb63aa: Status 404 returned error can't find the container with id b3c3451d80790c126bd879547fc1cad3418ff94fe84a9db0ff0e31b82ddb63aa
Jul 24 15:56:15.712031 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:15.711994    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f7cf95f4d-dqtk5" event={"ID":"9a31412a-a8e1-4e77-bd1c-f8c4954b83dd","Type":"ContainerStarted","Data":"9ac010dd62eb052b42b681aaffb8d30a599771efaed0f4988a5ab5008573bf15"}
Jul 24 15:56:15.712412 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:15.712048    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f7cf95f4d-dqtk5" event={"ID":"9a31412a-a8e1-4e77-bd1c-f8c4954b83dd","Type":"ContainerStarted","Data":"b3c3451d80790c126bd879547fc1cad3418ff94fe84a9db0ff0e31b82ddb63aa"}
Jul 24 15:56:15.729468 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:15.729412    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f7cf95f4d-dqtk5" podStartSLOduration=1.304978672 podStartE2EDuration="1.729393704s" totalImagesPullingTime="424.415032ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:56:15.728707182 +0000 UTC m=+529.791156370" watchObservedRunningTime="2026-07-24 15:56:15.729393704 +0000 UTC m=+529.791842909"
Jul 24 15:56:15.754674 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:15.754638    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xx74t"]
Jul 24 15:56:15.754849 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:15.754825    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xx74t" podUID="ef1535d6-edb7-4d48-bf9e-f50f3286ab62" containerName="authorino" containerID="cri-o://ffc5d003d5b2c255761f2d7dea3691cbb10cc22bd7ff75d53c7390197b9ed640" gracePeriod=30
Jul 24 15:56:15.999870 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:15.999841    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xx74t"
Jul 24 15:56:16.176882 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:16.176847    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr47s\" (UniqueName: \"kubernetes.io/projected/ef1535d6-edb7-4d48-bf9e-f50f3286ab62-kube-api-access-wr47s\") pod \"ef1535d6-edb7-4d48-bf9e-f50f3286ab62\" (UID: \"ef1535d6-edb7-4d48-bf9e-f50f3286ab62\") "
Jul 24 15:56:16.178920 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:16.178892    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef1535d6-edb7-4d48-bf9e-f50f3286ab62-kube-api-access-wr47s" (OuterVolumeSpecName: "kube-api-access-wr47s") pod "ef1535d6-edb7-4d48-bf9e-f50f3286ab62" (UID: "ef1535d6-edb7-4d48-bf9e-f50f3286ab62"). InnerVolumeSpecName "kube-api-access-wr47s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:56:16.277507 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:16.277470    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr47s\" (UniqueName: \"kubernetes.io/projected/ef1535d6-edb7-4d48-bf9e-f50f3286ab62-kube-api-access-wr47s\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:56:16.717770 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:16.717680    2553 generic.go:356] "Generic (PLEG): container finished" podID="ef1535d6-edb7-4d48-bf9e-f50f3286ab62" containerID="ffc5d003d5b2c255761f2d7dea3691cbb10cc22bd7ff75d53c7390197b9ed640" exitCode=0
Jul 24 15:56:16.717770 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:16.717722    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xx74t"
Jul 24 15:56:16.717770 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:16.717754    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xx74t" event={"ID":"ef1535d6-edb7-4d48-bf9e-f50f3286ab62","Type":"ContainerDied","Data":"ffc5d003d5b2c255761f2d7dea3691cbb10cc22bd7ff75d53c7390197b9ed640"}
Jul 24 15:56:16.718277 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:16.717792    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xx74t" event={"ID":"ef1535d6-edb7-4d48-bf9e-f50f3286ab62","Type":"ContainerDied","Data":"b314ab45df7c9f6f5af8dc693d9991604d637ef1928b5ac60c3f23695b03c26e"}
Jul 24 15:56:16.718277 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:16.717814    2553 scope.go:117] "RemoveContainer" containerID="ffc5d003d5b2c255761f2d7dea3691cbb10cc22bd7ff75d53c7390197b9ed640"
Jul 24 15:56:16.726264 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:16.726242    2553 scope.go:117] "RemoveContainer" containerID="ffc5d003d5b2c255761f2d7dea3691cbb10cc22bd7ff75d53c7390197b9ed640"
Jul 24 15:56:16.726522 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:56:16.726501    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffc5d003d5b2c255761f2d7dea3691cbb10cc22bd7ff75d53c7390197b9ed640\": container with ID starting with ffc5d003d5b2c255761f2d7dea3691cbb10cc22bd7ff75d53c7390197b9ed640 not found: ID does not exist" containerID="ffc5d003d5b2c255761f2d7dea3691cbb10cc22bd7ff75d53c7390197b9ed640"
Jul 24 15:56:16.726612 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:16.726531    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc5d003d5b2c255761f2d7dea3691cbb10cc22bd7ff75d53c7390197b9ed640"} err="failed to get container status \"ffc5d003d5b2c255761f2d7dea3691cbb10cc22bd7ff75d53c7390197b9ed640\": rpc error: code = NotFound desc = could not find container \"ffc5d003d5b2c255761f2d7dea3691cbb10cc22bd7ff75d53c7390197b9ed640\": container with ID starting with ffc5d003d5b2c255761f2d7dea3691cbb10cc22bd7ff75d53c7390197b9ed640 not found: ID does not exist"
Jul 24 15:56:16.733039 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:16.733012    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xx74t"]
Jul 24 15:56:16.735689 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:16.735664    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xx74t"]
Jul 24 15:56:18.474176 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:18.474082    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef1535d6-edb7-4d48-bf9e-f50f3286ab62" path="/var/lib/kubelet/pods/ef1535d6-edb7-4d48-bf9e-f50f3286ab62/volumes"
Jul 24 15:56:57.319250 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.319212    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4"]
Jul 24 15:56:57.319806 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.319788    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1535d6-edb7-4d48-bf9e-f50f3286ab62" containerName="authorino"
Jul 24 15:56:57.319855 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.319809    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1535d6-edb7-4d48-bf9e-f50f3286ab62" containerName="authorino"
Jul 24 15:56:57.319890 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.319879    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1535d6-edb7-4d48-bf9e-f50f3286ab62" containerName="authorino"
Jul 24 15:56:57.322858 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.322836    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4"
Jul 24 15:56:57.326052 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.326032    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 24 15:56:57.326369 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.326348    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lz2zg\""
Jul 24 15:56:57.333764 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.333739    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4"]
Jul 24 15:56:57.443754 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.443715    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nhpg\" (UniqueName: \"kubernetes.io/projected/00a5537d-de57-401d-9d0b-6e2defb83d2b-kube-api-access-9nhpg\") pod \"payload-pre-processing-687dbb6cf6-x5df4\" (UID: \"00a5537d-de57-401d-9d0b-6e2defb83d2b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4"
Jul 24 15:56:57.443939 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.443837    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00a5537d-de57-401d-9d0b-6e2defb83d2b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-x5df4\" (UID: \"00a5537d-de57-401d-9d0b-6e2defb83d2b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4"
Jul 24 15:56:57.544659 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.544628    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00a5537d-de57-401d-9d0b-6e2defb83d2b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-x5df4\" (UID: \"00a5537d-de57-401d-9d0b-6e2defb83d2b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4"
Jul 24 15:56:57.544825 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.544682    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhpg\" (UniqueName: \"kubernetes.io/projected/00a5537d-de57-401d-9d0b-6e2defb83d2b-kube-api-access-9nhpg\") pod \"payload-pre-processing-687dbb6cf6-x5df4\" (UID: \"00a5537d-de57-401d-9d0b-6e2defb83d2b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4"
Jul 24 15:56:57.545345 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.545324    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00a5537d-de57-401d-9d0b-6e2defb83d2b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-x5df4\" (UID: \"00a5537d-de57-401d-9d0b-6e2defb83d2b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4"
Jul 24 15:56:57.552570 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.552541    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nhpg\" (UniqueName: \"kubernetes.io/projected/00a5537d-de57-401d-9d0b-6e2defb83d2b-kube-api-access-9nhpg\") pod \"payload-pre-processing-687dbb6cf6-x5df4\" (UID: \"00a5537d-de57-401d-9d0b-6e2defb83d2b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4"
Jul 24 15:56:57.634071 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.633983    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4"
Jul 24 15:56:57.771724 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.771693    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4"]
Jul 24 15:56:57.774276 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:56:57.774233    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a5537d_de57_401d_9d0b_6e2defb83d2b.slice/crio-a3e919124a176825ac9d2de736841aefac84e4f649a57f5f184ca56225bc1032 WatchSource:0}: Error finding container a3e919124a176825ac9d2de736841aefac84e4f649a57f5f184ca56225bc1032: Status 404 returned error can't find the container with id a3e919124a176825ac9d2de736841aefac84e4f649a57f5f184ca56225bc1032
Jul 24 15:56:57.898778 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:56:57.898687    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4" event={"ID":"00a5537d-de57-401d-9d0b-6e2defb83d2b","Type":"ContainerStarted","Data":"a3e919124a176825ac9d2de736841aefac84e4f649a57f5f184ca56225bc1032"}
Jul 24 15:57:00.916963 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:00.916861    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4" event={"ID":"00a5537d-de57-401d-9d0b-6e2defb83d2b","Type":"ContainerStarted","Data":"6183965ed011be12451e1dee6e6e6f29142cb4d6b538efd110735471a4351c74"}
Jul 24 15:57:00.917332 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:00.917081    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4"
Jul 24 15:57:00.934574 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:00.934509    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4" podStartSLOduration=1.04567617 podStartE2EDuration="3.934494121s" totalImagesPullingTime="2.888817951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:57:00.932153213 +0000 UTC m=+574.994602401" watchObservedRunningTime="2026-07-24 15:57:00.934494121 +0000 UTC m=+574.996943308"
Jul 24 15:57:04.938855 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:04.938767    2553 generic.go:356] "Generic (PLEG): container finished" podID="dd09ada3-9556-463b-8928-af7dfcbf9feb" containerID="599d043fb0df862a241ab0426a12bb6980ac451923b800379eb4b6477d22b079" exitCode=0
Jul 24 15:57:04.938855 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:04.938831    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn" event={"ID":"dd09ada3-9556-463b-8928-af7dfcbf9feb","Type":"ContainerDied","Data":"599d043fb0df862a241ab0426a12bb6980ac451923b800379eb4b6477d22b079"}
Jul 24 15:57:04.939314 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:04.939218    2553 scope.go:117] "RemoveContainer" containerID="599d043fb0df862a241ab0426a12bb6980ac451923b800379eb4b6477d22b079"
Jul 24 15:57:04.940239 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:04.940210    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 15:57:04.940295 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:04.940279    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 15:57:04.940334 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:04.940311    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 15:57:05.948786 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:05.948742    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn" event={"ID":"dd09ada3-9556-463b-8928-af7dfcbf9feb","Type":"ContainerStarted","Data":"19993d6e9d8e2ea1179c066951e41f6ab6b1a2e710b8f8e484d1c7b6fc0a2660"}
Jul 24 15:57:06.120198 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:06.120157    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:57:06.121497 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:06.121464    2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-df6776dd6-slckn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 24 15:57:06.121669 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:06.121517    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn" podUID="dd09ada3-9556-463b-8928-af7dfcbf9feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 24 15:57:07.120423 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:07.120379    2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-df6776dd6-slckn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 24 15:57:07.120882 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:07.120444    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn" podUID="dd09ada3-9556-463b-8928-af7dfcbf9feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 24 15:57:08.119967 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:08.119921    2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-df6776dd6-slckn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 24 15:57:08.120151 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:08.119984    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn" podUID="dd09ada3-9556-463b-8928-af7dfcbf9feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 24 15:57:09.120106 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:09.120070    2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-df6776dd6-slckn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 24 15:57:09.120494 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:09.120123    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn" podUID="dd09ada3-9556-463b-8928-af7dfcbf9feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 24 15:57:09.539247 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:09.539197    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:57:10.123400 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:10.123367    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:57:10.124348 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:10.124328    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-slckn"
Jul 24 15:57:11.924765 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:11.924727    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x5df4"
Jul 24 15:57:26.790254 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:26.790218    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"]
Jul 24 15:57:26.793540 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:26.793513    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:26.796322 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:26.796295    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 15:57:26.796538 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:26.796521    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 15:57:26.797826 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:26.797807    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zqxbv\""
Jul 24 15:57:26.797937 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:26.797843    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 24 15:57:26.802538 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:26.802515    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"]
Jul 24 15:57:26.923460 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:26.923420    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/676b7bb7-40c6-4845-b016-e05bc009d299-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:26.923460 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:26.923460    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/676b7bb7-40c6-4845-b016-e05bc009d299-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:26.923767 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:26.923487    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/676b7bb7-40c6-4845-b016-e05bc009d299-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:26.923767 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:26.923567    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/676b7bb7-40c6-4845-b016-e05bc009d299-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:26.923767 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:26.923729    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/676b7bb7-40c6-4845-b016-e05bc009d299-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:26.923895 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:26.923774    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c86mg\" (UniqueName: \"kubernetes.io/projected/676b7bb7-40c6-4845-b016-e05bc009d299-kube-api-access-c86mg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:27.024780 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:27.024746    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/676b7bb7-40c6-4845-b016-e05bc009d299-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:27.024960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:27.024790    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c86mg\" (UniqueName: \"kubernetes.io/projected/676b7bb7-40c6-4845-b016-e05bc009d299-kube-api-access-c86mg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:27.024960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:27.024829    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/676b7bb7-40c6-4845-b016-e05bc009d299-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:27.024960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:27.024852    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/676b7bb7-40c6-4845-b016-e05bc009d299-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:27.024960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:27.024883    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/676b7bb7-40c6-4845-b016-e05bc009d299-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:27.024960 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:27.024911    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/676b7bb7-40c6-4845-b016-e05bc009d299-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:27.025340 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:27.025312    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/676b7bb7-40c6-4845-b016-e05bc009d299-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:27.025455 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:27.025378    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/676b7bb7-40c6-4845-b016-e05bc009d299-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:27.025500 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:27.025448    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/676b7bb7-40c6-4845-b016-e05bc009d299-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:27.027090 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:27.027069    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/676b7bb7-40c6-4845-b016-e05bc009d299-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:27.027346 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:27.027329    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/676b7bb7-40c6-4845-b016-e05bc009d299-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:27.032742 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:27.032720    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c86mg\" (UniqueName: \"kubernetes.io/projected/676b7bb7-40c6-4845-b016-e05bc009d299-kube-api-access-c86mg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj\" (UID: \"676b7bb7-40c6-4845-b016-e05bc009d299\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:27.104257 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:27.104157    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:27.241468 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:27.241434    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"]
Jul 24 15:57:27.243963 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:57:27.243928    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676b7bb7_40c6_4845_b016_e05bc009d299.slice/crio-3d0387f8d659da2d5df18a25021504b60cc71e233a685ad2af35dd4b69088ea7 WatchSource:0}: Error finding container 3d0387f8d659da2d5df18a25021504b60cc71e233a685ad2af35dd4b69088ea7: Status 404 returned error can't find the container with id 3d0387f8d659da2d5df18a25021504b60cc71e233a685ad2af35dd4b69088ea7
Jul 24 15:57:28.057944 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:28.057905    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj" event={"ID":"676b7bb7-40c6-4845-b016-e05bc009d299","Type":"ContainerStarted","Data":"3d0387f8d659da2d5df18a25021504b60cc71e233a685ad2af35dd4b69088ea7"}
Jul 24 15:57:31.071735 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:31.071695    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj" event={"ID":"676b7bb7-40c6-4845-b016-e05bc009d299","Type":"ContainerStarted","Data":"0b250c02f9ad6e26c47a4c4029d3b11a26de595083c60d3a792f98d4f6203889"}
Jul 24 15:57:31.088730 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:31.088674    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj" podStartSLOduration=2.27933778 podStartE2EDuration="5.088655134s" totalImagesPullingTime="2.809317354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:57:31.087879667 +0000 UTC m=+605.150328856" watchObservedRunningTime="2026-07-24 15:57:31.088655134 +0000 UTC m=+605.151104320"
Jul 24 15:57:37.105181 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:37.105143    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:37.105618 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:37.105204    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:37.117749 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:37.117717    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:38.121914 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.121881    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj"
Jul 24 15:57:38.481954 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.481862    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"]
Jul 24 15:57:38.485569 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.485544    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.488354 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.488329    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 24 15:57:38.495714 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.495688    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"]
Jul 24 15:57:38.635187 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.635140    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c067509e-a4ff-40b5-a311-5bb175cf61f4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.635381 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.635236    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c067509e-a4ff-40b5-a311-5bb175cf61f4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.635381 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.635272    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c067509e-a4ff-40b5-a311-5bb175cf61f4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.635381 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.635298    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c067509e-a4ff-40b5-a311-5bb175cf61f4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.635559 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.635396    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c067509e-a4ff-40b5-a311-5bb175cf61f4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.635559 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.635468    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spxk5\" (UniqueName: \"kubernetes.io/projected/c067509e-a4ff-40b5-a311-5bb175cf61f4-kube-api-access-spxk5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.736147 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.736044    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c067509e-a4ff-40b5-a311-5bb175cf61f4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.736147 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.736094    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c067509e-a4ff-40b5-a311-5bb175cf61f4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.736147 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.736120    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c067509e-a4ff-40b5-a311-5bb175cf61f4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.736430 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.736163    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c067509e-a4ff-40b5-a311-5bb175cf61f4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.736430 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.736209    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spxk5\" (UniqueName: \"kubernetes.io/projected/c067509e-a4ff-40b5-a311-5bb175cf61f4-kube-api-access-spxk5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.736430 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.736286    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c067509e-a4ff-40b5-a311-5bb175cf61f4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.736607 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.736541    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c067509e-a4ff-40b5-a311-5bb175cf61f4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.736696 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.736668    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c067509e-a4ff-40b5-a311-5bb175cf61f4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.737220 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.737192    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c067509e-a4ff-40b5-a311-5bb175cf61f4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.739894 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.739870    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c067509e-a4ff-40b5-a311-5bb175cf61f4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.740191 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.740171    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c067509e-a4ff-40b5-a311-5bb175cf61f4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.744845 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.744823    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spxk5\" (UniqueName: \"kubernetes.io/projected/c067509e-a4ff-40b5-a311-5bb175cf61f4-kube-api-access-spxk5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8nbq4\" (UID: \"c067509e-a4ff-40b5-a311-5bb175cf61f4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.797110 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.797059    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:38.931918 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:38.931894    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"]
Jul 24 15:57:38.933772 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:57:38.933740    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc067509e_a4ff_40b5_a311_5bb175cf61f4.slice/crio-c97d841785bd891143c3b296bca6c943d98479f9fd6c6ec2f80a34babc03ff85 WatchSource:0}: Error finding container c97d841785bd891143c3b296bca6c943d98479f9fd6c6ec2f80a34babc03ff85: Status 404 returned error can't find the container with id c97d841785bd891143c3b296bca6c943d98479f9fd6c6ec2f80a34babc03ff85
Jul 24 15:57:39.112551 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:39.112516    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4" event={"ID":"c067509e-a4ff-40b5-a311-5bb175cf61f4","Type":"ContainerStarted","Data":"c97d841785bd891143c3b296bca6c943d98479f9fd6c6ec2f80a34babc03ff85"}
Jul 24 15:57:40.120346 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:40.120305    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4" event={"ID":"c067509e-a4ff-40b5-a311-5bb175cf61f4","Type":"ContainerStarted","Data":"7d493a743d14c84950dd2051cd9557c36cce2756c400f8f55c282bf1eec54bdf"}
Jul 24 15:57:40.140114 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:40.140044    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4" podStartSLOduration=1.426335335 podStartE2EDuration="2.140019844s" totalImagesPullingTime="713.684509ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:57:40.137615435 +0000 UTC m=+614.200064623" watchObservedRunningTime="2026-07-24 15:57:40.140019844 +0000 UTC m=+614.202469032"
Jul 24 15:57:48.798316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:48.798224    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:48.798316 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:48.798314    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:48.811034 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:48.811001    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:57:49.178931 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:57:49.178842    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8nbq4"
Jul 24 15:59:30.762624 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:30.762520    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6575ffc6b9-vnggd"]
Jul 24 15:59:30.766058 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:30.766035    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6575ffc6b9-vnggd"
Jul 24 15:59:30.777075 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:30.777047    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6575ffc6b9-vnggd"]
Jul 24 15:59:30.869542 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:30.869493    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj72j\" (UniqueName: \"kubernetes.io/projected/f359d422-9c3b-40a5-987b-b3d8c782599d-kube-api-access-cj72j\") pod \"authorino-6575ffc6b9-vnggd\" (UID: \"f359d422-9c3b-40a5-987b-b3d8c782599d\") " pod="kuadrant-system/authorino-6575ffc6b9-vnggd"
Jul 24 15:59:30.869751 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:30.869675    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f359d422-9c3b-40a5-987b-b3d8c782599d-tls-cert\") pod \"authorino-6575ffc6b9-vnggd\" (UID: \"f359d422-9c3b-40a5-987b-b3d8c782599d\") " pod="kuadrant-system/authorino-6575ffc6b9-vnggd"
Jul 24 15:59:30.970474 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:30.970412    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f359d422-9c3b-40a5-987b-b3d8c782599d-tls-cert\") pod \"authorino-6575ffc6b9-vnggd\" (UID: \"f359d422-9c3b-40a5-987b-b3d8c782599d\") " pod="kuadrant-system/authorino-6575ffc6b9-vnggd"
Jul 24 15:59:30.970474 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:30.970473    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj72j\" (UniqueName: \"kubernetes.io/projected/f359d422-9c3b-40a5-987b-b3d8c782599d-kube-api-access-cj72j\") pod \"authorino-6575ffc6b9-vnggd\" (UID: \"f359d422-9c3b-40a5-987b-b3d8c782599d\") " pod="kuadrant-system/authorino-6575ffc6b9-vnggd"
Jul 24 15:59:30.973078 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:30.973042    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f359d422-9c3b-40a5-987b-b3d8c782599d-tls-cert\") pod \"authorino-6575ffc6b9-vnggd\" (UID: \"f359d422-9c3b-40a5-987b-b3d8c782599d\") " pod="kuadrant-system/authorino-6575ffc6b9-vnggd"
Jul 24 15:59:30.979556 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:30.979527    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj72j\" (UniqueName: \"kubernetes.io/projected/f359d422-9c3b-40a5-987b-b3d8c782599d-kube-api-access-cj72j\") pod \"authorino-6575ffc6b9-vnggd\" (UID: \"f359d422-9c3b-40a5-987b-b3d8c782599d\") " pod="kuadrant-system/authorino-6575ffc6b9-vnggd"
Jul 24 15:59:31.074524 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:31.074430    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6575ffc6b9-vnggd"
Jul 24 15:59:31.216667 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:31.216468    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6575ffc6b9-vnggd"]
Jul 24 15:59:31.219604 ip-10-0-136-199 kubenswrapper[2553]: W0724 15:59:31.219551    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf359d422_9c3b_40a5_987b_b3d8c782599d.slice/crio-9653a6e49e7711989e48335e12dce41558e386e4b00b1bf98ae93b86e7b34735 WatchSource:0}: Error finding container 9653a6e49e7711989e48335e12dce41558e386e4b00b1bf98ae93b86e7b34735: Status 404 returned error can't find the container with id 9653a6e49e7711989e48335e12dce41558e386e4b00b1bf98ae93b86e7b34735
Jul 24 15:59:31.221036 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:31.221016    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:59:31.664664 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:31.664632    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6575ffc6b9-vnggd" event={"ID":"f359d422-9c3b-40a5-987b-b3d8c782599d","Type":"ContainerStarted","Data":"9653a6e49e7711989e48335e12dce41558e386e4b00b1bf98ae93b86e7b34735"}
Jul 24 15:59:32.672660 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:32.672606    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6575ffc6b9-vnggd" event={"ID":"f359d422-9c3b-40a5-987b-b3d8c782599d","Type":"ContainerStarted","Data":"8e2f904fd48b5f537871cf3f9183e129abe8e2afbb0021d55eb9d4f2ce373176"}
Jul 24 15:59:32.691496 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:32.691421    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6575ffc6b9-vnggd" podStartSLOduration=2.215581223 podStartE2EDuration="2.691397815s" totalImagesPullingTime="475.816592ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:59:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:59:32.689178681 +0000 UTC m=+726.751627866" watchObservedRunningTime="2026-07-24 15:59:32.691397815 +0000 UTC m=+726.753847003"
Jul 24 15:59:32.722061 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:32.722015    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f7cf95f4d-dqtk5"]
Jul 24 15:59:32.722315 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:32.722277    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-f7cf95f4d-dqtk5" podUID="9a31412a-a8e1-4e77-bd1c-f8c4954b83dd" containerName="authorino" containerID="cri-o://9ac010dd62eb052b42b681aaffb8d30a599771efaed0f4988a5ab5008573bf15" gracePeriod=30
Jul 24 15:59:32.997094 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:32.997066    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f7cf95f4d-dqtk5"
Jul 24 15:59:33.088132 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.088099    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a31412a-a8e1-4e77-bd1c-f8c4954b83dd-tls-cert\") pod \"9a31412a-a8e1-4e77-bd1c-f8c4954b83dd\" (UID: \"9a31412a-a8e1-4e77-bd1c-f8c4954b83dd\") "
Jul 24 15:59:33.088307 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.088195    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ktch\" (UniqueName: \"kubernetes.io/projected/9a31412a-a8e1-4e77-bd1c-f8c4954b83dd-kube-api-access-7ktch\") pod \"9a31412a-a8e1-4e77-bd1c-f8c4954b83dd\" (UID: \"9a31412a-a8e1-4e77-bd1c-f8c4954b83dd\") "
Jul 24 15:59:33.090298 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.090267    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a31412a-a8e1-4e77-bd1c-f8c4954b83dd-kube-api-access-7ktch" (OuterVolumeSpecName: "kube-api-access-7ktch") pod "9a31412a-a8e1-4e77-bd1c-f8c4954b83dd" (UID: "9a31412a-a8e1-4e77-bd1c-f8c4954b83dd"). InnerVolumeSpecName "kube-api-access-7ktch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:59:33.098733 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.098691    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a31412a-a8e1-4e77-bd1c-f8c4954b83dd-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9a31412a-a8e1-4e77-bd1c-f8c4954b83dd" (UID: "9a31412a-a8e1-4e77-bd1c-f8c4954b83dd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:59:33.189823 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.189776    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ktch\" (UniqueName: \"kubernetes.io/projected/9a31412a-a8e1-4e77-bd1c-f8c4954b83dd-kube-api-access-7ktch\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:59:33.189823 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.189822    2553 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a31412a-a8e1-4e77-bd1c-f8c4954b83dd-tls-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 15:59:33.678648 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.678610    2553 generic.go:356] "Generic (PLEG): container finished" podID="9a31412a-a8e1-4e77-bd1c-f8c4954b83dd" containerID="9ac010dd62eb052b42b681aaffb8d30a599771efaed0f4988a5ab5008573bf15" exitCode=0
Jul 24 15:59:33.679143 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.678678    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f7cf95f4d-dqtk5"
Jul 24 15:59:33.679143 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.678714    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f7cf95f4d-dqtk5" event={"ID":"9a31412a-a8e1-4e77-bd1c-f8c4954b83dd","Type":"ContainerDied","Data":"9ac010dd62eb052b42b681aaffb8d30a599771efaed0f4988a5ab5008573bf15"}
Jul 24 15:59:33.679143 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.678756    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f7cf95f4d-dqtk5" event={"ID":"9a31412a-a8e1-4e77-bd1c-f8c4954b83dd","Type":"ContainerDied","Data":"b3c3451d80790c126bd879547fc1cad3418ff94fe84a9db0ff0e31b82ddb63aa"}
Jul 24 15:59:33.679143 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.678776    2553 scope.go:117] "RemoveContainer" containerID="9ac010dd62eb052b42b681aaffb8d30a599771efaed0f4988a5ab5008573bf15"
Jul 24 15:59:33.689995 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.689973    2553 scope.go:117] "RemoveContainer" containerID="9ac010dd62eb052b42b681aaffb8d30a599771efaed0f4988a5ab5008573bf15"
Jul 24 15:59:33.690288 ip-10-0-136-199 kubenswrapper[2553]: E0724 15:59:33.690268    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ac010dd62eb052b42b681aaffb8d30a599771efaed0f4988a5ab5008573bf15\": container with ID starting with 9ac010dd62eb052b42b681aaffb8d30a599771efaed0f4988a5ab5008573bf15 not found: ID does not exist" containerID="9ac010dd62eb052b42b681aaffb8d30a599771efaed0f4988a5ab5008573bf15"
Jul 24 15:59:33.690339 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.690299    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ac010dd62eb052b42b681aaffb8d30a599771efaed0f4988a5ab5008573bf15"} err="failed to get container status \"9ac010dd62eb052b42b681aaffb8d30a599771efaed0f4988a5ab5008573bf15\": rpc error: code = NotFound desc = could not find container \"9ac010dd62eb052b42b681aaffb8d30a599771efaed0f4988a5ab5008573bf15\": container with ID starting with 9ac010dd62eb052b42b681aaffb8d30a599771efaed0f4988a5ab5008573bf15 not found: ID does not exist"
Jul 24 15:59:33.703652 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.703623    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f7cf95f4d-dqtk5"]
Jul 24 15:59:33.709375 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:33.709349    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f7cf95f4d-dqtk5"]
Jul 24 15:59:34.475302 ip-10-0-136-199 kubenswrapper[2553]: I0724 15:59:34.475267    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a31412a-a8e1-4e77-bd1c-f8c4954b83dd" path="/var/lib/kubelet/pods/9a31412a-a8e1-4e77-bd1c-f8c4954b83dd/volumes"
Jul 24 16:06:22.799053 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:22.799011    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"]
Jul 24 16:06:22.799719 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:22.799284    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw" podUID="556783ee-892b-4682-bd8c-168e7a4cf8bd" containerName="manager" containerID="cri-o://61ca03fe52489d812d0d7bc89f921fba4022cc151a41552b0e9ff0c44f44d7d9" gracePeriod=10
Jul 24 16:06:25.857608 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:25.857560    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"
Jul 24 16:06:25.935347 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:25.935263    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/556783ee-892b-4682-bd8c-168e7a4cf8bd-extensions-socket-volume\") pod \"556783ee-892b-4682-bd8c-168e7a4cf8bd\" (UID: \"556783ee-892b-4682-bd8c-168e7a4cf8bd\") "
Jul 24 16:06:25.935491 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:25.935351    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rj68\" (UniqueName: \"kubernetes.io/projected/556783ee-892b-4682-bd8c-168e7a4cf8bd-kube-api-access-4rj68\") pod \"556783ee-892b-4682-bd8c-168e7a4cf8bd\" (UID: \"556783ee-892b-4682-bd8c-168e7a4cf8bd\") "
Jul 24 16:06:25.935728 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:25.935701    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/556783ee-892b-4682-bd8c-168e7a4cf8bd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "556783ee-892b-4682-bd8c-168e7a4cf8bd" (UID: "556783ee-892b-4682-bd8c-168e7a4cf8bd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:06:25.935850 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:25.935835    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/556783ee-892b-4682-bd8c-168e7a4cf8bd-extensions-socket-volume\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:06:25.937329 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:25.937308    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/556783ee-892b-4682-bd8c-168e7a4cf8bd-kube-api-access-4rj68" (OuterVolumeSpecName: "kube-api-access-4rj68") pod "556783ee-892b-4682-bd8c-168e7a4cf8bd" (UID: "556783ee-892b-4682-bd8c-168e7a4cf8bd"). InnerVolumeSpecName "kube-api-access-4rj68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:06:26.037061 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:26.037016    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rj68\" (UniqueName: \"kubernetes.io/projected/556783ee-892b-4682-bd8c-168e7a4cf8bd-kube-api-access-4rj68\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:06:26.444171 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:26.444137    2553 scope.go:117] "RemoveContainer" containerID="61ca03fe52489d812d0d7bc89f921fba4022cc151a41552b0e9ff0c44f44d7d9"
Jul 24 16:06:26.663949 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:26.663912    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"
Jul 24 16:06:26.663949 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:26.663941    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw" event={"ID":"556783ee-892b-4682-bd8c-168e7a4cf8bd","Type":"ContainerDied","Data":"61ca03fe52489d812d0d7bc89f921fba4022cc151a41552b0e9ff0c44f44d7d9"}
Jul 24 16:06:26.664209 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:26.663998    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw" event={"ID":"556783ee-892b-4682-bd8c-168e7a4cf8bd","Type":"ContainerDied","Data":"46883a4c6f254ce9c50966010b2ab6fa50df1636224e02fccecc4376099fd757"}
Jul 24 16:06:26.697089 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:26.697005    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"]
Jul 24 16:06:26.701041 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:26.701015    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6lwgw"]
Jul 24 16:06:28.474919 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:06:28.474881    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="556783ee-892b-4682-bd8c-168e7a4cf8bd" path="/var/lib/kubelet/pods/556783ee-892b-4682-bd8c-168e7a4cf8bd/volumes"
Jul 24 16:07:23.918425 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:23.918391    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm"]
Jul 24 16:07:23.920774 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:23.918771    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a31412a-a8e1-4e77-bd1c-f8c4954b83dd" containerName="authorino"
Jul 24 16:07:23.920774 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:23.918787    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a31412a-a8e1-4e77-bd1c-f8c4954b83dd" containerName="authorino"
Jul 24 16:07:23.920774 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:23.918807    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="556783ee-892b-4682-bd8c-168e7a4cf8bd" containerName="manager"
Jul 24 16:07:23.920774 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:23.918813    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="556783ee-892b-4682-bd8c-168e7a4cf8bd" containerName="manager"
Jul 24 16:07:23.920774 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:23.918874    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a31412a-a8e1-4e77-bd1c-f8c4954b83dd" containerName="authorino"
Jul 24 16:07:23.920774 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:23.918882    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="556783ee-892b-4682-bd8c-168e7a4cf8bd" containerName="manager"
Jul 24 16:07:23.921527 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:23.921508    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm"
Jul 24 16:07:23.924705 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:23.924686    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-92pjk\""
Jul 24 16:07:23.934816 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:23.934791    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm"]
Jul 24 16:07:24.078407 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:24.078366    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9362abb6-6fb8-4830-82d4-6d9114b45c83-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h89xm\" (UID: \"9362abb6-6fb8-4830-82d4-6d9114b45c83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm"
Jul 24 16:07:24.078637 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:24.078445    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5p5t\" (UniqueName: \"kubernetes.io/projected/9362abb6-6fb8-4830-82d4-6d9114b45c83-kube-api-access-x5p5t\") pod \"kuadrant-operator-controller-manager-86878c769f-h89xm\" (UID: \"9362abb6-6fb8-4830-82d4-6d9114b45c83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm"
Jul 24 16:07:24.179959 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:24.179860    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9362abb6-6fb8-4830-82d4-6d9114b45c83-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h89xm\" (UID: \"9362abb6-6fb8-4830-82d4-6d9114b45c83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm"
Jul 24 16:07:24.179959 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:24.179932    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5p5t\" (UniqueName: \"kubernetes.io/projected/9362abb6-6fb8-4830-82d4-6d9114b45c83-kube-api-access-x5p5t\") pod \"kuadrant-operator-controller-manager-86878c769f-h89xm\" (UID: \"9362abb6-6fb8-4830-82d4-6d9114b45c83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm"
Jul 24 16:07:24.180311 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:24.180287    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9362abb6-6fb8-4830-82d4-6d9114b45c83-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h89xm\" (UID: \"9362abb6-6fb8-4830-82d4-6d9114b45c83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm"
Jul 24 16:07:24.194836 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:24.194801    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5p5t\" (UniqueName: \"kubernetes.io/projected/9362abb6-6fb8-4830-82d4-6d9114b45c83-kube-api-access-x5p5t\") pod \"kuadrant-operator-controller-manager-86878c769f-h89xm\" (UID: \"9362abb6-6fb8-4830-82d4-6d9114b45c83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm"
Jul 24 16:07:24.231821 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:24.231775    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm"
Jul 24 16:07:24.432816 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:24.432790    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm"]
Jul 24 16:07:24.435065 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:07:24.435035    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9362abb6_6fb8_4830_82d4_6d9114b45c83.slice/crio-5514825690d95cf3b241d04d90f4913ddd4605840e8fb513a0d5b1f0901f8629 WatchSource:0}: Error finding container 5514825690d95cf3b241d04d90f4913ddd4605840e8fb513a0d5b1f0901f8629: Status 404 returned error can't find the container with id 5514825690d95cf3b241d04d90f4913ddd4605840e8fb513a0d5b1f0901f8629
Jul 24 16:07:24.927919 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:24.927881    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm" event={"ID":"9362abb6-6fb8-4830-82d4-6d9114b45c83","Type":"ContainerStarted","Data":"655c38ba498437fb696d89dd3c93100b481a79816bf9d60369783962abe47d35"}
Jul 24 16:07:24.928361 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:24.927936    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm" event={"ID":"9362abb6-6fb8-4830-82d4-6d9114b45c83","Type":"ContainerStarted","Data":"5514825690d95cf3b241d04d90f4913ddd4605840e8fb513a0d5b1f0901f8629"}
Jul 24 16:07:24.928361 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:24.928011    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm"
Jul 24 16:07:24.955319 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:24.955261    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm" podStartSLOduration=1.955246247 podStartE2EDuration="1.955246247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:07:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:24.953095913 +0000 UTC m=+1199.015545101" watchObservedRunningTime="2026-07-24 16:07:24.955246247 +0000 UTC m=+1199.017695434"
Jul 24 16:07:35.935110 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:07:35.935079    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h89xm"
Jul 24 16:10:20.581357 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.581321    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"]
Jul 24 16:10:20.585463 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.585441    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.588391 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.588364    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-2d826dad-kserve-self-signed-certs\""
Jul 24 16:10:20.591960 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.591938    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"]
Jul 24 16:10:20.706573 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.706533    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-home\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.706573 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.706571    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-model-cache\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.706848 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.706648    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-dshm\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.706848 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.706688    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg726\" (UniqueName: \"kubernetes.io/projected/42042df9-440b-4bfe-9d90-2f4298209e70-kube-api-access-cg726\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.706848 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.706729    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-tmp-dir\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.706984 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.706845    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42042df9-440b-4bfe-9d90-2f4298209e70-tls-certs\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.807311 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.807272    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-home\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.807311 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.807313    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-model-cache\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.807530 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.807346    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-dshm\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.807530 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.807396    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg726\" (UniqueName: \"kubernetes.io/projected/42042df9-440b-4bfe-9d90-2f4298209e70-kube-api-access-cg726\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.807530 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.807452    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-tmp-dir\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.807530 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.807505    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42042df9-440b-4bfe-9d90-2f4298209e70-tls-certs\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.807811 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.807786    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-model-cache\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.807860 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.807813    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-tmp-dir\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.807905 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.807853    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-home\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.809749 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.809718    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-dshm\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.809995 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.809979    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42042df9-440b-4bfe-9d90-2f4298209e70-tls-certs\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.816798 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.816772    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg726\" (UniqueName: \"kubernetes.io/projected/42042df9-440b-4bfe-9d90-2f4298209e70-kube-api-access-cg726\") pod \"e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") " pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:20.895906 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:20.895810    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:21.034239 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:21.034214    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"]
Jul 24 16:10:21.037343 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:10:21.037310    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42042df9_440b_4bfe_9d90_2f4298209e70.slice/crio-a814b5d6637e03109a6383eea4fa6434bcf9a9163241529cd1ace659a9a4b755 WatchSource:0}: Error finding container a814b5d6637e03109a6383eea4fa6434bcf9a9163241529cd1ace659a9a4b755: Status 404 returned error can't find the container with id a814b5d6637e03109a6383eea4fa6434bcf9a9163241529cd1ace659a9a4b755
Jul 24 16:10:21.784892 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:21.784856    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s" event={"ID":"42042df9-440b-4bfe-9d90-2f4298209e70","Type":"ContainerStarted","Data":"2a47d734524493e45bb53eb9a899a20deeb71d760372a947c48a3be5160eb0ae"}
Jul 24 16:10:21.784892 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:21.784895    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s" event={"ID":"42042df9-440b-4bfe-9d90-2f4298209e70","Type":"ContainerStarted","Data":"a814b5d6637e03109a6383eea4fa6434bcf9a9163241529cd1ace659a9a4b755"}
Jul 24 16:10:21.803230 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:21.803170    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s" podStartSLOduration=1.803150637 podStartE2EDuration="1.803150637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:10:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:10:21.802884404 +0000 UTC m=+1375.865333591" watchObservedRunningTime="2026-07-24 16:10:21.803150637 +0000 UTC m=+1375.865599825"
Jul 24 16:10:30.896385 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:30.896345    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:30.896867 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:30.896399    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:30.908907 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:30.908873    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:31.856417 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:31.856383    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:10:57.416857 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:10:57.416821    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"]
Jul 24 16:11:12.436349 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.436303    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s" podUID="42042df9-440b-4bfe-9d90-2f4298209e70" containerName="main" containerID="cri-o://2a47d734524493e45bb53eb9a899a20deeb71d760372a947c48a3be5160eb0ae" gracePeriod=45
Jul 24 16:11:12.688191 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.688127    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:11:12.787548 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.787509    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg726\" (UniqueName: \"kubernetes.io/projected/42042df9-440b-4bfe-9d90-2f4298209e70-kube-api-access-cg726\") pod \"42042df9-440b-4bfe-9d90-2f4298209e70\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") "
Jul 24 16:11:12.787765 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.787577    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-home\") pod \"42042df9-440b-4bfe-9d90-2f4298209e70\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") "
Jul 24 16:11:12.787765 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.787639    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-tmp-dir\") pod \"42042df9-440b-4bfe-9d90-2f4298209e70\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") "
Jul 24 16:11:12.787765 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.787671    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-model-cache\") pod \"42042df9-440b-4bfe-9d90-2f4298209e70\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") "
Jul 24 16:11:12.787765 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.787713    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42042df9-440b-4bfe-9d90-2f4298209e70-tls-certs\") pod \"42042df9-440b-4bfe-9d90-2f4298209e70\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") "
Jul 24 16:11:12.787765 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.787752    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-dshm\") pod \"42042df9-440b-4bfe-9d90-2f4298209e70\" (UID: \"42042df9-440b-4bfe-9d90-2f4298209e70\") "
Jul 24 16:11:12.788033 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.787942    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "42042df9-440b-4bfe-9d90-2f4298209e70" (UID: "42042df9-440b-4bfe-9d90-2f4298209e70"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:11:12.788033 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.787970    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-home" (OuterVolumeSpecName: "home") pod "42042df9-440b-4bfe-9d90-2f4298209e70" (UID: "42042df9-440b-4bfe-9d90-2f4298209e70"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:11:12.788033 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.787984    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-model-cache" (OuterVolumeSpecName: "model-cache") pod "42042df9-440b-4bfe-9d90-2f4298209e70" (UID: "42042df9-440b-4bfe-9d90-2f4298209e70"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:11:12.789870 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.789837    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-dshm" (OuterVolumeSpecName: "dshm") pod "42042df9-440b-4bfe-9d90-2f4298209e70" (UID: "42042df9-440b-4bfe-9d90-2f4298209e70"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:11:12.789962 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.789880    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42042df9-440b-4bfe-9d90-2f4298209e70-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "42042df9-440b-4bfe-9d90-2f4298209e70" (UID: "42042df9-440b-4bfe-9d90-2f4298209e70"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:11:12.790003 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.789953    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42042df9-440b-4bfe-9d90-2f4298209e70-kube-api-access-cg726" (OuterVolumeSpecName: "kube-api-access-cg726") pod "42042df9-440b-4bfe-9d90-2f4298209e70" (UID: "42042df9-440b-4bfe-9d90-2f4298209e70"). InnerVolumeSpecName "kube-api-access-cg726". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:11:12.888466 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.888428    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-home\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:11:12.888466 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.888461    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-tmp-dir\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:11:12.888466 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.888472    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-model-cache\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:11:12.888719 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.888483    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42042df9-440b-4bfe-9d90-2f4298209e70-tls-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:11:12.888719 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.888491    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42042df9-440b-4bfe-9d90-2f4298209e70-dshm\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:11:12.888719 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:12.888500    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg726\" (UniqueName: \"kubernetes.io/projected/42042df9-440b-4bfe-9d90-2f4298209e70-kube-api-access-cg726\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:11:13.048497 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:13.048462    2553 generic.go:356] "Generic (PLEG): container finished" podID="42042df9-440b-4bfe-9d90-2f4298209e70" containerID="2a47d734524493e45bb53eb9a899a20deeb71d760372a947c48a3be5160eb0ae" exitCode=0
Jul 24 16:11:13.048717 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:13.048508    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"
Jul 24 16:11:13.048717 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:13.048556    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s" event={"ID":"42042df9-440b-4bfe-9d90-2f4298209e70","Type":"ContainerDied","Data":"2a47d734524493e45bb53eb9a899a20deeb71d760372a947c48a3be5160eb0ae"}
Jul 24 16:11:13.048717 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:13.048625    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s" event={"ID":"42042df9-440b-4bfe-9d90-2f4298209e70","Type":"ContainerDied","Data":"a814b5d6637e03109a6383eea4fa6434bcf9a9163241529cd1ace659a9a4b755"}
Jul 24 16:11:13.048717 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:13.048653    2553 scope.go:117] "RemoveContainer" containerID="2a47d734524493e45bb53eb9a899a20deeb71d760372a947c48a3be5160eb0ae"
Jul 24 16:11:13.059115 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:13.059092    2553 scope.go:117] "RemoveContainer" containerID="2a47d734524493e45bb53eb9a899a20deeb71d760372a947c48a3be5160eb0ae"
Jul 24 16:11:13.059420 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:11:13.059401    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a47d734524493e45bb53eb9a899a20deeb71d760372a947c48a3be5160eb0ae\": container with ID starting with 2a47d734524493e45bb53eb9a899a20deeb71d760372a947c48a3be5160eb0ae not found: ID does not exist" containerID="2a47d734524493e45bb53eb9a899a20deeb71d760372a947c48a3be5160eb0ae"
Jul 24 16:11:13.059468 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:13.059426    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a47d734524493e45bb53eb9a899a20deeb71d760372a947c48a3be5160eb0ae"} err="failed to get container status \"2a47d734524493e45bb53eb9a899a20deeb71d760372a947c48a3be5160eb0ae\": rpc error: code = NotFound desc = could not find container \"2a47d734524493e45bb53eb9a899a20deeb71d760372a947c48a3be5160eb0ae\": container with ID starting with 2a47d734524493e45bb53eb9a899a20deeb71d760372a947c48a3be5160eb0ae not found: ID does not exist"
Jul 24 16:11:13.071159 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:13.071129    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"]
Jul 24 16:11:13.076040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:13.076004    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-2d826dad-kserve-54489c9c8c-lmj7s"]
Jul 24 16:11:14.474742 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:11:14.474701    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42042df9-440b-4bfe-9d90-2f4298209e70" path="/var/lib/kubelet/pods/42042df9-440b-4bfe-9d90-2f4298209e70/volumes"
Jul 24 16:14:49.164055 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.163975    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"]
Jul 24 16:14:49.164525 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.164343    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42042df9-440b-4bfe-9d90-2f4298209e70" containerName="main"
Jul 24 16:14:49.164525 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.164355    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="42042df9-440b-4bfe-9d90-2f4298209e70" containerName="main"
Jul 24 16:14:49.164525 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.164417    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="42042df9-440b-4bfe-9d90-2f4298209e70" containerName="main"
Jul 24 16:14:49.167139 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.167120    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.169956 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.169931    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f991138c-openshift-default-dockercfg-mznqd\""
Jul 24 16:14:49.188753 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.188725    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"]
Jul 24 16:14:49.291539 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.291493    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d676d22c-9231-43a5-9fab-865577ece930-istio-token\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.291539 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.291553    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-credential-socket\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.291808 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.291636    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-workload-certs\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.291808 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.291675    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-istio-data\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.291808 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.291704    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d676d22c-9231-43a5-9fab-865577ece930-istio-podinfo\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.291808 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.291728    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lllh8\" (UniqueName: \"kubernetes.io/projected/d676d22c-9231-43a5-9fab-865577ece930-kube-api-access-lllh8\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.291975 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.291809    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-workload-socket\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.291975 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.291838    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d676d22c-9231-43a5-9fab-865577ece930-istiod-ca-cert\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.291975 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.291877    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-istio-envoy\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.392351 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.392311    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-workload-socket\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.392351 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.392354    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d676d22c-9231-43a5-9fab-865577ece930-istiod-ca-cert\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.392643 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.392397    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-istio-envoy\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.392643 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.392430    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d676d22c-9231-43a5-9fab-865577ece930-istio-token\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.392643 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.392465    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-credential-socket\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.392643 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.392519    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-workload-certs\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.392643 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.392542    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-istio-data\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.392643 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.392571    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d676d22c-9231-43a5-9fab-865577ece930-istio-podinfo\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.392643 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.392609    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lllh8\" (UniqueName: \"kubernetes.io/projected/d676d22c-9231-43a5-9fab-865577ece930-kube-api-access-lllh8\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.393004 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.392789    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-workload-socket\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.393067 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.393049    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-workload-certs\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.393124 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.393084    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-istio-data\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.393205 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.393174    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d676d22c-9231-43a5-9fab-865577ece930-istiod-ca-cert\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.393306 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.393287    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-credential-socket\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.395141 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.395117    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-istio-envoy\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.395394 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.395373    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d676d22c-9231-43a5-9fab-865577ece930-istio-podinfo\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.401544 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.401508    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d676d22c-9231-43a5-9fab-865577ece930-istio-token\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.402242 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.402215    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lllh8\" (UniqueName: \"kubernetes.io/projected/d676d22c-9231-43a5-9fab-865577ece930-kube-api-access-lllh8\") pod \"e2e-ait-f991138c-openshift-default-68484fc444-kxblp\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") " pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.480153 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.480045    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:49.631754 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.631728    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"]
Jul 24 16:14:49.635039 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:14:49.635011    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd676d22c_9231_43a5_9fab_865577ece930.slice/crio-b05780afb41f5b9a686238b52ca008e89e8427b4f6710d4b63ae1ea3245d5a78 WatchSource:0}: Error finding container b05780afb41f5b9a686238b52ca008e89e8427b4f6710d4b63ae1ea3245d5a78: Status 404 returned error can't find the container with id b05780afb41f5b9a686238b52ca008e89e8427b4f6710d4b63ae1ea3245d5a78
Jul 24 16:14:49.638042 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.637996    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:14:49.638155 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.638091    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:14:49.638155 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:49.638132    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:14:50.118915 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:50.118872    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp" event={"ID":"d676d22c-9231-43a5-9fab-865577ece930","Type":"ContainerStarted","Data":"2b5cb6d5ca66e65d0618a8d49c37e4348946c8a3c958144d1316c480a3b0e1f6"}
Jul 24 16:14:50.119129 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:50.118940    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp" event={"ID":"d676d22c-9231-43a5-9fab-865577ece930","Type":"ContainerStarted","Data":"b05780afb41f5b9a686238b52ca008e89e8427b4f6710d4b63ae1ea3245d5a78"}
Jul 24 16:14:50.144076 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:50.144015    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp" podStartSLOduration=1.143996596 podStartE2EDuration="1.143996596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:50.141657352 +0000 UTC m=+1644.204106541" watchObservedRunningTime="2026-07-24 16:14:50.143996596 +0000 UTC m=+1644.206445783"
Jul 24 16:14:50.481180 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:50.481099    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:50.486341 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:50.486301    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:51.124237 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:51.124206    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:51.125340 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:51.125317    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:14:52.399621 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.399539    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"]
Jul 24 16:14:52.403167 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.403141    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"
Jul 24 16:14:52.406862 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.406835    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-f991138c\""
Jul 24 16:14:52.408492 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.408455    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-f991138c-dockercfg-nrmqt\""
Jul 24 16:14:52.416345 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.416318    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"]
Jul 24 16:14:52.419498 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.419472    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"]
Jul 24 16:14:52.423064 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.423042    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"
Jul 24 16:14:52.434514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.434481    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"]
Jul 24 16:14:52.520679 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.520638    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c980062-a7c5-4206-9108-b0e8ab84f3cd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl\" (UID: \"7c980062-a7c5-4206-9108-b0e8ab84f3cd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"
Jul 24 16:14:52.520840 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.520713    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9pj9\" (UniqueName: \"kubernetes.io/projected/f5658e48-169a-478a-9aec-8eeb05bd013f-kube-api-access-m9pj9\") pod \"payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4\" (UID: \"f5658e48-169a-478a-9aec-8eeb05bd013f\") " pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"
Jul 24 16:14:52.520840 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.520782    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twkgj\" (UniqueName: \"kubernetes.io/projected/7c980062-a7c5-4206-9108-b0e8ab84f3cd-kube-api-access-twkgj\") pod \"payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl\" (UID: \"7c980062-a7c5-4206-9108-b0e8ab84f3cd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"
Jul 24 16:14:52.521138 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.520850    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5658e48-169a-478a-9aec-8eeb05bd013f-plugins-config-volume\") pod \"payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4\" (UID: \"f5658e48-169a-478a-9aec-8eeb05bd013f\") " pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"
Jul 24 16:14:52.622345 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.622309    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twkgj\" (UniqueName: \"kubernetes.io/projected/7c980062-a7c5-4206-9108-b0e8ab84f3cd-kube-api-access-twkgj\") pod \"payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl\" (UID: \"7c980062-a7c5-4206-9108-b0e8ab84f3cd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"
Jul 24 16:14:52.622516 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.622371    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5658e48-169a-478a-9aec-8eeb05bd013f-plugins-config-volume\") pod \"payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4\" (UID: \"f5658e48-169a-478a-9aec-8eeb05bd013f\") " pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"
Jul 24 16:14:52.622516 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.622437    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c980062-a7c5-4206-9108-b0e8ab84f3cd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl\" (UID: \"7c980062-a7c5-4206-9108-b0e8ab84f3cd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"
Jul 24 16:14:52.622516 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.622461    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9pj9\" (UniqueName: \"kubernetes.io/projected/f5658e48-169a-478a-9aec-8eeb05bd013f-kube-api-access-m9pj9\") pod \"payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4\" (UID: \"f5658e48-169a-478a-9aec-8eeb05bd013f\") " pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"
Jul 24 16:14:52.623175 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.623153    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5658e48-169a-478a-9aec-8eeb05bd013f-plugins-config-volume\") pod \"payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4\" (UID: \"f5658e48-169a-478a-9aec-8eeb05bd013f\") " pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"
Jul 24 16:14:52.623175 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.623166    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c980062-a7c5-4206-9108-b0e8ab84f3cd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl\" (UID: \"7c980062-a7c5-4206-9108-b0e8ab84f3cd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"
Jul 24 16:14:52.634187 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.634164    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twkgj\" (UniqueName: \"kubernetes.io/projected/7c980062-a7c5-4206-9108-b0e8ab84f3cd-kube-api-access-twkgj\") pod \"payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl\" (UID: \"7c980062-a7c5-4206-9108-b0e8ab84f3cd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"
Jul 24 16:14:52.634296 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.634229    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9pj9\" (UniqueName: \"kubernetes.io/projected/f5658e48-169a-478a-9aec-8eeb05bd013f-kube-api-access-m9pj9\") pod \"payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4\" (UID: \"f5658e48-169a-478a-9aec-8eeb05bd013f\") " pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"
Jul 24 16:14:52.714735 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.714640    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"
Jul 24 16:14:52.738068 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.738035    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"
Jul 24 16:14:52.901697 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:52.901332    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"]
Jul 24 16:14:52.904416 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:14:52.904387    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5658e48_169a_478a_9aec_8eeb05bd013f.slice/crio-3e559bb29695cd058ec8cac75a3797821070c1dc05700d01d73c2ff8633e7865 WatchSource:0}: Error finding container 3e559bb29695cd058ec8cac75a3797821070c1dc05700d01d73c2ff8633e7865: Status 404 returned error can't find the container with id 3e559bb29695cd058ec8cac75a3797821070c1dc05700d01d73c2ff8633e7865
Jul 24 16:14:53.074830 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:53.074794    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"]
Jul 24 16:14:53.076620 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:14:53.076571    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c980062_a7c5_4206_9108_b0e8ab84f3cd.slice/crio-916283465b0329fd793855850909b625b375c17fa2133e66a156bfbffe623f26 WatchSource:0}: Error finding container 916283465b0329fd793855850909b625b375c17fa2133e66a156bfbffe623f26: Status 404 returned error can't find the container with id 916283465b0329fd793855850909b625b375c17fa2133e66a156bfbffe623f26
Jul 24 16:14:53.136175 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:53.136134    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4" event={"ID":"f5658e48-169a-478a-9aec-8eeb05bd013f","Type":"ContainerStarted","Data":"7cd7c9d94deae295a68dbf9f06c54562db8e11c59e1470ed78380b852c9ccd78"}
Jul 24 16:14:53.136329 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:53.136214    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4" event={"ID":"f5658e48-169a-478a-9aec-8eeb05bd013f","Type":"ContainerStarted","Data":"3e559bb29695cd058ec8cac75a3797821070c1dc05700d01d73c2ff8633e7865"}
Jul 24 16:14:53.136429 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:53.136406    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"
Jul 24 16:14:53.139393 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:53.139359    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl" event={"ID":"7c980062-a7c5-4206-9108-b0e8ab84f3cd","Type":"ContainerStarted","Data":"82874bd805fdf5fe4e7de79d0f8078fdaa5efab47e01ed5c1794dacd5529b60d"}
Jul 24 16:14:53.139504 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:53.139415    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"
Jul 24 16:14:53.139504 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:53.139439    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl" event={"ID":"7c980062-a7c5-4206-9108-b0e8ab84f3cd","Type":"ContainerStarted","Data":"916283465b0329fd793855850909b625b375c17fa2133e66a156bfbffe623f26"}
Jul 24 16:14:53.155486 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:53.155438    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4" podStartSLOduration=1.155422006 podStartE2EDuration="1.155422006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:53.154204093 +0000 UTC m=+1647.216653281" watchObservedRunningTime="2026-07-24 16:14:53.155422006 +0000 UTC m=+1647.217871192"
Jul 24 16:14:53.172283 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:14:53.172237    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl" podStartSLOduration=1.172222523 podStartE2EDuration="1.172222523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:53.170830801 +0000 UTC m=+1647.233279990" watchObservedRunningTime="2026-07-24 16:14:53.172222523 +0000 UTC m=+1647.234671710"
Jul 24 16:15:04.145762 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:04.145725    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"
Jul 24 16:15:04.146270 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:04.146172    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"
Jul 24 16:15:06.126052 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:06.126003    2553 patch_prober.go:28] interesting pod/e2e-ait-f991138c-openshift-default-68484fc444-kxblp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 24 16:15:06.126495 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:06.126082    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp" podUID="d676d22c-9231-43a5-9fab-865577ece930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 24 16:15:06.210261 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:06.210230    2553 generic.go:356] "Generic (PLEG): container finished" podID="d676d22c-9231-43a5-9fab-865577ece930" containerID="2b5cb6d5ca66e65d0618a8d49c37e4348946c8a3c958144d1316c480a3b0e1f6" exitCode=0
Jul 24 16:15:06.210437 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:06.210275    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp" event={"ID":"d676d22c-9231-43a5-9fab-865577ece930","Type":"ContainerDied","Data":"2b5cb6d5ca66e65d0618a8d49c37e4348946c8a3c958144d1316c480a3b0e1f6"}
Jul 24 16:15:06.210692 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:06.210675    2553 scope.go:117] "RemoveContainer" containerID="2b5cb6d5ca66e65d0618a8d49c37e4348946c8a3c958144d1316c480a3b0e1f6"
Jul 24 16:15:06.211658 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:06.211631    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:15:06.211718 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:06.211699    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:15:06.211765 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:06.211734    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:15:07.217001 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:07.216964    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp" event={"ID":"d676d22c-9231-43a5-9fab-865577ece930","Type":"ContainerStarted","Data":"79d95cc4d6ded7245e5cf81f7dea8eb9118748c5491e55fe16aaedc63dfab10f"}
Jul 24 16:15:07.481194 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:07.481100    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:15:07.481477 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:07.481456    2553 patch_prober.go:28] interesting pod/e2e-ait-f991138c-openshift-default-68484fc444-kxblp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 24 16:15:07.481522 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:07.481504    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp" podUID="d676d22c-9231-43a5-9fab-865577ece930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 24 16:15:08.480931 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:08.480898    2553 patch_prober.go:28] interesting pod/e2e-ait-f991138c-openshift-default-68484fc444-kxblp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 24 16:15:08.481322 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:08.480957    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp" podUID="d676d22c-9231-43a5-9fab-865577ece930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 24 16:15:09.480569 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:09.480532    2553 patch_prober.go:28] interesting pod/e2e-ait-f991138c-openshift-default-68484fc444-kxblp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 24 16:15:09.480780 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:09.480629    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp" podUID="d676d22c-9231-43a5-9fab-865577ece930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 24 16:15:10.481430 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:10.481395    2553 patch_prober.go:28] interesting pod/e2e-ait-f991138c-openshift-default-68484fc444-kxblp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 24 16:15:10.481843 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:10.481447    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp" podUID="d676d22c-9231-43a5-9fab-865577ece930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 24 16:15:11.485027 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:11.484992    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:15:11.485404 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:11.485262    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:15:11.485933 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:11.485916    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:15:27.524114 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:27.524076    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"]
Jul 24 16:15:27.524659 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:27.524332    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4" podUID="f5658e48-169a-478a-9aec-8eeb05bd013f" containerName="payload-processing" containerID="cri-o://7cd7c9d94deae295a68dbf9f06c54562db8e11c59e1470ed78380b852c9ccd78" gracePeriod=30
Jul 24 16:15:27.531930 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:27.531899    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"]
Jul 24 16:15:27.532186 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:27.532138    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl" podUID="7c980062-a7c5-4206-9108-b0e8ab84f3cd" containerName="payload-pre-processing" containerID="cri-o://82874bd805fdf5fe4e7de79d0f8078fdaa5efab47e01ed5c1794dacd5529b60d" gracePeriod=30
Jul 24 16:15:27.793760 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:27.793733    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"
Jul 24 16:15:27.824729 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:27.824702    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"
Jul 24 16:15:27.959618 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:27.959551    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twkgj\" (UniqueName: \"kubernetes.io/projected/7c980062-a7c5-4206-9108-b0e8ab84f3cd-kube-api-access-twkgj\") pod \"7c980062-a7c5-4206-9108-b0e8ab84f3cd\" (UID: \"7c980062-a7c5-4206-9108-b0e8ab84f3cd\") "
Jul 24 16:15:27.959821 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:27.959649    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c980062-a7c5-4206-9108-b0e8ab84f3cd-plugins-config-volume\") pod \"7c980062-a7c5-4206-9108-b0e8ab84f3cd\" (UID: \"7c980062-a7c5-4206-9108-b0e8ab84f3cd\") "
Jul 24 16:15:27.959821 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:27.959701    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9pj9\" (UniqueName: \"kubernetes.io/projected/f5658e48-169a-478a-9aec-8eeb05bd013f-kube-api-access-m9pj9\") pod \"f5658e48-169a-478a-9aec-8eeb05bd013f\" (UID: \"f5658e48-169a-478a-9aec-8eeb05bd013f\") "
Jul 24 16:15:27.959821 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:27.959764    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5658e48-169a-478a-9aec-8eeb05bd013f-plugins-config-volume\") pod \"f5658e48-169a-478a-9aec-8eeb05bd013f\" (UID: \"f5658e48-169a-478a-9aec-8eeb05bd013f\") "
Jul 24 16:15:27.960119 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:27.960086    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c980062-a7c5-4206-9108-b0e8ab84f3cd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7c980062-a7c5-4206-9108-b0e8ab84f3cd" (UID: "7c980062-a7c5-4206-9108-b0e8ab84f3cd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:15:27.960171 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:27.960150    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5658e48-169a-478a-9aec-8eeb05bd013f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5658e48-169a-478a-9aec-8eeb05bd013f" (UID: "f5658e48-169a-478a-9aec-8eeb05bd013f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:15:27.961894 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:27.961872    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c980062-a7c5-4206-9108-b0e8ab84f3cd-kube-api-access-twkgj" (OuterVolumeSpecName: "kube-api-access-twkgj") pod "7c980062-a7c5-4206-9108-b0e8ab84f3cd" (UID: "7c980062-a7c5-4206-9108-b0e8ab84f3cd"). InnerVolumeSpecName "kube-api-access-twkgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:15:27.961951 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:27.961905    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5658e48-169a-478a-9aec-8eeb05bd013f-kube-api-access-m9pj9" (OuterVolumeSpecName: "kube-api-access-m9pj9") pod "f5658e48-169a-478a-9aec-8eeb05bd013f" (UID: "f5658e48-169a-478a-9aec-8eeb05bd013f"). InnerVolumeSpecName "kube-api-access-m9pj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:15:28.061550 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.061469    2553 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5658e48-169a-478a-9aec-8eeb05bd013f-plugins-config-volume\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:15:28.061550 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.061499    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twkgj\" (UniqueName: \"kubernetes.io/projected/7c980062-a7c5-4206-9108-b0e8ab84f3cd-kube-api-access-twkgj\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:15:28.061550 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.061508    2553 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c980062-a7c5-4206-9108-b0e8ab84f3cd-plugins-config-volume\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:15:28.061550 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.061517    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9pj9\" (UniqueName: \"kubernetes.io/projected/f5658e48-169a-478a-9aec-8eeb05bd013f-kube-api-access-m9pj9\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:15:28.326332 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.326237    2553 generic.go:356] "Generic (PLEG): container finished" podID="f5658e48-169a-478a-9aec-8eeb05bd013f" containerID="7cd7c9d94deae295a68dbf9f06c54562db8e11c59e1470ed78380b852c9ccd78" exitCode=0
Jul 24 16:15:28.326332 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.326286    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"
Jul 24 16:15:28.326332 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.326316    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4" event={"ID":"f5658e48-169a-478a-9aec-8eeb05bd013f","Type":"ContainerDied","Data":"7cd7c9d94deae295a68dbf9f06c54562db8e11c59e1470ed78380b852c9ccd78"}
Jul 24 16:15:28.326624 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.326365    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4" event={"ID":"f5658e48-169a-478a-9aec-8eeb05bd013f","Type":"ContainerDied","Data":"3e559bb29695cd058ec8cac75a3797821070c1dc05700d01d73c2ff8633e7865"}
Jul 24 16:15:28.326624 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.326379    2553 scope.go:117] "RemoveContainer" containerID="7cd7c9d94deae295a68dbf9f06c54562db8e11c59e1470ed78380b852c9ccd78"
Jul 24 16:15:28.327667 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.327641    2553 generic.go:356] "Generic (PLEG): container finished" podID="7c980062-a7c5-4206-9108-b0e8ab84f3cd" containerID="82874bd805fdf5fe4e7de79d0f8078fdaa5efab47e01ed5c1794dacd5529b60d" exitCode=0
Jul 24 16:15:28.327785 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.327690    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"
Jul 24 16:15:28.327785 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.327714    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl" event={"ID":"7c980062-a7c5-4206-9108-b0e8ab84f3cd","Type":"ContainerDied","Data":"82874bd805fdf5fe4e7de79d0f8078fdaa5efab47e01ed5c1794dacd5529b60d"}
Jul 24 16:15:28.327785 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.327754    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl" event={"ID":"7c980062-a7c5-4206-9108-b0e8ab84f3cd","Type":"ContainerDied","Data":"916283465b0329fd793855850909b625b375c17fa2133e66a156bfbffe623f26"}
Jul 24 16:15:28.335943 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.335763    2553 scope.go:117] "RemoveContainer" containerID="7cd7c9d94deae295a68dbf9f06c54562db8e11c59e1470ed78380b852c9ccd78"
Jul 24 16:15:28.336329 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:15:28.336184    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cd7c9d94deae295a68dbf9f06c54562db8e11c59e1470ed78380b852c9ccd78\": container with ID starting with 7cd7c9d94deae295a68dbf9f06c54562db8e11c59e1470ed78380b852c9ccd78 not found: ID does not exist" containerID="7cd7c9d94deae295a68dbf9f06c54562db8e11c59e1470ed78380b852c9ccd78"
Jul 24 16:15:28.336329 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.336222    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cd7c9d94deae295a68dbf9f06c54562db8e11c59e1470ed78380b852c9ccd78"} err="failed to get container status \"7cd7c9d94deae295a68dbf9f06c54562db8e11c59e1470ed78380b852c9ccd78\": rpc error: code = NotFound desc = could not find container \"7cd7c9d94deae295a68dbf9f06c54562db8e11c59e1470ed78380b852c9ccd78\": container with ID starting with 7cd7c9d94deae295a68dbf9f06c54562db8e11c59e1470ed78380b852c9ccd78 not found: ID does not exist"
Jul 24 16:15:28.336329 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.336245    2553 scope.go:117] "RemoveContainer" containerID="82874bd805fdf5fe4e7de79d0f8078fdaa5efab47e01ed5c1794dacd5529b60d"
Jul 24 16:15:28.346499 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.346476    2553 scope.go:117] "RemoveContainer" containerID="82874bd805fdf5fe4e7de79d0f8078fdaa5efab47e01ed5c1794dacd5529b60d"
Jul 24 16:15:28.346799 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:15:28.346777    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82874bd805fdf5fe4e7de79d0f8078fdaa5efab47e01ed5c1794dacd5529b60d\": container with ID starting with 82874bd805fdf5fe4e7de79d0f8078fdaa5efab47e01ed5c1794dacd5529b60d not found: ID does not exist" containerID="82874bd805fdf5fe4e7de79d0f8078fdaa5efab47e01ed5c1794dacd5529b60d"
Jul 24 16:15:28.346873 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.346810    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82874bd805fdf5fe4e7de79d0f8078fdaa5efab47e01ed5c1794dacd5529b60d"} err="failed to get container status \"82874bd805fdf5fe4e7de79d0f8078fdaa5efab47e01ed5c1794dacd5529b60d\": rpc error: code = NotFound desc = could not find container \"82874bd805fdf5fe4e7de79d0f8078fdaa5efab47e01ed5c1794dacd5529b60d\": container with ID starting with 82874bd805fdf5fe4e7de79d0f8078fdaa5efab47e01ed5c1794dacd5529b60d not found: ID does not exist"
Jul 24 16:15:28.351024 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.351000    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"]
Jul 24 16:15:28.355440 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.355417    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f991138c-85f49d986d-f4zz4"]
Jul 24 16:15:28.366886 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.366861    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"]
Jul 24 16:15:28.370678 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.370655    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f991138c-5654b8bd4d-xkkhl"]
Jul 24 16:15:28.475163 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.475133    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c980062-a7c5-4206-9108-b0e8ab84f3cd" path="/var/lib/kubelet/pods/7c980062-a7c5-4206-9108-b0e8ab84f3cd/volumes"
Jul 24 16:15:28.475490 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:28.475477    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5658e48-169a-478a-9aec-8eeb05bd013f" path="/var/lib/kubelet/pods/f5658e48-169a-478a-9aec-8eeb05bd013f/volumes"
Jul 24 16:15:32.266403 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:32.266363    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"]
Jul 24 16:15:32.266852 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:32.266572    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp" podUID="d676d22c-9231-43a5-9fab-865577ece930" containerName="istio-proxy" containerID="cri-o://79d95cc4d6ded7245e5cf81f7dea8eb9118748c5491e55fe16aaedc63dfab10f" gracePeriod=30
Jul 24 16:15:33.233678 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.233642    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"]
Jul 24 16:15:33.234271 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.234244    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5658e48-169a-478a-9aec-8eeb05bd013f" containerName="payload-processing"
Jul 24 16:15:33.234271 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.234271    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5658e48-169a-478a-9aec-8eeb05bd013f" containerName="payload-processing"
Jul 24 16:15:33.234416 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.234284    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c980062-a7c5-4206-9108-b0e8ab84f3cd" containerName="payload-pre-processing"
Jul 24 16:15:33.234416 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.234293    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c980062-a7c5-4206-9108-b0e8ab84f3cd" containerName="payload-pre-processing"
Jul 24 16:15:33.234416 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.234370    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c980062-a7c5-4206-9108-b0e8ab84f3cd" containerName="payload-pre-processing"
Jul 24 16:15:33.234416 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.234386    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5658e48-169a-478a-9aec-8eeb05bd013f" containerName="payload-processing"
Jul 24 16:15:33.240789 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.240762    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.243808 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.243779    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-0b92f583-gw-openshift-default-dockercfg-749pr\""
Jul 24 16:15:33.251784 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.251752    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"]
Jul 24 16:15:33.409014 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.408972    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-data\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.409419 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.409021    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-token\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.409419 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.409107    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-workload-certs\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.409419 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.409141    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istiod-ca-cert\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.409419 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.409162    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-envoy\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.409419 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.409301    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s6ms\" (UniqueName: \"kubernetes.io/projected/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-kube-api-access-7s6ms\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.409419 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.409324    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-podinfo\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.409419 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.409349    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-workload-socket\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.409419 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.409371    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-credential-socket\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.510610 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.510556    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-workload-certs\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.510798 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.510636    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istiod-ca-cert\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.510798 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.510663    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-envoy\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.510798 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.510734    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s6ms\" (UniqueName: \"kubernetes.io/projected/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-kube-api-access-7s6ms\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.510973 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.510847    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-podinfo\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.510973 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.510880    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-workload-socket\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.510973 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.510917    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-credential-socket\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.510973 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.510946    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-data\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.510973 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.510961    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-workload-certs\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.511231 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.511005    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-token\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.511231 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.511214    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-credential-socket\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.511338 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.511281    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-workload-socket\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.511395 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.511359    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-data\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.511395 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.511381    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istiod-ca-cert\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.512980 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.512959    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-envoy\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.513242 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.513223    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-podinfo\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.519647 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.519624    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-token\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.520782 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.520748    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s6ms\" (UniqueName: \"kubernetes.io/projected/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-kube-api-access-7s6ms\") pod \"e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") " pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.555721 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.555682    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:33.705942 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.705916    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"]
Jul 24 16:15:33.708253 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:15:33.708224    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533dfdf6_ac6d_4af4_a9f2_67b79a5db62d.slice/crio-68cf9a65967c3f76cfd854aece80455a6e4843ee1e0ecaab6a9ac6021c494b63 WatchSource:0}: Error finding container 68cf9a65967c3f76cfd854aece80455a6e4843ee1e0ecaab6a9ac6021c494b63: Status 404 returned error can't find the container with id 68cf9a65967c3f76cfd854aece80455a6e4843ee1e0ecaab6a9ac6021c494b63
Jul 24 16:15:33.710319 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.710288    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:15:33.710385 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.710354    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:15:33.710431 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:33.710388    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:15:34.370125 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:34.370087    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p" event={"ID":"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d","Type":"ContainerStarted","Data":"60123f312fcff15bfa8d667af63038d4088f05b537df17734edbfd99cac034c5"}
Jul 24 16:15:34.370341 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:34.370157    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p" event={"ID":"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d","Type":"ContainerStarted","Data":"68cf9a65967c3f76cfd854aece80455a6e4843ee1e0ecaab6a9ac6021c494b63"}
Jul 24 16:15:34.394905 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:34.394846    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p" podStartSLOduration=1.394826949 podStartE2EDuration="1.394826949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:15:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:15:34.392291106 +0000 UTC m=+1688.454740294" watchObservedRunningTime="2026-07-24 16:15:34.394826949 +0000 UTC m=+1688.457276133"
Jul 24 16:15:34.556430 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:34.556393    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:34.561713 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:34.561686    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:35.375325 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:35.375286    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:35.376297 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:35.376275    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:36.690358 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.690315    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"]
Jul 24 16:15:36.694972 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.694945    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"]
Jul 24 16:15:36.695107 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.695062    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"
Jul 24 16:15:36.698087 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.698064    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"
Jul 24 16:15:36.698713 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.698692    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-0b92f583-dockercfg-pxbjn\""
Jul 24 16:15:36.698713 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.698706    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-0b92f583\""
Jul 24 16:15:36.706635 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.706604    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"]
Jul 24 16:15:36.710859 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.710829    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"]
Jul 24 16:15:36.741439 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.741394    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54e89e0a-3d65-41a2-97f1-2c31f3d04a74-plugins-config-volume\") pod \"payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw\" (UID: \"54e89e0a-3d65-41a2-97f1-2c31f3d04a74\") " pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"
Jul 24 16:15:36.741645 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.741447    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdzsq\" (UniqueName: \"kubernetes.io/projected/54e89e0a-3d65-41a2-97f1-2c31f3d04a74-kube-api-access-gdzsq\") pod \"payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw\" (UID: \"54e89e0a-3d65-41a2-97f1-2c31f3d04a74\") " pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"
Jul 24 16:15:36.741645 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.741579    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b696e2a-0fd0-4016-aff9-062d4452f369-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9\" (UID: \"4b696e2a-0fd0-4016-aff9-062d4452f369\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"
Jul 24 16:15:36.741744 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.741678    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp4fb\" (UniqueName: \"kubernetes.io/projected/4b696e2a-0fd0-4016-aff9-062d4452f369-kube-api-access-tp4fb\") pod \"payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9\" (UID: \"4b696e2a-0fd0-4016-aff9-062d4452f369\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"
Jul 24 16:15:36.842160 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.842128    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54e89e0a-3d65-41a2-97f1-2c31f3d04a74-plugins-config-volume\") pod \"payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw\" (UID: \"54e89e0a-3d65-41a2-97f1-2c31f3d04a74\") " pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"
Jul 24 16:15:36.842352 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.842169    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdzsq\" (UniqueName: \"kubernetes.io/projected/54e89e0a-3d65-41a2-97f1-2c31f3d04a74-kube-api-access-gdzsq\") pod \"payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw\" (UID: \"54e89e0a-3d65-41a2-97f1-2c31f3d04a74\") " pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"
Jul 24 16:15:36.842352 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.842238    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b696e2a-0fd0-4016-aff9-062d4452f369-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9\" (UID: \"4b696e2a-0fd0-4016-aff9-062d4452f369\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"
Jul 24 16:15:36.842352 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.842314    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp4fb\" (UniqueName: \"kubernetes.io/projected/4b696e2a-0fd0-4016-aff9-062d4452f369-kube-api-access-tp4fb\") pod \"payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9\" (UID: \"4b696e2a-0fd0-4016-aff9-062d4452f369\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"
Jul 24 16:15:36.843047 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.843024    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54e89e0a-3d65-41a2-97f1-2c31f3d04a74-plugins-config-volume\") pod \"payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw\" (UID: \"54e89e0a-3d65-41a2-97f1-2c31f3d04a74\") " pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"
Jul 24 16:15:36.843101 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.843062    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b696e2a-0fd0-4016-aff9-062d4452f369-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9\" (UID: \"4b696e2a-0fd0-4016-aff9-062d4452f369\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"
Jul 24 16:15:36.851452 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.851425    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdzsq\" (UniqueName: \"kubernetes.io/projected/54e89e0a-3d65-41a2-97f1-2c31f3d04a74-kube-api-access-gdzsq\") pod \"payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw\" (UID: \"54e89e0a-3d65-41a2-97f1-2c31f3d04a74\") " pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"
Jul 24 16:15:36.851597 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:36.851566    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp4fb\" (UniqueName: \"kubernetes.io/projected/4b696e2a-0fd0-4016-aff9-062d4452f369-kube-api-access-tp4fb\") pod \"payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9\" (UID: \"4b696e2a-0fd0-4016-aff9-062d4452f369\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"
Jul 24 16:15:37.008846 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.008805    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"
Jul 24 16:15:37.016777 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.016754    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"
Jul 24 16:15:37.167179 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.167147    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"]
Jul 24 16:15:37.167331 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:15:37.167299    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b696e2a_0fd0_4016_aff9_062d4452f369.slice/crio-167f8cd37b5b57a9f54f051c983acc3e252abeab987ae740cb57c79eb8c71699 WatchSource:0}: Error finding container 167f8cd37b5b57a9f54f051c983acc3e252abeab987ae740cb57c79eb8c71699: Status 404 returned error can't find the container with id 167f8cd37b5b57a9f54f051c983acc3e252abeab987ae740cb57c79eb8c71699
Jul 24 16:15:37.198981 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.198859    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"]
Jul 24 16:15:37.200721 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:15:37.200696    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e89e0a_3d65_41a2_97f1_2c31f3d04a74.slice/crio-300abda55e864691d5c2c04be22e5d2cb2e03d9858e4207fc41950464c9324ea WatchSource:0}: Error finding container 300abda55e864691d5c2c04be22e5d2cb2e03d9858e4207fc41950464c9324ea: Status 404 returned error can't find the container with id 300abda55e864691d5c2c04be22e5d2cb2e03d9858e4207fc41950464c9324ea
Jul 24 16:15:37.387723 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.387690    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9" event={"ID":"4b696e2a-0fd0-4016-aff9-062d4452f369","Type":"ContainerStarted","Data":"9f0869be6d3495d95463d6b530e54ac3738e5091842797fb0e030bd1093cc2cf"}
Jul 24 16:15:37.387861 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.387752    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9" event={"ID":"4b696e2a-0fd0-4016-aff9-062d4452f369","Type":"ContainerStarted","Data":"167f8cd37b5b57a9f54f051c983acc3e252abeab987ae740cb57c79eb8c71699"}
Jul 24 16:15:37.387861 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.387806    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"
Jul 24 16:15:37.389807 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.389778    2553 generic.go:356] "Generic (PLEG): container finished" podID="d676d22c-9231-43a5-9fab-865577ece930" containerID="79d95cc4d6ded7245e5cf81f7dea8eb9118748c5491e55fe16aaedc63dfab10f" exitCode=0
Jul 24 16:15:37.389919 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.389870    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp" event={"ID":"d676d22c-9231-43a5-9fab-865577ece930","Type":"ContainerDied","Data":"79d95cc4d6ded7245e5cf81f7dea8eb9118748c5491e55fe16aaedc63dfab10f"}
Jul 24 16:15:37.390001 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.389934    2553 scope.go:117] "RemoveContainer" containerID="2b5cb6d5ca66e65d0618a8d49c37e4348946c8a3c958144d1316c480a3b0e1f6"
Jul 24 16:15:37.392323 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.392297    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw" event={"ID":"54e89e0a-3d65-41a2-97f1-2c31f3d04a74","Type":"ContainerStarted","Data":"168f43e1d007c3e0cc9d8720f160a382e2ad25cd20459789b6a86e68da5079ba"}
Jul 24 16:15:37.392411 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.392344    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw" event={"ID":"54e89e0a-3d65-41a2-97f1-2c31f3d04a74","Type":"ContainerStarted","Data":"300abda55e864691d5c2c04be22e5d2cb2e03d9858e4207fc41950464c9324ea"}
Jul 24 16:15:37.392411 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.392374    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"
Jul 24 16:15:37.407651 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.407605    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9" podStartSLOduration=1.407574111 podStartE2EDuration="1.407574111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:15:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:15:37.405892794 +0000 UTC m=+1691.468341981" watchObservedRunningTime="2026-07-24 16:15:37.407574111 +0000 UTC m=+1691.470023297"
Jul 24 16:15:37.425475 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.425423    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw" podStartSLOduration=1.425406487 podStartE2EDuration="1.425406487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:15:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:15:37.42469814 +0000 UTC m=+1691.487147353" watchObservedRunningTime="2026-07-24 16:15:37.425406487 +0000 UTC m=+1691.487855673"
Jul 24 16:15:37.526116 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.526050    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:15:37.551307 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.551272    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d676d22c-9231-43a5-9fab-865577ece930-istio-podinfo\") pod \"d676d22c-9231-43a5-9fab-865577ece930\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") "
Jul 24 16:15:37.551491 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.551338    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-workload-certs\") pod \"d676d22c-9231-43a5-9fab-865577ece930\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") "
Jul 24 16:15:37.551491 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.551370    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lllh8\" (UniqueName: \"kubernetes.io/projected/d676d22c-9231-43a5-9fab-865577ece930-kube-api-access-lllh8\") pod \"d676d22c-9231-43a5-9fab-865577ece930\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") "
Jul 24 16:15:37.551491 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.551404    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-workload-socket\") pod \"d676d22c-9231-43a5-9fab-865577ece930\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") "
Jul 24 16:15:37.551491 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.551429    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-istio-envoy\") pod \"d676d22c-9231-43a5-9fab-865577ece930\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") "
Jul 24 16:15:37.551758 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.551493    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d676d22c-9231-43a5-9fab-865577ece930-istiod-ca-cert\") pod \"d676d22c-9231-43a5-9fab-865577ece930\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") "
Jul 24 16:15:37.551758 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.551551    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d676d22c-9231-43a5-9fab-865577ece930-istio-token\") pod \"d676d22c-9231-43a5-9fab-865577ece930\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") "
Jul 24 16:15:37.551758 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.551627    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-istio-data\") pod \"d676d22c-9231-43a5-9fab-865577ece930\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") "
Jul 24 16:15:37.551758 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.551677    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-credential-socket\") pod \"d676d22c-9231-43a5-9fab-865577ece930\" (UID: \"d676d22c-9231-43a5-9fab-865577ece930\") "
Jul 24 16:15:37.552192 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.552158    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d676d22c-9231-43a5-9fab-865577ece930" (UID: "d676d22c-9231-43a5-9fab-865577ece930"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:15:37.552298 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.552201    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d676d22c-9231-43a5-9fab-865577ece930" (UID: "d676d22c-9231-43a5-9fab-865577ece930"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:15:37.552449 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.552428    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d676d22c-9231-43a5-9fab-865577ece930-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d676d22c-9231-43a5-9fab-865577ece930" (UID: "d676d22c-9231-43a5-9fab-865577ece930"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:15:37.552613 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.552569    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d676d22c-9231-43a5-9fab-865577ece930" (UID: "d676d22c-9231-43a5-9fab-865577ece930"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:15:37.553289 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.553247    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-istio-data" (OuterVolumeSpecName: "istio-data") pod "d676d22c-9231-43a5-9fab-865577ece930" (UID: "d676d22c-9231-43a5-9fab-865577ece930"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:15:37.554460 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.554414    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d676d22c-9231-43a5-9fab-865577ece930-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d676d22c-9231-43a5-9fab-865577ece930" (UID: "d676d22c-9231-43a5-9fab-865577ece930"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:15:37.554708 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.554678    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d676d22c-9231-43a5-9fab-865577ece930-kube-api-access-lllh8" (OuterVolumeSpecName: "kube-api-access-lllh8") pod "d676d22c-9231-43a5-9fab-865577ece930" (UID: "d676d22c-9231-43a5-9fab-865577ece930"). InnerVolumeSpecName "kube-api-access-lllh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:15:37.554901 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.554873    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d676d22c-9231-43a5-9fab-865577ece930" (UID: "d676d22c-9231-43a5-9fab-865577ece930"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:15:37.554901 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.554895    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d676d22c-9231-43a5-9fab-865577ece930-istio-token" (OuterVolumeSpecName: "istio-token") pod "d676d22c-9231-43a5-9fab-865577ece930" (UID: "d676d22c-9231-43a5-9fab-865577ece930"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:15:37.653182 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.653144    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d676d22c-9231-43a5-9fab-865577ece930-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:15:37.653182 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.653175    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:15:37.653182 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.653189    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lllh8\" (UniqueName: \"kubernetes.io/projected/d676d22c-9231-43a5-9fab-865577ece930-kube-api-access-lllh8\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:15:37.653417 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.653199    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:15:37.653417 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.653211    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:15:37.653417 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.653220    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d676d22c-9231-43a5-9fab-865577ece930-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:15:37.653417 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.653228    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d676d22c-9231-43a5-9fab-865577ece930-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:15:37.653417 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.653236    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:15:37.653417 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:37.653244    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d676d22c-9231-43a5-9fab-865577ece930-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:15:38.399081 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:38.399035    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp" event={"ID":"d676d22c-9231-43a5-9fab-865577ece930","Type":"ContainerDied","Data":"b05780afb41f5b9a686238b52ca008e89e8427b4f6710d4b63ae1ea3245d5a78"}
Jul 24 16:15:38.399552 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:38.399107    2553 scope.go:117] "RemoveContainer" containerID="79d95cc4d6ded7245e5cf81f7dea8eb9118748c5491e55fe16aaedc63dfab10f"
Jul 24 16:15:38.399552 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:38.399050    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"
Jul 24 16:15:38.421881 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:38.421856    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"]
Jul 24 16:15:38.426434 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:38.426408    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f991138c-openshift-default-68484fc444-kxblp"]
Jul 24 16:15:38.475180 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:38.475146    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d676d22c-9231-43a5-9fab-865577ece930" path="/var/lib/kubelet/pods/d676d22c-9231-43a5-9fab-865577ece930/volumes"
Jul 24 16:15:48.401988 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:48.401498    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"
Jul 24 16:15:48.401988 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:48.401724    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"
Jul 24 16:15:50.377260 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:50.377162    2553 patch_prober.go:28] interesting pod/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 24 16:15:50.377260 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:50.377222    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p" podUID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 24 16:15:50.475330 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:50.475298    2553 generic.go:356] "Generic (PLEG): container finished" podID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerID="60123f312fcff15bfa8d667af63038d4088f05b537df17734edbfd99cac034c5" exitCode=0
Jul 24 16:15:50.475499 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:50.475369    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p" event={"ID":"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d","Type":"ContainerDied","Data":"60123f312fcff15bfa8d667af63038d4088f05b537df17734edbfd99cac034c5"}
Jul 24 16:15:50.475829 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:50.475815    2553 scope.go:117] "RemoveContainer" containerID="60123f312fcff15bfa8d667af63038d4088f05b537df17734edbfd99cac034c5"
Jul 24 16:15:50.476829 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:50.476801    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:15:50.477127 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:50.476861    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:15:50.477127 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:50.476894    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:15:51.483278 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:51.483245    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p" event={"ID":"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d","Type":"ContainerStarted","Data":"67fc8e48fb534a815a9b4c580698c7c64e8886d195b391f54800444978e822b2"}
Jul 24 16:15:51.555892 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:51.555859    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:51.556129 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:51.556112    2553 patch_prober.go:28] interesting pod/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 24 16:15:51.556182 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:51.556154    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p" podUID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 24 16:15:52.556738 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:52.556689    2553 patch_prober.go:28] interesting pod/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 24 16:15:52.557283 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:52.556803    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p" podUID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 24 16:15:53.557648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:53.557119    2553 patch_prober.go:28] interesting pod/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 24 16:15:53.557648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:53.557194    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p" podUID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 24 16:15:54.557054 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:54.557002    2553 patch_prober.go:28] interesting pod/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 24 16:15:54.557268 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:54.557085    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p" podUID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 24 16:15:55.556881 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:55.556837    2553 patch_prober.go:28] interesting pod/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 24 16:15:55.557425 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:55.556913    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p" podUID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 24 16:15:56.560464 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:56.560430    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:56.560923 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:56.560778    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:15:56.561511 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:15:56.561491    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:16:11.279011 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.278929    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"]
Jul 24 16:16:11.281927 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.279796    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"]
Jul 24 16:16:11.281927 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.280088    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9" podUID="4b696e2a-0fd0-4016-aff9-062d4452f369" containerName="payload-pre-processing" containerID="cri-o://9f0869be6d3495d95463d6b530e54ac3738e5091842797fb0e030bd1093cc2cf" gracePeriod=30
Jul 24 16:16:11.281927 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.280438    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw" podUID="54e89e0a-3d65-41a2-97f1-2c31f3d04a74" containerName="payload-processing" containerID="cri-o://168f43e1d007c3e0cc9d8720f160a382e2ad25cd20459789b6a86e68da5079ba" gracePeriod=30
Jul 24 16:16:11.580631 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.580600    2553 generic.go:356] "Generic (PLEG): container finished" podID="4b696e2a-0fd0-4016-aff9-062d4452f369" containerID="9f0869be6d3495d95463d6b530e54ac3738e5091842797fb0e030bd1093cc2cf" exitCode=0
Jul 24 16:16:11.580792 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.580657    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9" event={"ID":"4b696e2a-0fd0-4016-aff9-062d4452f369","Type":"ContainerDied","Data":"9f0869be6d3495d95463d6b530e54ac3738e5091842797fb0e030bd1093cc2cf"}
Jul 24 16:16:11.580792 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.580710    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9" event={"ID":"4b696e2a-0fd0-4016-aff9-062d4452f369","Type":"ContainerDied","Data":"167f8cd37b5b57a9f54f051c983acc3e252abeab987ae740cb57c79eb8c71699"}
Jul 24 16:16:11.580792 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.580736    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="167f8cd37b5b57a9f54f051c983acc3e252abeab987ae740cb57c79eb8c71699"
Jul 24 16:16:11.581973 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.581950    2553 generic.go:356] "Generic (PLEG): container finished" podID="54e89e0a-3d65-41a2-97f1-2c31f3d04a74" containerID="168f43e1d007c3e0cc9d8720f160a382e2ad25cd20459789b6a86e68da5079ba" exitCode=0
Jul 24 16:16:11.582069 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.581983    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw" event={"ID":"54e89e0a-3d65-41a2-97f1-2c31f3d04a74","Type":"ContainerDied","Data":"168f43e1d007c3e0cc9d8720f160a382e2ad25cd20459789b6a86e68da5079ba"}
Jul 24 16:16:11.582069 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.582022    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw" event={"ID":"54e89e0a-3d65-41a2-97f1-2c31f3d04a74","Type":"ContainerDied","Data":"300abda55e864691d5c2c04be22e5d2cb2e03d9858e4207fc41950464c9324ea"}
Jul 24 16:16:11.582069 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.582042    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="300abda55e864691d5c2c04be22e5d2cb2e03d9858e4207fc41950464c9324ea"
Jul 24 16:16:11.583465 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.583448    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"
Jul 24 16:16:11.586726 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.586708    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"
Jul 24 16:16:11.682053 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.682020    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp4fb\" (UniqueName: \"kubernetes.io/projected/4b696e2a-0fd0-4016-aff9-062d4452f369-kube-api-access-tp4fb\") pod \"4b696e2a-0fd0-4016-aff9-062d4452f369\" (UID: \"4b696e2a-0fd0-4016-aff9-062d4452f369\") "
Jul 24 16:16:11.682237 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.682076    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54e89e0a-3d65-41a2-97f1-2c31f3d04a74-plugins-config-volume\") pod \"54e89e0a-3d65-41a2-97f1-2c31f3d04a74\" (UID: \"54e89e0a-3d65-41a2-97f1-2c31f3d04a74\") "
Jul 24 16:16:11.682237 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.682154    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b696e2a-0fd0-4016-aff9-062d4452f369-plugins-config-volume\") pod \"4b696e2a-0fd0-4016-aff9-062d4452f369\" (UID: \"4b696e2a-0fd0-4016-aff9-062d4452f369\") "
Jul 24 16:16:11.682237 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.682233    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdzsq\" (UniqueName: \"kubernetes.io/projected/54e89e0a-3d65-41a2-97f1-2c31f3d04a74-kube-api-access-gdzsq\") pod \"54e89e0a-3d65-41a2-97f1-2c31f3d04a74\" (UID: \"54e89e0a-3d65-41a2-97f1-2c31f3d04a74\") "
Jul 24 16:16:11.682562 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.682532    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54e89e0a-3d65-41a2-97f1-2c31f3d04a74-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "54e89e0a-3d65-41a2-97f1-2c31f3d04a74" (UID: "54e89e0a-3d65-41a2-97f1-2c31f3d04a74"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:16:11.682739 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.682563    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b696e2a-0fd0-4016-aff9-062d4452f369-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4b696e2a-0fd0-4016-aff9-062d4452f369" (UID: "4b696e2a-0fd0-4016-aff9-062d4452f369"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:16:11.684220 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.684199    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b696e2a-0fd0-4016-aff9-062d4452f369-kube-api-access-tp4fb" (OuterVolumeSpecName: "kube-api-access-tp4fb") pod "4b696e2a-0fd0-4016-aff9-062d4452f369" (UID: "4b696e2a-0fd0-4016-aff9-062d4452f369"). InnerVolumeSpecName "kube-api-access-tp4fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:16:11.684318 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.684228    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54e89e0a-3d65-41a2-97f1-2c31f3d04a74-kube-api-access-gdzsq" (OuterVolumeSpecName: "kube-api-access-gdzsq") pod "54e89e0a-3d65-41a2-97f1-2c31f3d04a74" (UID: "54e89e0a-3d65-41a2-97f1-2c31f3d04a74"). InnerVolumeSpecName "kube-api-access-gdzsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:16:11.783883 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.783842    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdzsq\" (UniqueName: \"kubernetes.io/projected/54e89e0a-3d65-41a2-97f1-2c31f3d04a74-kube-api-access-gdzsq\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:11.783883 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.783873    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp4fb\" (UniqueName: \"kubernetes.io/projected/4b696e2a-0fd0-4016-aff9-062d4452f369-kube-api-access-tp4fb\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:11.783883 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.783887    2553 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54e89e0a-3d65-41a2-97f1-2c31f3d04a74-plugins-config-volume\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:11.784116 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:11.783902    2553 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b696e2a-0fd0-4016-aff9-062d4452f369-plugins-config-volume\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:12.586901 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:12.586869    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"
Jul 24 16:16:12.587284 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:12.586869    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"
Jul 24 16:16:12.607719 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:12.607684    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"]
Jul 24 16:16:12.612657 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:12.612632    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0b92f583-64576fddbd-tqhv9"]
Jul 24 16:16:12.622942 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:12.622913    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"]
Jul 24 16:16:12.628930 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:12.628905    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-0b92f583-5866d9d67c-qr6xw"]
Jul 24 16:16:14.475091 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:14.475054    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b696e2a-0fd0-4016-aff9-062d4452f369" path="/var/lib/kubelet/pods/4b696e2a-0fd0-4016-aff9-062d4452f369/volumes"
Jul 24 16:16:14.475489 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:14.475415    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54e89e0a-3d65-41a2-97f1-2c31f3d04a74" path="/var/lib/kubelet/pods/54e89e0a-3d65-41a2-97f1-2c31f3d04a74/volumes"
Jul 24 16:16:16.036606 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.026840    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"]
Jul 24 16:16:16.037407 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.037368    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p" podUID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerName="istio-proxy" containerID="cri-o://67fc8e48fb534a815a9b4c580698c7c64e8886d195b391f54800444978e822b2" gracePeriod=30
Jul 24 16:16:16.803535 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.803492    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"]
Jul 24 16:16:16.803926 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.803912    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d676d22c-9231-43a5-9fab-865577ece930" containerName="istio-proxy"
Jul 24 16:16:16.803983 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.803928    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d676d22c-9231-43a5-9fab-865577ece930" containerName="istio-proxy"
Jul 24 16:16:16.803983 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.803942    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e89e0a-3d65-41a2-97f1-2c31f3d04a74" containerName="payload-processing"
Jul 24 16:16:16.803983 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.803948    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e89e0a-3d65-41a2-97f1-2c31f3d04a74" containerName="payload-processing"
Jul 24 16:16:16.803983 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.803958    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d676d22c-9231-43a5-9fab-865577ece930" containerName="istio-proxy"
Jul 24 16:16:16.803983 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.803964    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d676d22c-9231-43a5-9fab-865577ece930" containerName="istio-proxy"
Jul 24 16:16:16.803983 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.803982    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b696e2a-0fd0-4016-aff9-062d4452f369" containerName="payload-pre-processing"
Jul 24 16:16:16.804167 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.803990    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b696e2a-0fd0-4016-aff9-062d4452f369" containerName="payload-pre-processing"
Jul 24 16:16:16.804167 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.804050    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d676d22c-9231-43a5-9fab-865577ece930" containerName="istio-proxy"
Jul 24 16:16:16.804167 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.804061    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="54e89e0a-3d65-41a2-97f1-2c31f3d04a74" containerName="payload-processing"
Jul 24 16:16:16.804167 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.804073    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b696e2a-0fd0-4016-aff9-062d4452f369" containerName="payload-pre-processing"
Jul 24 16:16:16.808447 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.808427    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:16.811219 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.811189    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2cc8eb19-openshift-default-dockercfg-8hkfb\""
Jul 24 16:16:16.819761 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.819729    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"]
Jul 24 16:16:16.937970 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.937930    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-envoy\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:16.937970 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.937968    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-podinfo\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:16.938193 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.937997    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-workload-socket\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:16.938193 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.938093    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-credential-socket\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:16.938193 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.938153    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-workload-certs\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:16.938193 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.938178    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-token\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:16.938333 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.938209    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/868b8eaa-8bce-478f-9493-39d1b966b5eb-istiod-ca-cert\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:16.938333 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.938282    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4psb\" (UniqueName: \"kubernetes.io/projected/868b8eaa-8bce-478f-9493-39d1b966b5eb-kube-api-access-l4psb\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:16.938405 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:16.938329    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-data\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.039695 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.039657    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-envoy\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.039695 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.039694    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-podinfo\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.040243 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.039720    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-workload-socket\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.040243 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.039746    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-credential-socket\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.040243 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.039779    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-workload-certs\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.040243 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.039801    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-token\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.040243 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.039820    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/868b8eaa-8bce-478f-9493-39d1b966b5eb-istiod-ca-cert\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.040243 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.039872    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4psb\" (UniqueName: \"kubernetes.io/projected/868b8eaa-8bce-478f-9493-39d1b966b5eb-kube-api-access-l4psb\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.040243 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.039913    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-data\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.040685 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.040285    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-data\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.040685 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.040608    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-workload-certs\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.040890 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.040864    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-credential-socket\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.041006 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.040955    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-workload-socket\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.041117 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.041098    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/868b8eaa-8bce-478f-9493-39d1b966b5eb-istiod-ca-cert\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.042413 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.042390    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-envoy\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.042970 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.042951    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-podinfo\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.049982 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.049959    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-token\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.050086 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.050054    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4psb\" (UniqueName: \"kubernetes.io/projected/868b8eaa-8bce-478f-9493-39d1b966b5eb-kube-api-access-l4psb\") pod \"e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") " pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.121367 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.121268    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:17.277654 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.277622    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"]
Jul 24 16:16:17.280106 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:16:17.280079    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868b8eaa_8bce_478f_9493_39d1b966b5eb.slice/crio-697016787becf98f832904414ac43ece8c8fd07e81cf3ff0882543f00829b123 WatchSource:0}: Error finding container 697016787becf98f832904414ac43ece8c8fd07e81cf3ff0882543f00829b123: Status 404 returned error can't find the container with id 697016787becf98f832904414ac43ece8c8fd07e81cf3ff0882543f00829b123
Jul 24 16:16:17.282398 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.282367    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:16:17.282497 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.282447    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:16:17.282497 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.282490    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:16:17.613638 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.613598    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr" event={"ID":"868b8eaa-8bce-478f-9493-39d1b966b5eb","Type":"ContainerStarted","Data":"cd9b4d99488537d85179bf42c24651ed6b65ae7b16f4e2fb81ba7515bd1e0633"}
Jul 24 16:16:17.613848 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.613655    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr" event={"ID":"868b8eaa-8bce-478f-9493-39d1b966b5eb","Type":"ContainerStarted","Data":"697016787becf98f832904414ac43ece8c8fd07e81cf3ff0882543f00829b123"}
Jul 24 16:16:17.635170 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:17.635088    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr" podStartSLOduration=1.635072077 podStartE2EDuration="1.635072077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:16:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:16:17.633540767 +0000 UTC m=+1731.695989964" watchObservedRunningTime="2026-07-24 16:16:17.635072077 +0000 UTC m=+1731.697521264"
Jul 24 16:16:18.122108 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:18.122077    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:18.126843 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:18.126815    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:18.618964 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:18.618934    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:18.619838 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:18.619815    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:19.937548 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:19.937508    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"]
Jul 24 16:16:19.938199 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:19.938177    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d676d22c-9231-43a5-9fab-865577ece930" containerName="istio-proxy"
Jul 24 16:16:19.941565 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:19.941541    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"
Jul 24 16:16:19.944406 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:19.944380    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-2cc8eb19\""
Jul 24 16:16:19.944710 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:19.944687    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-2cc8eb19-dockercfg-6glt7\""
Jul 24 16:16:19.951908 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:19.951883    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"]
Jul 24 16:16:19.970123 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:19.970077    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b27ab6d8-0b38-4815-a18a-e02a9f65723d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4\" (UID: \"b27ab6d8-0b38-4815-a18a-e02a9f65723d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"
Jul 24 16:16:19.970327 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:19.970173    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9np\" (UniqueName: \"kubernetes.io/projected/b27ab6d8-0b38-4815-a18a-e02a9f65723d-kube-api-access-6l9np\") pod \"payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4\" (UID: \"b27ab6d8-0b38-4815-a18a-e02a9f65723d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"
Jul 24 16:16:20.070692 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:20.070659    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b27ab6d8-0b38-4815-a18a-e02a9f65723d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4\" (UID: \"b27ab6d8-0b38-4815-a18a-e02a9f65723d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"
Jul 24 16:16:20.070890 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:20.070716    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9np\" (UniqueName: \"kubernetes.io/projected/b27ab6d8-0b38-4815-a18a-e02a9f65723d-kube-api-access-6l9np\") pod \"payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4\" (UID: \"b27ab6d8-0b38-4815-a18a-e02a9f65723d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"
Jul 24 16:16:20.071344 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:20.071323    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b27ab6d8-0b38-4815-a18a-e02a9f65723d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4\" (UID: \"b27ab6d8-0b38-4815-a18a-e02a9f65723d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"
Jul 24 16:16:20.081491 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:20.081460    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9np\" (UniqueName: \"kubernetes.io/projected/b27ab6d8-0b38-4815-a18a-e02a9f65723d-kube-api-access-6l9np\") pod \"payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4\" (UID: \"b27ab6d8-0b38-4815-a18a-e02a9f65723d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"
Jul 24 16:16:20.255714 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:20.255679    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"
Jul 24 16:16:20.400830 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:20.400799    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"]
Jul 24 16:16:20.402633 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:16:20.402608    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27ab6d8_0b38_4815_a18a_e02a9f65723d.slice/crio-201f978bdbc460a504997ce7577a19f1188e833b34aa85fe0b0df2d135921fd7 WatchSource:0}: Error finding container 201f978bdbc460a504997ce7577a19f1188e833b34aa85fe0b0df2d135921fd7: Status 404 returned error can't find the container with id 201f978bdbc460a504997ce7577a19f1188e833b34aa85fe0b0df2d135921fd7
Jul 24 16:16:20.631622 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:20.631490    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4" event={"ID":"b27ab6d8-0b38-4815-a18a-e02a9f65723d","Type":"ContainerStarted","Data":"452a3dfda01a67607dcdab2cd9d788243d8219a7956100f3ca51e537ef43d2e8"}
Jul 24 16:16:20.631622 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:20.631560    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4" event={"ID":"b27ab6d8-0b38-4815-a18a-e02a9f65723d","Type":"ContainerStarted","Data":"201f978bdbc460a504997ce7577a19f1188e833b34aa85fe0b0df2d135921fd7"}
Jul 24 16:16:20.650477 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:20.650423    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4" podStartSLOduration=1.65040471 podStartE2EDuration="1.65040471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:16:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:16:20.649608869 +0000 UTC m=+1734.712058056" watchObservedRunningTime="2026-07-24 16:16:20.65040471 +0000 UTC m=+1734.712853896"
Jul 24 16:16:21.304029 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.303961    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:16:21.382714 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.382677    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-podinfo\") pod \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") "
Jul 24 16:16:21.382714 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.382719    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-envoy\") pod \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") "
Jul 24 16:16:21.382975 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.382752    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-token\") pod \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") "
Jul 24 16:16:21.382975 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.382789    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-credential-socket\") pod \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") "
Jul 24 16:16:21.382975 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.382820    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-workload-socket\") pod \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") "
Jul 24 16:16:21.382975 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.382843    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-data\") pod \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") "
Jul 24 16:16:21.382975 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.382866    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istiod-ca-cert\") pod \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") "
Jul 24 16:16:21.382975 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.382892    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-workload-certs\") pod \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") "
Jul 24 16:16:21.382975 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.382930    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s6ms\" (UniqueName: \"kubernetes.io/projected/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-kube-api-access-7s6ms\") pod \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\" (UID: \"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d\") "
Jul 24 16:16:21.383341 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.383108    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" (UID: "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:16:21.383341 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.383146    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" (UID: "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:16:21.383341 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.383293    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" (UID: "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:16:21.383341 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.383298    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:21.383341 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.383340    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:21.383654 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.383417    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" (UID: "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:16:21.383897 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.383877    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-data" (OuterVolumeSpecName: "istio-data") pod "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" (UID: "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:16:21.385036 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.385013    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" (UID: "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:16:21.385160 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.385107    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-kube-api-access-7s6ms" (OuterVolumeSpecName: "kube-api-access-7s6ms") pod "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" (UID: "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d"). InnerVolumeSpecName "kube-api-access-7s6ms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:16:21.385349 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.385332    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" (UID: "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:16:21.385438 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.385363    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-token" (OuterVolumeSpecName: "istio-token") pod "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" (UID: "533dfdf6-ac6d-4af4-a9f2-67b79a5db62d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:16:21.483970 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.483936    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:21.483970 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.483968    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:21.483970 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.483978    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:21.484199 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.483989    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s6ms\" (UniqueName: \"kubernetes.io/projected/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-kube-api-access-7s6ms\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:21.484199 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.483998    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:21.484199 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.484007    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:21.484199 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.484014    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:21.638754 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.638661    2553 generic.go:356] "Generic (PLEG): container finished" podID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerID="67fc8e48fb534a815a9b4c580698c7c64e8886d195b391f54800444978e822b2" exitCode=0
Jul 24 16:16:21.638754 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.638705    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p" event={"ID":"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d","Type":"ContainerDied","Data":"67fc8e48fb534a815a9b4c580698c7c64e8886d195b391f54800444978e822b2"}
Jul 24 16:16:21.638754 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.638735    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"
Jul 24 16:16:21.639020 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.638762    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p" event={"ID":"533dfdf6-ac6d-4af4-a9f2-67b79a5db62d","Type":"ContainerDied","Data":"68cf9a65967c3f76cfd854aece80455a6e4843ee1e0ecaab6a9ac6021c494b63"}
Jul 24 16:16:21.639020 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.638792    2553 scope.go:117] "RemoveContainer" containerID="67fc8e48fb534a815a9b4c580698c7c64e8886d195b391f54800444978e822b2"
Jul 24 16:16:21.639556 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.639493    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"
Jul 24 16:16:21.648268 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.648253    2553 scope.go:117] "RemoveContainer" containerID="60123f312fcff15bfa8d667af63038d4088f05b537df17734edbfd99cac034c5"
Jul 24 16:16:21.657823 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.657800    2553 scope.go:117] "RemoveContainer" containerID="67fc8e48fb534a815a9b4c580698c7c64e8886d195b391f54800444978e822b2"
Jul 24 16:16:21.658123 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:16:21.658102    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67fc8e48fb534a815a9b4c580698c7c64e8886d195b391f54800444978e822b2\": container with ID starting with 67fc8e48fb534a815a9b4c580698c7c64e8886d195b391f54800444978e822b2 not found: ID does not exist" containerID="67fc8e48fb534a815a9b4c580698c7c64e8886d195b391f54800444978e822b2"
Jul 24 16:16:21.658179 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.658133    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67fc8e48fb534a815a9b4c580698c7c64e8886d195b391f54800444978e822b2"} err="failed to get container status \"67fc8e48fb534a815a9b4c580698c7c64e8886d195b391f54800444978e822b2\": rpc error: code = NotFound desc = could not find container \"67fc8e48fb534a815a9b4c580698c7c64e8886d195b391f54800444978e822b2\": container with ID starting with 67fc8e48fb534a815a9b4c580698c7c64e8886d195b391f54800444978e822b2 not found: ID does not exist"
Jul 24 16:16:21.658179 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.658152    2553 scope.go:117] "RemoveContainer" containerID="60123f312fcff15bfa8d667af63038d4088f05b537df17734edbfd99cac034c5"
Jul 24 16:16:21.658425 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:16:21.658406    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60123f312fcff15bfa8d667af63038d4088f05b537df17734edbfd99cac034c5\": container with ID starting with 60123f312fcff15bfa8d667af63038d4088f05b537df17734edbfd99cac034c5 not found: ID does not exist" containerID="60123f312fcff15bfa8d667af63038d4088f05b537df17734edbfd99cac034c5"
Jul 24 16:16:21.658480 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.658431    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60123f312fcff15bfa8d667af63038d4088f05b537df17734edbfd99cac034c5"} err="failed to get container status \"60123f312fcff15bfa8d667af63038d4088f05b537df17734edbfd99cac034c5\": rpc error: code = NotFound desc = could not find container \"60123f312fcff15bfa8d667af63038d4088f05b537df17734edbfd99cac034c5\": container with ID starting with 60123f312fcff15bfa8d667af63038d4088f05b537df17734edbfd99cac034c5 not found: ID does not exist"
Jul 24 16:16:21.663891 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.663864    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"]
Jul 24 16:16:21.668490 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:21.668463    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-0b92f583-gw-openshift-default-7c7f5fcd88-2l92p"]
Jul 24 16:16:22.475074 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:22.475036    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" path="/var/lib/kubelet/pods/533dfdf6-ac6d-4af4-a9f2-67b79a5db62d/volumes"
Jul 24 16:16:32.647491 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:32.647458    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"
Jul 24 16:16:33.620325 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:33.620246    2553 patch_prober.go:28] interesting pod/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 24 16:16:33.620505 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:33.620316    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr" podUID="868b8eaa-8bce-478f-9493-39d1b966b5eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 24 16:16:33.711010 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:33.710916    2553 generic.go:356] "Generic (PLEG): container finished" podID="868b8eaa-8bce-478f-9493-39d1b966b5eb" containerID="cd9b4d99488537d85179bf42c24651ed6b65ae7b16f4e2fb81ba7515bd1e0633" exitCode=0
Jul 24 16:16:33.711010 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:33.710967    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr" event={"ID":"868b8eaa-8bce-478f-9493-39d1b966b5eb","Type":"ContainerDied","Data":"cd9b4d99488537d85179bf42c24651ed6b65ae7b16f4e2fb81ba7515bd1e0633"}
Jul 24 16:16:33.711550 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:33.711445    2553 scope.go:117] "RemoveContainer" containerID="cd9b4d99488537d85179bf42c24651ed6b65ae7b16f4e2fb81ba7515bd1e0633"
Jul 24 16:16:33.712722 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:33.712694    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:16:33.712798 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:33.712764    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:16:33.712837 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:33.712796    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:16:34.717789 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:34.717752    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr" event={"ID":"868b8eaa-8bce-478f-9493-39d1b966b5eb","Type":"ContainerStarted","Data":"4847c65f86e66e9fe26a45f4fc0af62b0fe3980666eaea7b3e778ef2627ffc55"}
Jul 24 16:16:35.121984 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:35.121941    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:35.122244 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:35.122219    2553 patch_prober.go:28] interesting pod/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 24 16:16:35.122302 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:35.122270    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr" podUID="868b8eaa-8bce-478f-9493-39d1b966b5eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 24 16:16:36.122171 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:36.122126    2553 patch_prober.go:28] interesting pod/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 24 16:16:36.122702 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:36.122190    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr" podUID="868b8eaa-8bce-478f-9493-39d1b966b5eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 24 16:16:37.122137 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:37.122096    2553 patch_prober.go:28] interesting pod/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 24 16:16:37.122319 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:37.122160    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr" podUID="868b8eaa-8bce-478f-9493-39d1b966b5eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 24 16:16:38.122546 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:38.122511    2553 patch_prober.go:28] interesting pod/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 24 16:16:38.122979 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:38.122618    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr" podUID="868b8eaa-8bce-478f-9493-39d1b966b5eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 24 16:16:39.125667 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:39.125639    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:39.126123 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:39.125911    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:39.126793 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:39.126775    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:16:55.273071 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.273030    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"]
Jul 24 16:16:55.273629 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.273243    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4" podUID="b27ab6d8-0b38-4815-a18a-e02a9f65723d" containerName="payload-pre-processing" containerID="cri-o://452a3dfda01a67607dcdab2cd9d788243d8219a7956100f3ca51e537ef43d2e8" gracePeriod=30
Jul 24 16:16:55.528255 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.528193    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"
Jul 24 16:16:55.713470 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.713438    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l9np\" (UniqueName: \"kubernetes.io/projected/b27ab6d8-0b38-4815-a18a-e02a9f65723d-kube-api-access-6l9np\") pod \"b27ab6d8-0b38-4815-a18a-e02a9f65723d\" (UID: \"b27ab6d8-0b38-4815-a18a-e02a9f65723d\") "
Jul 24 16:16:55.713704 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.713483    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b27ab6d8-0b38-4815-a18a-e02a9f65723d-plugins-config-volume\") pod \"b27ab6d8-0b38-4815-a18a-e02a9f65723d\" (UID: \"b27ab6d8-0b38-4815-a18a-e02a9f65723d\") "
Jul 24 16:16:55.713917 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.713894    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b27ab6d8-0b38-4815-a18a-e02a9f65723d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b27ab6d8-0b38-4815-a18a-e02a9f65723d" (UID: "b27ab6d8-0b38-4815-a18a-e02a9f65723d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:16:55.715632 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.715578    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27ab6d8-0b38-4815-a18a-e02a9f65723d-kube-api-access-6l9np" (OuterVolumeSpecName: "kube-api-access-6l9np") pod "b27ab6d8-0b38-4815-a18a-e02a9f65723d" (UID: "b27ab6d8-0b38-4815-a18a-e02a9f65723d"). InnerVolumeSpecName "kube-api-access-6l9np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:16:55.814291 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.814199    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l9np\" (UniqueName: \"kubernetes.io/projected/b27ab6d8-0b38-4815-a18a-e02a9f65723d-kube-api-access-6l9np\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:55.814291 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.814231    2553 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b27ab6d8-0b38-4815-a18a-e02a9f65723d-plugins-config-volume\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:16:55.825495 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.825465    2553 generic.go:356] "Generic (PLEG): container finished" podID="b27ab6d8-0b38-4815-a18a-e02a9f65723d" containerID="452a3dfda01a67607dcdab2cd9d788243d8219a7956100f3ca51e537ef43d2e8" exitCode=0
Jul 24 16:16:55.825667 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.825504    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"
Jul 24 16:16:55.825667 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.825512    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4" event={"ID":"b27ab6d8-0b38-4815-a18a-e02a9f65723d","Type":"ContainerDied","Data":"452a3dfda01a67607dcdab2cd9d788243d8219a7956100f3ca51e537ef43d2e8"}
Jul 24 16:16:55.825667 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.825557    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4" event={"ID":"b27ab6d8-0b38-4815-a18a-e02a9f65723d","Type":"ContainerDied","Data":"201f978bdbc460a504997ce7577a19f1188e833b34aa85fe0b0df2d135921fd7"}
Jul 24 16:16:55.825667 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.825580    2553 scope.go:117] "RemoveContainer" containerID="452a3dfda01a67607dcdab2cd9d788243d8219a7956100f3ca51e537ef43d2e8"
Jul 24 16:16:55.834274 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.834254    2553 scope.go:117] "RemoveContainer" containerID="452a3dfda01a67607dcdab2cd9d788243d8219a7956100f3ca51e537ef43d2e8"
Jul 24 16:16:55.834567 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:16:55.834548    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"452a3dfda01a67607dcdab2cd9d788243d8219a7956100f3ca51e537ef43d2e8\": container with ID starting with 452a3dfda01a67607dcdab2cd9d788243d8219a7956100f3ca51e537ef43d2e8 not found: ID does not exist" containerID="452a3dfda01a67607dcdab2cd9d788243d8219a7956100f3ca51e537ef43d2e8"
Jul 24 16:16:55.834649 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.834576    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"452a3dfda01a67607dcdab2cd9d788243d8219a7956100f3ca51e537ef43d2e8"} err="failed to get container status \"452a3dfda01a67607dcdab2cd9d788243d8219a7956100f3ca51e537ef43d2e8\": rpc error: code = NotFound desc = could not find container \"452a3dfda01a67607dcdab2cd9d788243d8219a7956100f3ca51e537ef43d2e8\": container with ID starting with 452a3dfda01a67607dcdab2cd9d788243d8219a7956100f3ca51e537ef43d2e8 not found: ID does not exist"
Jul 24 16:16:55.876355 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.876309    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"]
Jul 24 16:16:55.879204 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:55.879175    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2cc8eb19-5c88959f4d-9hsx4"]
Jul 24 16:16:56.480420 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:16:56.480386    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b27ab6d8-0b38-4815-a18a-e02a9f65723d" path="/var/lib/kubelet/pods/b27ab6d8-0b38-4815-a18a-e02a9f65723d/volumes"
Jul 24 16:17:00.966995 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:00.966963    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"]
Jul 24 16:17:00.967604 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:00.967182    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr" podUID="868b8eaa-8bce-478f-9493-39d1b966b5eb" containerName="istio-proxy" containerID="cri-o://4847c65f86e66e9fe26a45f4fc0af62b0fe3980666eaea7b3e778ef2627ffc55" gracePeriod=30
Jul 24 16:17:01.760443 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.760410    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"]
Jul 24 16:17:01.760822 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.760808    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27ab6d8-0b38-4815-a18a-e02a9f65723d" containerName="payload-pre-processing"
Jul 24 16:17:01.760877 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.760824    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27ab6d8-0b38-4815-a18a-e02a9f65723d" containerName="payload-pre-processing"
Jul 24 16:17:01.760877 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.760839    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerName="istio-proxy"
Jul 24 16:17:01.760877 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.760845    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerName="istio-proxy"
Jul 24 16:17:01.760986 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.760857    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerName="istio-proxy"
Jul 24 16:17:01.760986 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.760889    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerName="istio-proxy"
Jul 24 16:17:01.760986 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.760946    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerName="istio-proxy"
Jul 24 16:17:01.760986 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.760957    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b27ab6d8-0b38-4815-a18a-e02a9f65723d" containerName="payload-pre-processing"
Jul 24 16:17:01.764088 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.764072    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.766829 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.766799    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-8426fff8-openshift-default-dockercfg-2lhdm\""
Jul 24 16:17:01.771817 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.771789    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-workload-certs\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.771939 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.771848    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-podinfo\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.771939 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.771899    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-token\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.772067 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.771943    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istiod-ca-cert\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.772067 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.771968    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-workload-socket\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.772067 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.771995    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-credential-socket\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.772067 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.772063    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-data\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.772229 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.772120    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdshd\" (UniqueName: \"kubernetes.io/projected/d57d2fb9-cddf-48e4-aae4-55075f7e8266-kube-api-access-gdshd\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.772229 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.772152    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-envoy\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.777933 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.777909    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"]
Jul 24 16:17:01.873221 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.873188    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdshd\" (UniqueName: \"kubernetes.io/projected/d57d2fb9-cddf-48e4-aae4-55075f7e8266-kube-api-access-gdshd\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.873415 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.873229    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-envoy\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.873415 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.873350    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-workload-certs\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.873415 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.873405    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-podinfo\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.873624 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.873461    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-token\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.873624 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.873509    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istiod-ca-cert\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.873624 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.873535    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-workload-socket\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.873624 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.873559    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-credential-socket\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.873846 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.873632    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-data\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.873989 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.873965    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-workload-socket\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.874063 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.873975    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-data\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.874121 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.874069    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-workload-certs\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.874220 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.874195    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-credential-socket\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.874546 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.874527    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istiod-ca-cert\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.876785 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.876440    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-envoy\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.877038 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.877012    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-podinfo\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.881512 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.881483    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-token\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:01.881954 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:01.881937    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdshd\" (UniqueName: \"kubernetes.io/projected/d57d2fb9-cddf-48e4-aae4-55075f7e8266-kube-api-access-gdshd\") pod \"e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") " pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:02.074690 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:02.074600    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:02.226535 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:02.226506    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"]
Jul 24 16:17:02.229775 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:17:02.229319    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57d2fb9_cddf_48e4_aae4_55075f7e8266.slice/crio-40679edf801dbb62714d7ad6c8df68ec997bf6e43ea6e16262dfc6c635814e1e WatchSource:0}: Error finding container 40679edf801dbb62714d7ad6c8df68ec997bf6e43ea6e16262dfc6c635814e1e: Status 404 returned error can't find the container with id 40679edf801dbb62714d7ad6c8df68ec997bf6e43ea6e16262dfc6c635814e1e
Jul 24 16:17:02.231697 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:02.231664    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:17:02.231794 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:02.231737    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:17:02.231794 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:02.231769    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:17:02.868608 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:02.868546    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv" event={"ID":"d57d2fb9-cddf-48e4-aae4-55075f7e8266","Type":"ContainerStarted","Data":"f0f9de31922aea7df0a131e10ae67813a29f61390793b9cb2dad6849b68bfb58"}
Jul 24 16:17:02.868788 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:02.868633    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv" event={"ID":"d57d2fb9-cddf-48e4-aae4-55075f7e8266","Type":"ContainerStarted","Data":"40679edf801dbb62714d7ad6c8df68ec997bf6e43ea6e16262dfc6c635814e1e"}
Jul 24 16:17:02.893618 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:02.893558    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv" podStartSLOduration=1.8935435250000001 podStartE2EDuration="1.893543525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:17:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:17:02.890999457 +0000 UTC m=+1776.953448663" watchObservedRunningTime="2026-07-24 16:17:02.893543525 +0000 UTC m=+1776.955992712"
Jul 24 16:17:03.075505 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:03.075463    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:03.080847 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:03.080815    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:03.873283 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:03.873252    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:03.874064 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:03.874043    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:06.217020 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.216993    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:17:06.318158 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318120    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/868b8eaa-8bce-478f-9493-39d1b966b5eb-istiod-ca-cert\") pod \"868b8eaa-8bce-478f-9493-39d1b966b5eb\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") "
Jul 24 16:17:06.318339 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318167    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-credential-socket\") pod \"868b8eaa-8bce-478f-9493-39d1b966b5eb\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") "
Jul 24 16:17:06.318339 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318208    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-podinfo\") pod \"868b8eaa-8bce-478f-9493-39d1b966b5eb\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") "
Jul 24 16:17:06.318339 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318253    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-envoy\") pod \"868b8eaa-8bce-478f-9493-39d1b966b5eb\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") "
Jul 24 16:17:06.318339 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318277    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-workload-certs\") pod \"868b8eaa-8bce-478f-9493-39d1b966b5eb\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") "
Jul 24 16:17:06.318514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318417    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4psb\" (UniqueName: \"kubernetes.io/projected/868b8eaa-8bce-478f-9493-39d1b966b5eb-kube-api-access-l4psb\") pod \"868b8eaa-8bce-478f-9493-39d1b966b5eb\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") "
Jul 24 16:17:06.318514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318485    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-token\") pod \"868b8eaa-8bce-478f-9493-39d1b966b5eb\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") "
Jul 24 16:17:06.318658 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318543    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "868b8eaa-8bce-478f-9493-39d1b966b5eb" (UID: "868b8eaa-8bce-478f-9493-39d1b966b5eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:17:06.318658 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318563    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-workload-socket\") pod \"868b8eaa-8bce-478f-9493-39d1b966b5eb\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") "
Jul 24 16:17:06.318658 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318545    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/868b8eaa-8bce-478f-9493-39d1b966b5eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "868b8eaa-8bce-478f-9493-39d1b966b5eb" (UID: "868b8eaa-8bce-478f-9493-39d1b966b5eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:17:06.318658 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318625    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-data\") pod \"868b8eaa-8bce-478f-9493-39d1b966b5eb\" (UID: \"868b8eaa-8bce-478f-9493-39d1b966b5eb\") "
Jul 24 16:17:06.318882 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318772    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "868b8eaa-8bce-478f-9493-39d1b966b5eb" (UID: "868b8eaa-8bce-478f-9493-39d1b966b5eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:17:06.318945 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318919    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:06.318945 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318928    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "868b8eaa-8bce-478f-9493-39d1b966b5eb" (UID: "868b8eaa-8bce-478f-9493-39d1b966b5eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:17:06.319062 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318940    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/868b8eaa-8bce-478f-9493-39d1b966b5eb-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:06.319062 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.318974    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:06.319473 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.319450    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "868b8eaa-8bce-478f-9493-39d1b966b5eb" (UID: "868b8eaa-8bce-478f-9493-39d1b966b5eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:17:06.320745 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.320720    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "868b8eaa-8bce-478f-9493-39d1b966b5eb" (UID: "868b8eaa-8bce-478f-9493-39d1b966b5eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:17:06.320867 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.320753    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "868b8eaa-8bce-478f-9493-39d1b966b5eb" (UID: "868b8eaa-8bce-478f-9493-39d1b966b5eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:17:06.320986 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.320969    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "868b8eaa-8bce-478f-9493-39d1b966b5eb" (UID: "868b8eaa-8bce-478f-9493-39d1b966b5eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:17:06.321052 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.320992    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/868b8eaa-8bce-478f-9493-39d1b966b5eb-kube-api-access-l4psb" (OuterVolumeSpecName: "kube-api-access-l4psb") pod "868b8eaa-8bce-478f-9493-39d1b966b5eb" (UID: "868b8eaa-8bce-478f-9493-39d1b966b5eb"). InnerVolumeSpecName "kube-api-access-l4psb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:17:06.419687 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.419653    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:06.419687 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.419680    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:06.419687 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.419692    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:06.419926 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.419700    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/868b8eaa-8bce-478f-9493-39d1b966b5eb-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:06.419926 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.419708    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4psb\" (UniqueName: \"kubernetes.io/projected/868b8eaa-8bce-478f-9493-39d1b966b5eb-kube-api-access-l4psb\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:06.419926 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.419718    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/868b8eaa-8bce-478f-9493-39d1b966b5eb-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:06.889523 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.889482    2553 generic.go:356] "Generic (PLEG): container finished" podID="868b8eaa-8bce-478f-9493-39d1b966b5eb" containerID="4847c65f86e66e9fe26a45f4fc0af62b0fe3980666eaea7b3e778ef2627ffc55" exitCode=0
Jul 24 16:17:06.889721 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.889554    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"
Jul 24 16:17:06.889721 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.889566    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr" event={"ID":"868b8eaa-8bce-478f-9493-39d1b966b5eb","Type":"ContainerDied","Data":"4847c65f86e66e9fe26a45f4fc0af62b0fe3980666eaea7b3e778ef2627ffc55"}
Jul 24 16:17:06.889721 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.889659    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr" event={"ID":"868b8eaa-8bce-478f-9493-39d1b966b5eb","Type":"ContainerDied","Data":"697016787becf98f832904414ac43ece8c8fd07e81cf3ff0882543f00829b123"}
Jul 24 16:17:06.889721 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.889676    2553 scope.go:117] "RemoveContainer" containerID="4847c65f86e66e9fe26a45f4fc0af62b0fe3980666eaea7b3e778ef2627ffc55"
Jul 24 16:17:06.898546 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.898525    2553 scope.go:117] "RemoveContainer" containerID="cd9b4d99488537d85179bf42c24651ed6b65ae7b16f4e2fb81ba7515bd1e0633"
Jul 24 16:17:06.906657 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.906635    2553 scope.go:117] "RemoveContainer" containerID="4847c65f86e66e9fe26a45f4fc0af62b0fe3980666eaea7b3e778ef2627ffc55"
Jul 24 16:17:06.906946 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:17:06.906922    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4847c65f86e66e9fe26a45f4fc0af62b0fe3980666eaea7b3e778ef2627ffc55\": container with ID starting with 4847c65f86e66e9fe26a45f4fc0af62b0fe3980666eaea7b3e778ef2627ffc55 not found: ID does not exist" containerID="4847c65f86e66e9fe26a45f4fc0af62b0fe3980666eaea7b3e778ef2627ffc55"
Jul 24 16:17:06.907015 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.906955    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4847c65f86e66e9fe26a45f4fc0af62b0fe3980666eaea7b3e778ef2627ffc55"} err="failed to get container status \"4847c65f86e66e9fe26a45f4fc0af62b0fe3980666eaea7b3e778ef2627ffc55\": rpc error: code = NotFound desc = could not find container \"4847c65f86e66e9fe26a45f4fc0af62b0fe3980666eaea7b3e778ef2627ffc55\": container with ID starting with 4847c65f86e66e9fe26a45f4fc0af62b0fe3980666eaea7b3e778ef2627ffc55 not found: ID does not exist"
Jul 24 16:17:06.907015 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.906971    2553 scope.go:117] "RemoveContainer" containerID="cd9b4d99488537d85179bf42c24651ed6b65ae7b16f4e2fb81ba7515bd1e0633"
Jul 24 16:17:06.907195 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:17:06.907181    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd9b4d99488537d85179bf42c24651ed6b65ae7b16f4e2fb81ba7515bd1e0633\": container with ID starting with cd9b4d99488537d85179bf42c24651ed6b65ae7b16f4e2fb81ba7515bd1e0633 not found: ID does not exist" containerID="cd9b4d99488537d85179bf42c24651ed6b65ae7b16f4e2fb81ba7515bd1e0633"
Jul 24 16:17:06.907231 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.907200    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd9b4d99488537d85179bf42c24651ed6b65ae7b16f4e2fb81ba7515bd1e0633"} err="failed to get container status \"cd9b4d99488537d85179bf42c24651ed6b65ae7b16f4e2fb81ba7515bd1e0633\": rpc error: code = NotFound desc = could not find container \"cd9b4d99488537d85179bf42c24651ed6b65ae7b16f4e2fb81ba7515bd1e0633\": container with ID starting with cd9b4d99488537d85179bf42c24651ed6b65ae7b16f4e2fb81ba7515bd1e0633 not found: ID does not exist"
Jul 24 16:17:06.912935 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.912908    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"]
Jul 24 16:17:06.916792 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:06.916767    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2cc8eb19-openshift-default-c4cd5b5f8-5kbrr"]
Jul 24 16:17:08.475044 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:08.475013    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="868b8eaa-8bce-478f-9493-39d1b966b5eb" path="/var/lib/kubelet/pods/868b8eaa-8bce-478f-9493-39d1b966b5eb/volumes"
Jul 24 16:17:17.948341 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:17.948252    2553 generic.go:356] "Generic (PLEG): container finished" podID="d57d2fb9-cddf-48e4-aae4-55075f7e8266" containerID="f0f9de31922aea7df0a131e10ae67813a29f61390793b9cb2dad6849b68bfb58" exitCode=0
Jul 24 16:17:17.948341 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:17.948330    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv" event={"ID":"d57d2fb9-cddf-48e4-aae4-55075f7e8266","Type":"ContainerDied","Data":"f0f9de31922aea7df0a131e10ae67813a29f61390793b9cb2dad6849b68bfb58"}
Jul 24 16:17:17.948803 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:17.948764    2553 scope.go:117] "RemoveContainer" containerID="f0f9de31922aea7df0a131e10ae67813a29f61390793b9cb2dad6849b68bfb58"
Jul 24 16:17:17.949795 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:17.949765    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:17:17.949870 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:17.949850    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:17:17.949920 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:17.949906    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:17:18.873339 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:18.873295    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:18.959436 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:18.959391    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv" event={"ID":"d57d2fb9-cddf-48e4-aae4-55075f7e8266","Type":"ContainerStarted","Data":"fc55969b8ed7faccef10640fb3430f42ddf1c4bae0b85c6dc9aad035f3b5a34e"}
Jul 24 16:17:19.075780 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:19.075743    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:19.076937 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:19.076904    2553 patch_prober.go:28] interesting pod/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 24 16:17:19.077086 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:19.076964    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv" podUID="d57d2fb9-cddf-48e4-aae4-55075f7e8266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 24 16:17:20.075205 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:20.075165    2553 patch_prober.go:28] interesting pod/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 24 16:17:20.075666 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:20.075240    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv" podUID="d57d2fb9-cddf-48e4-aae4-55075f7e8266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 24 16:17:21.075523 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:21.075464    2553 patch_prober.go:28] interesting pod/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 24 16:17:21.075936 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:21.075548    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv" podUID="d57d2fb9-cddf-48e4-aae4-55075f7e8266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 24 16:17:22.075147 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:22.075106    2553 patch_prober.go:28] interesting pod/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 24 16:17:22.075329 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:22.075166    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv" podUID="d57d2fb9-cddf-48e4-aae4-55075f7e8266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 24 16:17:23.079423 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:23.079390    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:23.079939 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:23.079799    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:23.080529 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:23.080508    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:44.290547 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:44.290504    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"]
Jul 24 16:17:44.291431 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:44.291374    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv" podUID="d57d2fb9-cddf-48e4-aae4-55075f7e8266" containerName="istio-proxy" containerID="cri-o://fc55969b8ed7faccef10640fb3430f42ddf1c4bae0b85c6dc9aad035f3b5a34e" gracePeriod=30
Jul 24 16:17:49.616961 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.616933    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:49.736637 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.736597    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-podinfo\") pod \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") "
Jul 24 16:17:49.736838 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.736654    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdshd\" (UniqueName: \"kubernetes.io/projected/d57d2fb9-cddf-48e4-aae4-55075f7e8266-kube-api-access-gdshd\") pod \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") "
Jul 24 16:17:49.736838 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.736679    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-envoy\") pod \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") "
Jul 24 16:17:49.736838 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.736734    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-token\") pod \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") "
Jul 24 16:17:49.736838 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.736773    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-data\") pod \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") "
Jul 24 16:17:49.736838 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.736821    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-workload-certs\") pod \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") "
Jul 24 16:17:49.737116 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.736875    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-workload-socket\") pod \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") "
Jul 24 16:17:49.737116 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.736908    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-credential-socket\") pod \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") "
Jul 24 16:17:49.737116 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.736939    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istiod-ca-cert\") pod \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\" (UID: \"d57d2fb9-cddf-48e4-aae4-55075f7e8266\") "
Jul 24 16:17:49.737303 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.737272    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d57d2fb9-cddf-48e4-aae4-55075f7e8266" (UID: "d57d2fb9-cddf-48e4-aae4-55075f7e8266"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:17:49.737505 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.737483    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d57d2fb9-cddf-48e4-aae4-55075f7e8266" (UID: "d57d2fb9-cddf-48e4-aae4-55075f7e8266"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:17:49.737708 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.737534    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d57d2fb9-cddf-48e4-aae4-55075f7e8266" (UID: "d57d2fb9-cddf-48e4-aae4-55075f7e8266"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:17:49.737811 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.737791    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d57d2fb9-cddf-48e4-aae4-55075f7e8266" (UID: "d57d2fb9-cddf-48e4-aae4-55075f7e8266"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:17:49.738059 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.738027    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-data" (OuterVolumeSpecName: "istio-data") pod "d57d2fb9-cddf-48e4-aae4-55075f7e8266" (UID: "d57d2fb9-cddf-48e4-aae4-55075f7e8266"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:17:49.739251 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.739219    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-token" (OuterVolumeSpecName: "istio-token") pod "d57d2fb9-cddf-48e4-aae4-55075f7e8266" (UID: "d57d2fb9-cddf-48e4-aae4-55075f7e8266"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:17:49.739350 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.739295    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d57d2fb9-cddf-48e4-aae4-55075f7e8266" (UID: "d57d2fb9-cddf-48e4-aae4-55075f7e8266"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:17:49.739411 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.739360    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d57d2fb9-cddf-48e4-aae4-55075f7e8266-kube-api-access-gdshd" (OuterVolumeSpecName: "kube-api-access-gdshd") pod "d57d2fb9-cddf-48e4-aae4-55075f7e8266" (UID: "d57d2fb9-cddf-48e4-aae4-55075f7e8266"). InnerVolumeSpecName "kube-api-access-gdshd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:17:49.739536 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.739509    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d57d2fb9-cddf-48e4-aae4-55075f7e8266" (UID: "d57d2fb9-cddf-48e4-aae4-55075f7e8266"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:17:49.838514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.838476    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:49.838514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.838511    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:49.838514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.838521    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:49.838787 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.838530    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:49.838787 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.838538    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdshd\" (UniqueName: \"kubernetes.io/projected/d57d2fb9-cddf-48e4-aae4-55075f7e8266-kube-api-access-gdshd\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:49.838787 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.838547    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:49.838787 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.838555    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:49.838787 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.838562    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:49.838787 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:49.838569    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d57d2fb9-cddf-48e4-aae4-55075f7e8266-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:17:50.116575 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:50.116537    2553 generic.go:356] "Generic (PLEG): container finished" podID="d57d2fb9-cddf-48e4-aae4-55075f7e8266" containerID="fc55969b8ed7faccef10640fb3430f42ddf1c4bae0b85c6dc9aad035f3b5a34e" exitCode=0
Jul 24 16:17:50.116780 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:50.116606    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"
Jul 24 16:17:50.116780 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:50.116632    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv" event={"ID":"d57d2fb9-cddf-48e4-aae4-55075f7e8266","Type":"ContainerDied","Data":"fc55969b8ed7faccef10640fb3430f42ddf1c4bae0b85c6dc9aad035f3b5a34e"}
Jul 24 16:17:50.116780 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:50.116717    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv" event={"ID":"d57d2fb9-cddf-48e4-aae4-55075f7e8266","Type":"ContainerDied","Data":"40679edf801dbb62714d7ad6c8df68ec997bf6e43ea6e16262dfc6c635814e1e"}
Jul 24 16:17:50.116780 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:50.116743    2553 scope.go:117] "RemoveContainer" containerID="fc55969b8ed7faccef10640fb3430f42ddf1c4bae0b85c6dc9aad035f3b5a34e"
Jul 24 16:17:50.126458 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:50.126436    2553 scope.go:117] "RemoveContainer" containerID="f0f9de31922aea7df0a131e10ae67813a29f61390793b9cb2dad6849b68bfb58"
Jul 24 16:17:50.141687 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:50.141655    2553 scope.go:117] "RemoveContainer" containerID="fc55969b8ed7faccef10640fb3430f42ddf1c4bae0b85c6dc9aad035f3b5a34e"
Jul 24 16:17:50.142075 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:17:50.142039    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc55969b8ed7faccef10640fb3430f42ddf1c4bae0b85c6dc9aad035f3b5a34e\": container with ID starting with fc55969b8ed7faccef10640fb3430f42ddf1c4bae0b85c6dc9aad035f3b5a34e not found: ID does not exist" containerID="fc55969b8ed7faccef10640fb3430f42ddf1c4bae0b85c6dc9aad035f3b5a34e"
Jul 24 16:17:50.142164 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:50.142097    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc55969b8ed7faccef10640fb3430f42ddf1c4bae0b85c6dc9aad035f3b5a34e"} err="failed to get container status \"fc55969b8ed7faccef10640fb3430f42ddf1c4bae0b85c6dc9aad035f3b5a34e\": rpc error: code = NotFound desc = could not find container \"fc55969b8ed7faccef10640fb3430f42ddf1c4bae0b85c6dc9aad035f3b5a34e\": container with ID starting with fc55969b8ed7faccef10640fb3430f42ddf1c4bae0b85c6dc9aad035f3b5a34e not found: ID does not exist"
Jul 24 16:17:50.142164 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:50.142132    2553 scope.go:117] "RemoveContainer" containerID="f0f9de31922aea7df0a131e10ae67813a29f61390793b9cb2dad6849b68bfb58"
Jul 24 16:17:50.142494 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:17:50.142454    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0f9de31922aea7df0a131e10ae67813a29f61390793b9cb2dad6849b68bfb58\": container with ID starting with f0f9de31922aea7df0a131e10ae67813a29f61390793b9cb2dad6849b68bfb58 not found: ID does not exist" containerID="f0f9de31922aea7df0a131e10ae67813a29f61390793b9cb2dad6849b68bfb58"
Jul 24 16:17:50.142620 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:50.142508    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0f9de31922aea7df0a131e10ae67813a29f61390793b9cb2dad6849b68bfb58"} err="failed to get container status \"f0f9de31922aea7df0a131e10ae67813a29f61390793b9cb2dad6849b68bfb58\": rpc error: code = NotFound desc = could not find container \"f0f9de31922aea7df0a131e10ae67813a29f61390793b9cb2dad6849b68bfb58\": container with ID starting with f0f9de31922aea7df0a131e10ae67813a29f61390793b9cb2dad6849b68bfb58 not found: ID does not exist"
Jul 24 16:17:50.146475 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:50.146450    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"]
Jul 24 16:17:50.156176 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:50.156149    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-8426fff8-openshift-default-bc4947b68-4rbwv"]
Jul 24 16:17:50.475457 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:17:50.475369    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d57d2fb9-cddf-48e4-aae4-55075f7e8266" path="/var/lib/kubelet/pods/d57d2fb9-cddf-48e4-aae4-55075f7e8266/volumes"
Jul 24 16:19:21.305743 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.304974    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"]
Jul 24 16:19:21.308514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.306499    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57d2fb9-cddf-48e4-aae4-55075f7e8266" containerName="istio-proxy"
Jul 24 16:19:21.308514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.306524    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57d2fb9-cddf-48e4-aae4-55075f7e8266" containerName="istio-proxy"
Jul 24 16:19:21.308514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.306556    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="868b8eaa-8bce-478f-9493-39d1b966b5eb" containerName="istio-proxy"
Jul 24 16:19:21.308514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.306566    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="868b8eaa-8bce-478f-9493-39d1b966b5eb" containerName="istio-proxy"
Jul 24 16:19:21.308514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.306600    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57d2fb9-cddf-48e4-aae4-55075f7e8266" containerName="istio-proxy"
Jul 24 16:19:21.308514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.306610    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57d2fb9-cddf-48e4-aae4-55075f7e8266" containerName="istio-proxy"
Jul 24 16:19:21.308514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.306809    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57d2fb9-cddf-48e4-aae4-55075f7e8266" containerName="istio-proxy"
Jul 24 16:19:21.308514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.306829    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="868b8eaa-8bce-478f-9493-39d1b966b5eb" containerName="istio-proxy"
Jul 24 16:19:21.308514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.306843    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="868b8eaa-8bce-478f-9493-39d1b966b5eb" containerName="istio-proxy"
Jul 24 16:19:21.308514 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.306858    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="533dfdf6-ac6d-4af4-a9f2-67b79a5db62d" containerName="istio-proxy"
Jul 24 16:19:21.310860 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.310806    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.313827 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.313806    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e1fef210-openshift-default-dockercfg-npbvl\""
Jul 24 16:19:21.331013 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.330983    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"]
Jul 24 16:19:21.377419 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.377377    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-workload-socket\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.377658 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.377430    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-workload-certs\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.377658 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.377523    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-data\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.377658 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.377558    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-podinfo\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.377658 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.377621    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-envoy\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.377658 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.377645    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-credential-socket\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.377932 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.377675    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istiod-ca-cert\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.377932 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.377740    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-token\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.377932 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.377822    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lp28\" (UniqueName: \"kubernetes.io/projected/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-kube-api-access-5lp28\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.478721 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.478686    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-envoy\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.478721 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.478724    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-credential-socket\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.479001 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.478748    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istiod-ca-cert\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.479001 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.478783    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-token\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.479001 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.478850    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lp28\" (UniqueName: \"kubernetes.io/projected/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-kube-api-access-5lp28\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.479001 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.478884    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-workload-socket\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.479001 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.478928    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-workload-certs\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.479001 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.478966    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-data\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.479001 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.478991    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-podinfo\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.479405 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.479149    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-credential-socket\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.479494 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.479468    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-workload-certs\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.479572 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.479498    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-data\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.479572 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.479561    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istiod-ca-cert\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.479711 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.479568    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-workload-socket\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.481870 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.481843    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-envoy\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.482000 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.481906    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-podinfo\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.487637 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.487616    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-token\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.488223 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.488204    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lp28\" (UniqueName: \"kubernetes.io/projected/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-kube-api-access-5lp28\") pod \"e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") " pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.621607 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.621510    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:21.770367 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.770340    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"]
Jul 24 16:19:21.772177 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:19:21.772144    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89108b1_43a7_41ba_93b9_3d7fcdb14c66.slice/crio-1782aa94c061f6fb9c2529f8a366081d4d0be7d1047c1d9cea781f1d7097f8cb WatchSource:0}: Error finding container 1782aa94c061f6fb9c2529f8a366081d4d0be7d1047c1d9cea781f1d7097f8cb: Status 404 returned error can't find the container with id 1782aa94c061f6fb9c2529f8a366081d4d0be7d1047c1d9cea781f1d7097f8cb
Jul 24 16:19:21.774169 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.774134    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:19:21.774275 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.774202    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:19:21.774275 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:21.774235    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:19:22.574018 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:22.573979    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc" event={"ID":"f89108b1-43a7-41ba-93b9-3d7fcdb14c66","Type":"ContainerStarted","Data":"fc4bda4b46ff80b3af913de24ad7b5139e39e7d981f12cdf6e13d9ad1ca438c2"}
Jul 24 16:19:22.574422 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:22.574036    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc" event={"ID":"f89108b1-43a7-41ba-93b9-3d7fcdb14c66","Type":"ContainerStarted","Data":"1782aa94c061f6fb9c2529f8a366081d4d0be7d1047c1d9cea781f1d7097f8cb"}
Jul 24 16:19:22.599136 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:22.599086    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc" podStartSLOduration=1.59906898 podStartE2EDuration="1.59906898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:19:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:19:22.597654778 +0000 UTC m=+1916.660103966" watchObservedRunningTime="2026-07-24 16:19:22.59906898 +0000 UTC m=+1916.661518166"
Jul 24 16:19:22.622262 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:22.622222    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:22.627187 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:22.627156    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:23.579706 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:23.579676    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:23.580652 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:23.580631    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:38.770412 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:38.769718    2553 patch_prober.go:28] interesting pod/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:41232->10.134.0.52:15021: read: connection reset by peer" start-of-body=
Jul 24 16:19:38.770412 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:38.769805    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc" podUID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:41232->10.134.0.52:15021: read: connection reset by peer"
Jul 24 16:19:39.671885 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:39.671853    2553 generic.go:356] "Generic (PLEG): container finished" podID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerID="fc4bda4b46ff80b3af913de24ad7b5139e39e7d981f12cdf6e13d9ad1ca438c2" exitCode=0
Jul 24 16:19:39.672058 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:39.671920    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc" event={"ID":"f89108b1-43a7-41ba-93b9-3d7fcdb14c66","Type":"ContainerDied","Data":"fc4bda4b46ff80b3af913de24ad7b5139e39e7d981f12cdf6e13d9ad1ca438c2"}
Jul 24 16:19:39.672336 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:39.672320    2553 scope.go:117] "RemoveContainer" containerID="fc4bda4b46ff80b3af913de24ad7b5139e39e7d981f12cdf6e13d9ad1ca438c2"
Jul 24 16:19:39.673338 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:39.673312    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:19:39.673395 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:39.673380    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:19:39.673430 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:39.673414    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:19:40.678266 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:40.678232    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc" event={"ID":"f89108b1-43a7-41ba-93b9-3d7fcdb14c66","Type":"ContainerStarted","Data":"7e6fe61c1c8fe18e9a71863e885c9fac45cff8ad0bbcc1ab49c91fa108cbc57d"}
Jul 24 16:19:41.622480 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:41.622437    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:41.622727 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:41.622702    2553 patch_prober.go:28] interesting pod/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 24 16:19:41.622788 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:41.622757    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc" podUID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 24 16:19:42.622749 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:42.622704    2553 patch_prober.go:28] interesting pod/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 24 16:19:42.623212 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:42.622767    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc" podUID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 24 16:19:43.622067 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:43.622032    2553 patch_prober.go:28] interesting pod/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 24 16:19:43.622277 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:43.622094    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc" podUID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 24 16:19:44.622493 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:44.622453    2553 patch_prober.go:28] interesting pod/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 24 16:19:44.622917 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:44.622512    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc" podUID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 24 16:19:45.626521 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:45.626485    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:45.626920 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:45.626747    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:45.627393 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:45.627372    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:19:57.748252 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:57.748218    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"]
Jul 24 16:19:57.748834 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:19:57.748488    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc" podUID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerName="istio-proxy" containerID="cri-o://7e6fe61c1c8fe18e9a71863e885c9fac45cff8ad0bbcc1ab49c91fa108cbc57d" gracePeriod=30
Jul 24 16:20:00.629316 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:00.629273    2553 patch_prober.go:28] interesting pod/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 16:20:00.629792 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:00.629360    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc" podUID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 16:20:03.003870 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.003842    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:20:03.181230 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181127    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-envoy\") pod \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") "
Jul 24 16:20:03.181230 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181181    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-workload-certs\") pod \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") "
Jul 24 16:20:03.181230 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181220    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-credential-socket\") pod \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") "
Jul 24 16:20:03.181532 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181276    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-workload-socket\") pod \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") "
Jul 24 16:20:03.181532 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181305    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istiod-ca-cert\") pod \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") "
Jul 24 16:20:03.181532 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181332    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-data\") pod \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") "
Jul 24 16:20:03.181532 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181349    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-podinfo\") pod \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") "
Jul 24 16:20:03.181532 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181377    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-token\") pod \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") "
Jul 24 16:20:03.181532 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181479    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f89108b1-43a7-41ba-93b9-3d7fcdb14c66" (UID: "f89108b1-43a7-41ba-93b9-3d7fcdb14c66"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:20:03.181532 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181493    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f89108b1-43a7-41ba-93b9-3d7fcdb14c66" (UID: "f89108b1-43a7-41ba-93b9-3d7fcdb14c66"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:20:03.181930 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181536    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lp28\" (UniqueName: \"kubernetes.io/projected/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-kube-api-access-5lp28\") pod \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\" (UID: \"f89108b1-43a7-41ba-93b9-3d7fcdb14c66\") "
Jul 24 16:20:03.181930 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181783    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f89108b1-43a7-41ba-93b9-3d7fcdb14c66" (UID: "f89108b1-43a7-41ba-93b9-3d7fcdb14c66"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:20:03.181930 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181914    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:20:03.181930 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181922    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f89108b1-43a7-41ba-93b9-3d7fcdb14c66" (UID: "f89108b1-43a7-41ba-93b9-3d7fcdb14c66"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:20:03.182135 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181933    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:20:03.182135 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.181966    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:20:03.182466 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.182438    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-data" (OuterVolumeSpecName: "istio-data") pod "f89108b1-43a7-41ba-93b9-3d7fcdb14c66" (UID: "f89108b1-43a7-41ba-93b9-3d7fcdb14c66"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:20:03.183561 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.183519    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f89108b1-43a7-41ba-93b9-3d7fcdb14c66" (UID: "f89108b1-43a7-41ba-93b9-3d7fcdb14c66"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:20:03.183728 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.183577    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f89108b1-43a7-41ba-93b9-3d7fcdb14c66" (UID: "f89108b1-43a7-41ba-93b9-3d7fcdb14c66"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:20:03.183728 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.183659    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-token" (OuterVolumeSpecName: "istio-token") pod "f89108b1-43a7-41ba-93b9-3d7fcdb14c66" (UID: "f89108b1-43a7-41ba-93b9-3d7fcdb14c66"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:20:03.183817 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.183733    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-kube-api-access-5lp28" (OuterVolumeSpecName: "kube-api-access-5lp28") pod "f89108b1-43a7-41ba-93b9-3d7fcdb14c66" (UID: "f89108b1-43a7-41ba-93b9-3d7fcdb14c66"). InnerVolumeSpecName "kube-api-access-5lp28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:20:03.282742 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.282700    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:20:03.282742 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.282733    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:20:03.282742 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.282746    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:20:03.282983 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.282759    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lp28\" (UniqueName: \"kubernetes.io/projected/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-kube-api-access-5lp28\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:20:03.282983 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.282773    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:20:03.282983 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.282785    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89108b1-43a7-41ba-93b9-3d7fcdb14c66-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:20:03.794789 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.794749    2553 generic.go:356] "Generic (PLEG): container finished" podID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerID="7e6fe61c1c8fe18e9a71863e885c9fac45cff8ad0bbcc1ab49c91fa108cbc57d" exitCode=0
Jul 24 16:20:03.794966 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.794803    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"
Jul 24 16:20:03.794966 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.794838    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc" event={"ID":"f89108b1-43a7-41ba-93b9-3d7fcdb14c66","Type":"ContainerDied","Data":"7e6fe61c1c8fe18e9a71863e885c9fac45cff8ad0bbcc1ab49c91fa108cbc57d"}
Jul 24 16:20:03.794966 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.794900    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc" event={"ID":"f89108b1-43a7-41ba-93b9-3d7fcdb14c66","Type":"ContainerDied","Data":"1782aa94c061f6fb9c2529f8a366081d4d0be7d1047c1d9cea781f1d7097f8cb"}
Jul 24 16:20:03.794966 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.794923    2553 scope.go:117] "RemoveContainer" containerID="7e6fe61c1c8fe18e9a71863e885c9fac45cff8ad0bbcc1ab49c91fa108cbc57d"
Jul 24 16:20:03.804621 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.804579    2553 scope.go:117] "RemoveContainer" containerID="fc4bda4b46ff80b3af913de24ad7b5139e39e7d981f12cdf6e13d9ad1ca438c2"
Jul 24 16:20:03.813121 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.813099    2553 scope.go:117] "RemoveContainer" containerID="7e6fe61c1c8fe18e9a71863e885c9fac45cff8ad0bbcc1ab49c91fa108cbc57d"
Jul 24 16:20:03.813409 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:20:03.813387    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e6fe61c1c8fe18e9a71863e885c9fac45cff8ad0bbcc1ab49c91fa108cbc57d\": container with ID starting with 7e6fe61c1c8fe18e9a71863e885c9fac45cff8ad0bbcc1ab49c91fa108cbc57d not found: ID does not exist" containerID="7e6fe61c1c8fe18e9a71863e885c9fac45cff8ad0bbcc1ab49c91fa108cbc57d"
Jul 24 16:20:03.813491 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.813418    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e6fe61c1c8fe18e9a71863e885c9fac45cff8ad0bbcc1ab49c91fa108cbc57d"} err="failed to get container status \"7e6fe61c1c8fe18e9a71863e885c9fac45cff8ad0bbcc1ab49c91fa108cbc57d\": rpc error: code = NotFound desc = could not find container \"7e6fe61c1c8fe18e9a71863e885c9fac45cff8ad0bbcc1ab49c91fa108cbc57d\": container with ID starting with 7e6fe61c1c8fe18e9a71863e885c9fac45cff8ad0bbcc1ab49c91fa108cbc57d not found: ID does not exist"
Jul 24 16:20:03.813491 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.813438    2553 scope.go:117] "RemoveContainer" containerID="fc4bda4b46ff80b3af913de24ad7b5139e39e7d981f12cdf6e13d9ad1ca438c2"
Jul 24 16:20:03.813740 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:20:03.813721    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc4bda4b46ff80b3af913de24ad7b5139e39e7d981f12cdf6e13d9ad1ca438c2\": container with ID starting with fc4bda4b46ff80b3af913de24ad7b5139e39e7d981f12cdf6e13d9ad1ca438c2 not found: ID does not exist" containerID="fc4bda4b46ff80b3af913de24ad7b5139e39e7d981f12cdf6e13d9ad1ca438c2"
Jul 24 16:20:03.813779 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.813747    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc4bda4b46ff80b3af913de24ad7b5139e39e7d981f12cdf6e13d9ad1ca438c2"} err="failed to get container status \"fc4bda4b46ff80b3af913de24ad7b5139e39e7d981f12cdf6e13d9ad1ca438c2\": rpc error: code = NotFound desc = could not find container \"fc4bda4b46ff80b3af913de24ad7b5139e39e7d981f12cdf6e13d9ad1ca438c2\": container with ID starting with fc4bda4b46ff80b3af913de24ad7b5139e39e7d981f12cdf6e13d9ad1ca438c2 not found: ID does not exist"
Jul 24 16:20:03.818120 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.818092    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"]
Jul 24 16:20:03.821087 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:03.821061    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e1fef210-openshift-default-75bff7f74d-m5vrc"]
Jul 24 16:20:04.474889 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:04.474854    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" path="/var/lib/kubelet/pods/f89108b1-43a7-41ba-93b9-3d7fcdb14c66/volumes"
Jul 24 16:20:17.195181 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.195144    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"]
Jul 24 16:20:17.195611 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.195502    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerName="istio-proxy"
Jul 24 16:20:17.195611 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.195513    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerName="istio-proxy"
Jul 24 16:20:17.195611 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.195526    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="868b8eaa-8bce-478f-9493-39d1b966b5eb" containerName="istio-proxy"
Jul 24 16:20:17.195611 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.195531    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="868b8eaa-8bce-478f-9493-39d1b966b5eb" containerName="istio-proxy"
Jul 24 16:20:17.195611 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.195537    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerName="istio-proxy"
Jul 24 16:20:17.195611 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.195543    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerName="istio-proxy"
Jul 24 16:20:17.195819 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.195632    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerName="istio-proxy"
Jul 24 16:20:17.195819 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.195642    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57d2fb9-cddf-48e4-aae4-55075f7e8266" containerName="istio-proxy"
Jul 24 16:20:17.200036 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.200018    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.203599 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.203558    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b13121e3-openshift-default-dockercfg-h2flg\""
Jul 24 16:20:17.251422 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.251387    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"]
Jul 24 16:20:17.311529 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.311492    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-data\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.311529 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.311530    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istiod-ca-cert\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.311785 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.311561    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2qdk\" (UniqueName: \"kubernetes.io/projected/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-kube-api-access-w2qdk\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.311785 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.311663    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-envoy\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.311785 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.311709    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-workload-socket\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.311785 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.311779    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-workload-certs\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.312000 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.311801    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-credential-socket\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.312000 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.311818    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-token\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.312000 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.311843    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-podinfo\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.412528 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.412488    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-workload-socket\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.412757 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.412581    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-workload-certs\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.412757 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.412650    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-credential-socket\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.412757 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.412673    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-token\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.412757 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.412709    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-podinfo\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.412757 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.412750    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-data\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.413044 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.412779    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istiod-ca-cert\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.413044 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.412807    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qdk\" (UniqueName: \"kubernetes.io/projected/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-kube-api-access-w2qdk\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.413044 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.412840    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-envoy\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.413044 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.412958    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-workload-certs\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.413044 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.413008    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-workload-socket\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.413324 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.413043    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-credential-socket\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.413324 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.413257    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-data\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.413580 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.413559    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istiod-ca-cert\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.415161 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.415139    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-envoy\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.415252 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.415213    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-podinfo\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.424778 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.424754    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-token\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.425836 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.425812    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2qdk\" (UniqueName: \"kubernetes.io/projected/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-kube-api-access-w2qdk\") pod \"e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") " pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.511048 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.511016    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:17.656349 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.656320    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"]
Jul 24 16:20:17.659692 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:20:17.659653    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd54a615_04e4_48d4_92e2_0ed6b5eb27dd.slice/crio-a2babef33a0af4fcf7566201e845f08a76a20d4900ba944d9d1268fd5599f131 WatchSource:0}: Error finding container a2babef33a0af4fcf7566201e845f08a76a20d4900ba944d9d1268fd5599f131: Status 404 returned error can't find the container with id a2babef33a0af4fcf7566201e845f08a76a20d4900ba944d9d1268fd5599f131
Jul 24 16:20:17.661840 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.661811    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:20:17.661918 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.661875    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:20:17.661918 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.661904    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:20:17.863032 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.862948    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn" event={"ID":"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd","Type":"ContainerStarted","Data":"9d1e5378081306f2153c3d3afe16ee066e859b1f89b812a3f35b48c5c8f8d3a0"}
Jul 24 16:20:17.863285 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.863257    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn" event={"ID":"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd","Type":"ContainerStarted","Data":"a2babef33a0af4fcf7566201e845f08a76a20d4900ba944d9d1268fd5599f131"}
Jul 24 16:20:17.885413 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:17.885354    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn" podStartSLOduration=0.885333915 podStartE2EDuration="885.333915ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:20:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:20:17.883366689 +0000 UTC m=+1971.945815878" watchObservedRunningTime="2026-07-24 16:20:17.885333915 +0000 UTC m=+1971.947783102"
Jul 24 16:20:18.511963 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:18.511924    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:18.516848 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:18.516819    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:18.868801 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:18.868705    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:18.869676 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:18.869658    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:20.613160 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:20.613118    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"]
Jul 24 16:20:20.613779 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:20.613759    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f89108b1-43a7-41ba-93b9-3d7fcdb14c66" containerName="istio-proxy"
Jul 24 16:20:20.617071 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:20.617049    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"
Jul 24 16:20:20.620791 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:20.620768    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-b13121e3\""
Jul 24 16:20:20.622091 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:20.622073    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-b13121e3-dockercfg-p79jd\""
Jul 24 16:20:20.628833 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:20.628808    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"]
Jul 24 16:20:20.742407 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:20.742361    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k429d\" (UniqueName: \"kubernetes.io/projected/7a6afdd7-01d9-4c8b-a08f-edd41a1d539f-kube-api-access-k429d\") pod \"payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8\" (UID: \"7a6afdd7-01d9-4c8b-a08f-edd41a1d539f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"
Jul 24 16:20:20.742637 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:20.742541    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a6afdd7-01d9-4c8b-a08f-edd41a1d539f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8\" (UID: \"7a6afdd7-01d9-4c8b-a08f-edd41a1d539f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"
Jul 24 16:20:20.843418 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:20.843376    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k429d\" (UniqueName: \"kubernetes.io/projected/7a6afdd7-01d9-4c8b-a08f-edd41a1d539f-kube-api-access-k429d\") pod \"payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8\" (UID: \"7a6afdd7-01d9-4c8b-a08f-edd41a1d539f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"
Jul 24 16:20:20.843628 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:20.843501    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a6afdd7-01d9-4c8b-a08f-edd41a1d539f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8\" (UID: \"7a6afdd7-01d9-4c8b-a08f-edd41a1d539f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"
Jul 24 16:20:20.844392 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:20.844370    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a6afdd7-01d9-4c8b-a08f-edd41a1d539f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8\" (UID: \"7a6afdd7-01d9-4c8b-a08f-edd41a1d539f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"
Jul 24 16:20:20.852828 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:20.852797    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k429d\" (UniqueName: \"kubernetes.io/projected/7a6afdd7-01d9-4c8b-a08f-edd41a1d539f-kube-api-access-k429d\") pod \"payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8\" (UID: \"7a6afdd7-01d9-4c8b-a08f-edd41a1d539f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"
Jul 24 16:20:20.928772 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:20.928682    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"
Jul 24 16:20:21.073192 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:21.073159    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"]
Jul 24 16:20:21.075039 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:20:21.075001    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a6afdd7_01d9_4c8b_a08f_edd41a1d539f.slice/crio-12d7903f4bcfd8d093fe9c9bd16e115e2835569d0fea663571ee13566885e503 WatchSource:0}: Error finding container 12d7903f4bcfd8d093fe9c9bd16e115e2835569d0fea663571ee13566885e503: Status 404 returned error can't find the container with id 12d7903f4bcfd8d093fe9c9bd16e115e2835569d0fea663571ee13566885e503
Jul 24 16:20:21.887328 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:21.887289    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8" event={"ID":"7a6afdd7-01d9-4c8b-a08f-edd41a1d539f","Type":"ContainerStarted","Data":"ad92b3fbd46f0e430d47652fa3547cee13f8c77178ecb165fb2a8c371e70f5a4"}
Jul 24 16:20:21.887849 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:21.887348    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8" event={"ID":"7a6afdd7-01d9-4c8b-a08f-edd41a1d539f","Type":"ContainerStarted","Data":"12d7903f4bcfd8d093fe9c9bd16e115e2835569d0fea663571ee13566885e503"}
Jul 24 16:20:21.887849 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:21.887424    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"
Jul 24 16:20:21.904441 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:21.904388    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8" podStartSLOduration=1.904373063 podStartE2EDuration="1.904373063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:20:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:20:21.902962627 +0000 UTC m=+1975.965411835" watchObservedRunningTime="2026-07-24 16:20:21.904373063 +0000 UTC m=+1975.966822250"
Jul 24 16:20:32.894760 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:32.894727    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"
Jul 24 16:20:33.870007 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:33.869972    2553 patch_prober.go:28] interesting pod/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 24 16:20:33.870269 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:33.870031    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn" podUID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 24 16:20:33.948580 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:33.948543    2553 generic.go:356] "Generic (PLEG): container finished" podID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" containerID="9d1e5378081306f2153c3d3afe16ee066e859b1f89b812a3f35b48c5c8f8d3a0" exitCode=0
Jul 24 16:20:33.948974 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:33.948615    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn" event={"ID":"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd","Type":"ContainerDied","Data":"9d1e5378081306f2153c3d3afe16ee066e859b1f89b812a3f35b48c5c8f8d3a0"}
Jul 24 16:20:33.949020 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:33.949005    2553 scope.go:117] "RemoveContainer" containerID="9d1e5378081306f2153c3d3afe16ee066e859b1f89b812a3f35b48c5c8f8d3a0"
Jul 24 16:20:33.950164 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:33.950134    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:20:33.950232 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:33.950220    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:20:33.950268 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:33.950257    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:20:34.958246 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:34.958198    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn" event={"ID":"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd","Type":"ContainerStarted","Data":"f2df264b051181dcd72bce92527244d65a56227e9c8f6289bd12f9307e85ed07"}
Jul 24 16:20:35.511865 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:35.511824    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:35.512101 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:35.512077    2553 patch_prober.go:28] interesting pod/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 24 16:20:35.512177 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:35.512133    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn" podUID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 24 16:20:36.512210 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:36.512166    2553 patch_prober.go:28] interesting pod/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 24 16:20:36.512640 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:36.512228    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn" podUID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 24 16:20:37.512339 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:37.512300    2553 patch_prober.go:28] interesting pod/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 24 16:20:37.512769 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:37.512354    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn" podUID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 24 16:20:38.511844 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:38.511802    2553 patch_prober.go:28] interesting pod/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 24 16:20:38.512025 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:38.511859    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn" podUID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 24 16:20:39.515368 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:39.515334    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:39.515861 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:39.515611    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:39.516245 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:39.516228    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:20:58.600921 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:58.600878    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm"]
Jul 24 16:20:58.603666 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:58.603646    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm"
Jul 24 16:20:58.606453 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:58.606424    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:20:58.606622 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:58.606424    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hchgr\""
Jul 24 16:20:58.612091 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:58.611761    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm"]
Jul 24 16:20:58.707886 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:58.707841    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af1b425-166b-449b-8812-f599d7d2b73c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm\" (UID: \"8af1b425-166b-449b-8812-f599d7d2b73c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm"
Jul 24 16:20:58.809380 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:58.809341    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af1b425-166b-449b-8812-f599d7d2b73c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm\" (UID: \"8af1b425-166b-449b-8812-f599d7d2b73c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm"
Jul 24 16:20:58.809969 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:58.809950    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af1b425-166b-449b-8812-f599d7d2b73c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm\" (UID: \"8af1b425-166b-449b-8812-f599d7d2b73c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm"
Jul 24 16:20:58.915382 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:58.915289    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm"
Jul 24 16:20:59.053911 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:59.053883    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm"]
Jul 24 16:20:59.055888 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:20:59.055866    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af1b425_166b_449b_8812_f599d7d2b73c.slice/crio-699685129c09b094469279132b277c5519c23ccc24ae270c08c3e7825173f107 WatchSource:0}: Error finding container 699685129c09b094469279132b277c5519c23ccc24ae270c08c3e7825173f107: Status 404 returned error can't find the container with id 699685129c09b094469279132b277c5519c23ccc24ae270c08c3e7825173f107
Jul 24 16:20:59.057871 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:59.057852    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:20:59.077701 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:20:59.077665    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm" event={"ID":"8af1b425-166b-449b-8812-f599d7d2b73c","Type":"ContainerStarted","Data":"699685129c09b094469279132b277c5519c23ccc24ae270c08c3e7825173f107"}
Jul 24 16:21:02.098214 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:02.098174    2553 generic.go:356] "Generic (PLEG): container finished" podID="8af1b425-166b-449b-8812-f599d7d2b73c" containerID="3a5d10e6c8bf52d3c2925bb913b22204ba5647bd6c94098c9e087d95ee4c6c1f" exitCode=0
Jul 24 16:21:02.098639 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:02.098252    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm" event={"ID":"8af1b425-166b-449b-8812-f599d7d2b73c","Type":"ContainerDied","Data":"3a5d10e6c8bf52d3c2925bb913b22204ba5647bd6c94098c9e087d95ee4c6c1f"}
Jul 24 16:21:03.238000 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:03.237969    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm"
Jul 24 16:21:03.355772 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:03.355684    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af1b425-166b-449b-8812-f599d7d2b73c-maas-api-service-ca\") pod \"8af1b425-166b-449b-8812-f599d7d2b73c\" (UID: \"8af1b425-166b-449b-8812-f599d7d2b73c\") "
Jul 24 16:21:03.356050 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:03.356026    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8af1b425-166b-449b-8812-f599d7d2b73c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8af1b425-166b-449b-8812-f599d7d2b73c" (UID: "8af1b425-166b-449b-8812-f599d7d2b73c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:21:03.457100 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:03.457061    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af1b425-166b-449b-8812-f599d7d2b73c-maas-api-service-ca\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:21:04.109929 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:04.109900    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm"
Jul 24 16:21:04.109929 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:04.109918    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm" event={"ID":"8af1b425-166b-449b-8812-f599d7d2b73c","Type":"ContainerDied","Data":"699685129c09b094469279132b277c5519c23ccc24ae270c08c3e7825173f107"}
Jul 24 16:21:04.110230 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:04.109968    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="699685129c09b094469279132b277c5519c23ccc24ae270c08c3e7825173f107"
Jul 24 16:21:14.187960 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:14.187921    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"]
Jul 24 16:21:14.188419 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:14.188157    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8" podUID="7a6afdd7-01d9-4c8b-a08f-edd41a1d539f" containerName="payload-pre-processing" containerID="cri-o://ad92b3fbd46f0e430d47652fa3547cee13f8c77178ecb165fb2a8c371e70f5a4" gracePeriod=30
Jul 24 16:21:14.461189 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:14.461161    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"
Jul 24 16:21:14.559832 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:14.559790    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k429d\" (UniqueName: \"kubernetes.io/projected/7a6afdd7-01d9-4c8b-a08f-edd41a1d539f-kube-api-access-k429d\") pod \"7a6afdd7-01d9-4c8b-a08f-edd41a1d539f\" (UID: \"7a6afdd7-01d9-4c8b-a08f-edd41a1d539f\") "
Jul 24 16:21:14.560027 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:14.559897    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a6afdd7-01d9-4c8b-a08f-edd41a1d539f-plugins-config-volume\") pod \"7a6afdd7-01d9-4c8b-a08f-edd41a1d539f\" (UID: \"7a6afdd7-01d9-4c8b-a08f-edd41a1d539f\") "
Jul 24 16:21:14.560272 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:14.560247    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a6afdd7-01d9-4c8b-a08f-edd41a1d539f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a6afdd7-01d9-4c8b-a08f-edd41a1d539f" (UID: "7a6afdd7-01d9-4c8b-a08f-edd41a1d539f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:21:14.561952 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:14.561932    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a6afdd7-01d9-4c8b-a08f-edd41a1d539f-kube-api-access-k429d" (OuterVolumeSpecName: "kube-api-access-k429d") pod "7a6afdd7-01d9-4c8b-a08f-edd41a1d539f" (UID: "7a6afdd7-01d9-4c8b-a08f-edd41a1d539f"). InnerVolumeSpecName "kube-api-access-k429d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:21:14.660754 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:14.660707    2553 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a6afdd7-01d9-4c8b-a08f-edd41a1d539f-plugins-config-volume\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:21:14.660754 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:14.660738    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k429d\" (UniqueName: \"kubernetes.io/projected/7a6afdd7-01d9-4c8b-a08f-edd41a1d539f-kube-api-access-k429d\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:21:15.163447 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:15.163411    2553 generic.go:356] "Generic (PLEG): container finished" podID="7a6afdd7-01d9-4c8b-a08f-edd41a1d539f" containerID="ad92b3fbd46f0e430d47652fa3547cee13f8c77178ecb165fb2a8c371e70f5a4" exitCode=0
Jul 24 16:21:15.163677 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:15.163453    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"
Jul 24 16:21:15.163677 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:15.163497    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8" event={"ID":"7a6afdd7-01d9-4c8b-a08f-edd41a1d539f","Type":"ContainerDied","Data":"ad92b3fbd46f0e430d47652fa3547cee13f8c77178ecb165fb2a8c371e70f5a4"}
Jul 24 16:21:15.163677 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:15.163561    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8" event={"ID":"7a6afdd7-01d9-4c8b-a08f-edd41a1d539f","Type":"ContainerDied","Data":"12d7903f4bcfd8d093fe9c9bd16e115e2835569d0fea663571ee13566885e503"}
Jul 24 16:21:15.163677 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:15.163617    2553 scope.go:117] "RemoveContainer" containerID="ad92b3fbd46f0e430d47652fa3547cee13f8c77178ecb165fb2a8c371e70f5a4"
Jul 24 16:21:15.173110 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:15.173092    2553 scope.go:117] "RemoveContainer" containerID="ad92b3fbd46f0e430d47652fa3547cee13f8c77178ecb165fb2a8c371e70f5a4"
Jul 24 16:21:15.173373 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:21:15.173352    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad92b3fbd46f0e430d47652fa3547cee13f8c77178ecb165fb2a8c371e70f5a4\": container with ID starting with ad92b3fbd46f0e430d47652fa3547cee13f8c77178ecb165fb2a8c371e70f5a4 not found: ID does not exist" containerID="ad92b3fbd46f0e430d47652fa3547cee13f8c77178ecb165fb2a8c371e70f5a4"
Jul 24 16:21:15.173442 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:15.173380    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad92b3fbd46f0e430d47652fa3547cee13f8c77178ecb165fb2a8c371e70f5a4"} err="failed to get container status \"ad92b3fbd46f0e430d47652fa3547cee13f8c77178ecb165fb2a8c371e70f5a4\": rpc error: code = NotFound desc = could not find container \"ad92b3fbd46f0e430d47652fa3547cee13f8c77178ecb165fb2a8c371e70f5a4\": container with ID starting with ad92b3fbd46f0e430d47652fa3547cee13f8c77178ecb165fb2a8c371e70f5a4 not found: ID does not exist"
Jul 24 16:21:15.185761 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:15.185729    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"]
Jul 24 16:21:15.189886 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:15.189859    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b13121e3-7d9f8fb656-lcnq8"]
Jul 24 16:21:16.474663 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:16.474628    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a6afdd7-01d9-4c8b-a08f-edd41a1d539f" path="/var/lib/kubelet/pods/7a6afdd7-01d9-4c8b-a08f-edd41a1d539f/volumes"
Jul 24 16:21:18.683256 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:18.683225    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm"]
Jul 24 16:21:18.685247 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:18.685223    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b13121e3-p8qqm"]
Jul 24 16:21:20.474981 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:21:20.474946    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8af1b425-166b-449b-8812-f599d7d2b73c" path="/var/lib/kubelet/pods/8af1b425-166b-449b-8812-f599d7d2b73c/volumes"
Jul 24 16:22:10.276187 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:10.276099    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"]
Jul 24 16:22:10.276765 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:10.276333    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn" podUID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" containerName="istio-proxy" containerID="cri-o://f2df264b051181dcd72bce92527244d65a56227e9c8f6289bd12f9307e85ed07" gracePeriod=30
Jul 24 16:22:15.457524 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.457339    2553 generic.go:356] "Generic (PLEG): container finished" podID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" containerID="f2df264b051181dcd72bce92527244d65a56227e9c8f6289bd12f9307e85ed07" exitCode=0
Jul 24 16:22:15.457524 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.457400    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn" event={"ID":"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd","Type":"ContainerDied","Data":"f2df264b051181dcd72bce92527244d65a56227e9c8f6289bd12f9307e85ed07"}
Jul 24 16:22:15.457524 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.457453    2553 scope.go:117] "RemoveContainer" containerID="9d1e5378081306f2153c3d3afe16ee066e859b1f89b812a3f35b48c5c8f8d3a0"
Jul 24 16:22:15.547179 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.547105    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:22:15.728491 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.728451    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-envoy\") pod \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") "
Jul 24 16:22:15.728725 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.728527    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2qdk\" (UniqueName: \"kubernetes.io/projected/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-kube-api-access-w2qdk\") pod \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") "
Jul 24 16:22:15.728725 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.728575    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-podinfo\") pod \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") "
Jul 24 16:22:15.728725 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.728691    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-token\") pod \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") "
Jul 24 16:22:15.728915 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.728757    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-workload-socket\") pod \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") "
Jul 24 16:22:15.728915 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.728807    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-credential-socket\") pod \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") "
Jul 24 16:22:15.728915 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.728872    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-data\") pod \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") "
Jul 24 16:22:15.728915 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.728901    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-workload-certs\") pod \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") "
Jul 24 16:22:15.729109 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.728941    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istiod-ca-cert\") pod \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\" (UID: \"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd\") "
Jul 24 16:22:15.729532 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.729489    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" (UID: "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:22:15.729674 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.729617    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" (UID: "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:22:15.729738 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.729703    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" (UID: "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:22:15.730005 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.729959    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" (UID: "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:22:15.730212 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.730193    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-data" (OuterVolumeSpecName: "istio-data") pod "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" (UID: "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:22:15.731120 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.731095    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" (UID: "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:22:15.731270 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.731235    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-kube-api-access-w2qdk" (OuterVolumeSpecName: "kube-api-access-w2qdk") pod "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" (UID: "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd"). InnerVolumeSpecName "kube-api-access-w2qdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:22:15.731361 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.731287    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" (UID: "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:22:15.731447 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.731426    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" (UID: "bd54a615-04e4-48d4-92e2-0ed6b5eb27dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:22:15.830091 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.830007    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:22:15.830091 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.830036    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:22:15.830091 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.830045    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2qdk\" (UniqueName: \"kubernetes.io/projected/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-kube-api-access-w2qdk\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:22:15.830091 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.830055    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:22:15.830091 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.830063    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:22:15.830091 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.830071    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:22:15.830091 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.830079    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:22:15.830091 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.830087    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:22:15.830091 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:15.830096    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:22:16.464403 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:16.464361    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn" event={"ID":"bd54a615-04e4-48d4-92e2-0ed6b5eb27dd","Type":"ContainerDied","Data":"a2babef33a0af4fcf7566201e845f08a76a20d4900ba944d9d1268fd5599f131"}
Jul 24 16:22:16.464929 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:16.464407    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"
Jul 24 16:22:16.464929 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:16.464437    2553 scope.go:117] "RemoveContainer" containerID="f2df264b051181dcd72bce92527244d65a56227e9c8f6289bd12f9307e85ed07"
Jul 24 16:22:16.491058 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:16.491019    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"]
Jul 24 16:22:16.496347 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:16.496311    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b13121e3-openshift-default-d4b8b59cb-tbjrn"]
Jul 24 16:22:18.475327 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:18.475295    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" path="/var/lib/kubelet/pods/bd54a615-04e4-48d4-92e2-0ed6b5eb27dd/volumes"
Jul 24 16:22:26.627024 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:26.626988    2553 scope.go:117] "RemoveContainer" containerID="168f43e1d007c3e0cc9d8720f160a382e2ad25cd20459789b6a86e68da5079ba"
Jul 24 16:22:26.636113 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:22:26.636081    2553 scope.go:117] "RemoveContainer" containerID="9f0869be6d3495d95463d6b530e54ac3738e5091842797fb0e030bd1093cc2cf"
Jul 24 16:23:05.601627 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.601571    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"]
Jul 24 16:23:05.602289 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.601983    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6afdd7-01d9-4c8b-a08f-edd41a1d539f" containerName="payload-pre-processing"
Jul 24 16:23:05.602289 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.601996    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6afdd7-01d9-4c8b-a08f-edd41a1d539f" containerName="payload-pre-processing"
Jul 24 16:23:05.602289 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.602006    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" containerName="istio-proxy"
Jul 24 16:23:05.602289 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.602012    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" containerName="istio-proxy"
Jul 24 16:23:05.602289 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.602022    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" containerName="istio-proxy"
Jul 24 16:23:05.602289 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.602028    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" containerName="istio-proxy"
Jul 24 16:23:05.602289 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.602033    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8af1b425-166b-449b-8812-f599d7d2b73c" containerName="revoke-keys"
Jul 24 16:23:05.602289 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.602039    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8af1b425-166b-449b-8812-f599d7d2b73c" containerName="revoke-keys"
Jul 24 16:23:05.602289 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.602089    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8af1b425-166b-449b-8812-f599d7d2b73c" containerName="revoke-keys"
Jul 24 16:23:05.602289 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.602098    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" containerName="istio-proxy"
Jul 24 16:23:05.602289 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.602105    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a6afdd7-01d9-4c8b-a08f-edd41a1d539f" containerName="payload-pre-processing"
Jul 24 16:23:05.604426 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.604395    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.607281 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.607259    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-e12d61-openshift-default-dockercfg-56p4h\""
Jul 24 16:23:05.619106 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.619062    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"]
Jul 24 16:23:05.690850 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.690811    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4p7c\" (UniqueName: \"kubernetes.io/projected/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-kube-api-access-r4p7c\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.691133 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.691104    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-envoy\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.691264 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.691164    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-token\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.691264 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.691190    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istiod-ca-cert\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.691264 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.691234    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-workload-socket\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.691439 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.691283    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-credential-socket\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.691439 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.691340    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-podinfo\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.691439 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.691388    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-workload-certs\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.691623 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.691493    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-data\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.792183 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.792146    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-workload-certs\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.792393 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.792206    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-data\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.792393 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.792243    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4p7c\" (UniqueName: \"kubernetes.io/projected/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-kube-api-access-r4p7c\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.792393 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.792277    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-envoy\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.792393 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.792317    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-token\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.792393 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.792343    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istiod-ca-cert\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.792393 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.792373    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-workload-socket\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.792764 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.792421    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-credential-socket\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.792764 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.792476    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-podinfo\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.792764 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.792668    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-workload-certs\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.792764 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.792711    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-data\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.793171 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.793117    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-credential-socket\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.793364 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.793335    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istiod-ca-cert\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.793517 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.793497    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-workload-socket\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.794755 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.794738    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-envoy\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.795156 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.795141    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-podinfo\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.801038 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.801017    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-token\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.801352 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.801327    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4p7c\" (UniqueName: \"kubernetes.io/projected/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-kube-api-access-r4p7c\") pod \"e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") " pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:05.916494 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:05.916402    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:06.059332 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:06.059305    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"]
Jul 24 16:23:06.061250 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:23:06.061221    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47657bc_6d76_4ebd_b4fe_b98d67055ebe.slice/crio-e8eb66187b8ea43ae85843428160836d1b99872a527c1d8e0f4bc4bef931031e WatchSource:0}: Error finding container e8eb66187b8ea43ae85843428160836d1b99872a527c1d8e0f4bc4bef931031e: Status 404 returned error can't find the container with id e8eb66187b8ea43ae85843428160836d1b99872a527c1d8e0f4bc4bef931031e
Jul 24 16:23:06.063361 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:06.063318    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:23:06.063441 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:06.063413    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:23:06.063485 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:06.063460    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:23:06.711739 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:06.711699    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g" event={"ID":"a47657bc-6d76-4ebd-b4fe-b98d67055ebe","Type":"ContainerStarted","Data":"bcb08a9d70985abd02b4bd401b99bd1e8a859a6c15448adc50e4f4767f5ba98c"}
Jul 24 16:23:06.712147 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:06.711754    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g" event={"ID":"a47657bc-6d76-4ebd-b4fe-b98d67055ebe","Type":"ContainerStarted","Data":"e8eb66187b8ea43ae85843428160836d1b99872a527c1d8e0f4bc4bef931031e"}
Jul 24 16:23:06.736952 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:06.736896    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g" podStartSLOduration=1.736880575 podStartE2EDuration="1.736880575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:23:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:23:06.733628461 +0000 UTC m=+2140.796077648" watchObservedRunningTime="2026-07-24 16:23:06.736880575 +0000 UTC m=+2140.799329761"
Jul 24 16:23:06.916564 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:06.916525    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:07.922524 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:07.922485    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:08.721564 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:08.721533    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:08.722632 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:08.722597    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:09.458878 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:09.458843    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"]
Jul 24 16:23:09.459474 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:09.459454    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd54a615-04e4-48d4-92e2-0ed6b5eb27dd" containerName="istio-proxy"
Jul 24 16:23:09.461636 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:09.461615    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"
Jul 24 16:23:09.464301 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:09.464273    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-e12d61\""
Jul 24 16:23:09.472861 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:09.472771    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"]
Jul 24 16:23:09.527363 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:09.527329    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdr9b\" (UniqueName: \"kubernetes.io/projected/61fb2d07-ef49-4df6-922c-6682e97227de-kube-api-access-zdr9b\") pod \"payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k\" (UID: \"61fb2d07-ef49-4df6-922c-6682e97227de\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"
Jul 24 16:23:09.527363 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:09.527369    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61fb2d07-ef49-4df6-922c-6682e97227de-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k\" (UID: \"61fb2d07-ef49-4df6-922c-6682e97227de\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"
Jul 24 16:23:09.628658 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:09.628615    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdr9b\" (UniqueName: \"kubernetes.io/projected/61fb2d07-ef49-4df6-922c-6682e97227de-kube-api-access-zdr9b\") pod \"payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k\" (UID: \"61fb2d07-ef49-4df6-922c-6682e97227de\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"
Jul 24 16:23:09.628658 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:09.628663    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61fb2d07-ef49-4df6-922c-6682e97227de-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k\" (UID: \"61fb2d07-ef49-4df6-922c-6682e97227de\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"
Jul 24 16:23:09.629437 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:09.629413    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61fb2d07-ef49-4df6-922c-6682e97227de-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k\" (UID: \"61fb2d07-ef49-4df6-922c-6682e97227de\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"
Jul 24 16:23:09.637651 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:09.637617    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdr9b\" (UniqueName: \"kubernetes.io/projected/61fb2d07-ef49-4df6-922c-6682e97227de-kube-api-access-zdr9b\") pod \"payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k\" (UID: \"61fb2d07-ef49-4df6-922c-6682e97227de\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"
Jul 24 16:23:09.773452 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:09.773409    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"
Jul 24 16:23:09.910801 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:09.910772    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"]
Jul 24 16:23:09.913267 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:23:09.913229    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61fb2d07_ef49_4df6_922c_6682e97227de.slice/crio-0d38eca1c868d09cb179dbc1e1921769ac41a690422e2b94e24bf6ca98d6bea0 WatchSource:0}: Error finding container 0d38eca1c868d09cb179dbc1e1921769ac41a690422e2b94e24bf6ca98d6bea0: Status 404 returned error can't find the container with id 0d38eca1c868d09cb179dbc1e1921769ac41a690422e2b94e24bf6ca98d6bea0
Jul 24 16:23:10.733246 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:10.733204    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k" event={"ID":"61fb2d07-ef49-4df6-922c-6682e97227de","Type":"ContainerStarted","Data":"49c906ba1e477b52e7ef5243003cb04928b79b7ebd704f6891ff090630505902"}
Jul 24 16:23:10.733691 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:10.733263    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k" event={"ID":"61fb2d07-ef49-4df6-922c-6682e97227de","Type":"ContainerStarted","Data":"0d38eca1c868d09cb179dbc1e1921769ac41a690422e2b94e24bf6ca98d6bea0"}
Jul 24 16:23:10.733691 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:10.733420    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"
Jul 24 16:23:10.752360 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:10.752301    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k" podStartSLOduration=1.752283334 podStartE2EDuration="1.752283334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:23:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:23:10.749228574 +0000 UTC m=+2144.811677762" watchObservedRunningTime="2026-07-24 16:23:10.752283334 +0000 UTC m=+2144.814732526"
Jul 24 16:23:13.773777 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.773738    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"]
Jul 24 16:23:13.776897 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.776869    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.779765 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.779743    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-d060b0-openshift-default-dockercfg-n5vgk\""
Jul 24 16:23:13.787993 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.787949    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"]
Jul 24 16:23:13.868226 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.868186    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-workload-certs\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.868496 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.868478    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-data\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.868643 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.868621    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istiod-ca-cert\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.868784 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.868688    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-workload-socket\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.868784 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.868715    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-credential-socket\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.868784 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.868755    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-envoy\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.868981 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.868814    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hz8n\" (UniqueName: \"kubernetes.io/projected/43921f28-ed0e-4d15-b17e-7f7720bab0ef-kube-api-access-5hz8n\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.868981 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.868852    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-podinfo\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.868981 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.868877    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-token\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.970241 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.970201    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-workload-socket\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.970241 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.970246    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-credential-socket\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.970510 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.970278    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-envoy\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.970510 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.970449    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hz8n\" (UniqueName: \"kubernetes.io/projected/43921f28-ed0e-4d15-b17e-7f7720bab0ef-kube-api-access-5hz8n\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.970667 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.970508    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-podinfo\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.970667 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.970542    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-token\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.970667 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.970646    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-workload-socket\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.970826 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.970744    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-credential-socket\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.970826 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.970765    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-workload-certs\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.970911 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.970833    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-data\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.970911 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.970881    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istiod-ca-cert\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.971140 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.971108    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-workload-certs\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.971276 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.971150    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-data\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.971705 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.971681    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istiod-ca-cert\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.972671 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.972651    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-envoy\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.973262 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.973244    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-podinfo\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.978870 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.978847    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-token\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:13.979501 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:13.979481    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hz8n\" (UniqueName: \"kubernetes.io/projected/43921f28-ed0e-4d15-b17e-7f7720bab0ef-kube-api-access-5hz8n\") pod \"e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") " pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:14.088468 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:14.088378    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:14.235713 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:14.235678    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"]
Jul 24 16:23:14.241732 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:14.241684    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:23:14.241846 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:14.241769    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:23:14.241846 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:14.241811    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:23:14.755975 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:14.755936    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8" event={"ID":"43921f28-ed0e-4d15-b17e-7f7720bab0ef","Type":"ContainerStarted","Data":"93a38c4673f0d2af5ae44790bde38cbf25a5b1f31c1818333f767b5c0d4f4d10"}
Jul 24 16:23:14.756160 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:14.755990    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8" event={"ID":"43921f28-ed0e-4d15-b17e-7f7720bab0ef","Type":"ContainerStarted","Data":"e30d8477f4b6c01e46a37e68f7422004270481693fd66e1adc42fde756edf05e"}
Jul 24 16:23:14.774652 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:14.774570    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8" podStartSLOduration=1.774554503 podStartE2EDuration="1.774554503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:23:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:23:14.773940451 +0000 UTC m=+2148.836389658" watchObservedRunningTime="2026-07-24 16:23:14.774554503 +0000 UTC m=+2148.837003690"
Jul 24 16:23:15.088681 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:15.088572    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:15.093466 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:15.093439    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:15.760491 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:15.760458    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:15.761343 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:15.761323    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:21.741844 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:21.741752    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"
Jul 24 16:23:24.763809 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:24.763767    2553 patch_prober.go:28] interesting pod/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 16:23:24.764245 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:24.763838    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g" podUID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 16:23:25.816601 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:25.816550    2553 generic.go:356] "Generic (PLEG): container finished" podID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerID="bcb08a9d70985abd02b4bd401b99bd1e8a859a6c15448adc50e4f4767f5ba98c" exitCode=0
Jul 24 16:23:25.817021 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:25.816624    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g" event={"ID":"a47657bc-6d76-4ebd-b4fe-b98d67055ebe","Type":"ContainerDied","Data":"bcb08a9d70985abd02b4bd401b99bd1e8a859a6c15448adc50e4f4767f5ba98c"}
Jul 24 16:23:25.817065 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:25.817023    2553 scope.go:117] "RemoveContainer" containerID="bcb08a9d70985abd02b4bd401b99bd1e8a859a6c15448adc50e4f4767f5ba98c"
Jul 24 16:23:25.818201 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:25.818173    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:23:25.818265 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:25.818255    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:23:25.818301 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:25.818287    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:23:26.824607 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:26.824544    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g" event={"ID":"a47657bc-6d76-4ebd-b4fe-b98d67055ebe","Type":"ContainerStarted","Data":"e6cf71397736b16ca0ad8f0de1a3ceb4c512694afc7575d859f6ced4abecd525"}
Jul 24 16:23:26.917252 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:26.917210    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:26.917502 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:26.917475    2553 patch_prober.go:28] interesting pod/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 24 16:23:26.917629 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:26.917536    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g" podUID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 24 16:23:27.917278 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:27.917226    2553 patch_prober.go:28] interesting pod/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 24 16:23:27.917717 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:27.917292    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g" podUID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 24 16:23:28.917864 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:28.917827    2553 patch_prober.go:28] interesting pod/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 24 16:23:28.918297 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:28.917885    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g" podUID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 24 16:23:29.917532 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:29.917486    2553 patch_prober.go:28] interesting pod/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 24 16:23:29.917816 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:29.917567    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g" podUID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 24 16:23:30.917090 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:30.917056    2553 patch_prober.go:28] interesting pod/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 24 16:23:30.917492 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:30.917112    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g" podUID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 24 16:23:31.921114 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:31.921074    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:31.921636 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:31.921615    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:31.922349 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:31.922330    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:23:34.872469 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:34.872429    2553 generic.go:356] "Generic (PLEG): container finished" podID="43921f28-ed0e-4d15-b17e-7f7720bab0ef" containerID="93a38c4673f0d2af5ae44790bde38cbf25a5b1f31c1818333f767b5c0d4f4d10" exitCode=0
Jul 24 16:23:34.872469 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:34.872473    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8" event={"ID":"43921f28-ed0e-4d15-b17e-7f7720bab0ef","Type":"ContainerDied","Data":"93a38c4673f0d2af5ae44790bde38cbf25a5b1f31c1818333f767b5c0d4f4d10"}
Jul 24 16:23:34.872957 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:34.872848    2553 scope.go:117] "RemoveContainer" containerID="93a38c4673f0d2af5ae44790bde38cbf25a5b1f31c1818333f767b5c0d4f4d10"
Jul 24 16:23:34.873963 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:34.873931    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:23:34.874064 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:34.874016    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:23:34.874132 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:34.874062    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:23:35.879417 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:35.879380    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8" event={"ID":"43921f28-ed0e-4d15-b17e-7f7720bab0ef","Type":"ContainerStarted","Data":"82d24830a2b426c912ac3bf2ce0a754d0ab23945b059d67b24e898837f72b4f1"}
Jul 24 16:23:36.089513 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:36.089477    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:36.089876 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:36.089851    2553 patch_prober.go:28] interesting pod/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 24 16:23:36.089942 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:36.089903    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8" podUID="43921f28-ed0e-4d15-b17e-7f7720bab0ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 24 16:23:37.089560 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:37.089522    2553 patch_prober.go:28] interesting pod/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 24 16:23:37.090069 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:37.089581    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8" podUID="43921f28-ed0e-4d15-b17e-7f7720bab0ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 24 16:23:38.089788 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:38.089738    2553 patch_prober.go:28] interesting pod/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 24 16:23:38.090207 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:38.089807    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8" podUID="43921f28-ed0e-4d15-b17e-7f7720bab0ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 24 16:23:39.089199 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:39.089152    2553 patch_prober.go:28] interesting pod/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 24 16:23:39.089383 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:39.089216    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8" podUID="43921f28-ed0e-4d15-b17e-7f7720bab0ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 24 16:23:40.092827 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:40.092788    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:40.093315 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:40.093188    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:23:40.093926 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:23:40.093906    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:24:27.398644 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.398608    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"]
Jul 24 16:24:27.401286 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.401267    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.404109 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.404086    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d060b0\"/\"openshift-service-ca.crt\""
Jul 24 16:24:27.404236 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.404159    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d060b0\"/\"kube-root-ca.crt\""
Jul 24 16:24:27.405416 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.405397    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d060b0\"/\"default-dockercfg-zrmds\""
Jul 24 16:24:27.405519 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.405401    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d060b0\"/\"test-model-d060b0-kserve-self-signed-certs\""
Jul 24 16:24:27.413897 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.413874    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"]
Jul 24 16:24:27.588142 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.588112    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-tmp-dir\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.588325 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.588165    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-model-cache\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.588325 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.588213    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-dshm\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.588325 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.588288    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-home\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.588464 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.588389    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjbmt\" (UniqueName: \"kubernetes.io/projected/8824a445-cd43-4ed6-a561-647fa10f3218-kube-api-access-bjbmt\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.588509 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.588477    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8824a445-cd43-4ed6-a561-647fa10f3218-tls-certs\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.689573 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.689469    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjbmt\" (UniqueName: \"kubernetes.io/projected/8824a445-cd43-4ed6-a561-647fa10f3218-kube-api-access-bjbmt\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.689573 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.689532    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8824a445-cd43-4ed6-a561-647fa10f3218-tls-certs\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.689573 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.689566    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-tmp-dir\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.689902 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.689614    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-model-cache\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.689902 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.689634    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-dshm\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.689902 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.689677    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-home\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.690066 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.690042    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-tmp-dir\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.690133 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.690077    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-home\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.690133 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.690122    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-model-cache\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.691938 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.691917    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-dshm\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.692235 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.692218    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8824a445-cd43-4ed6-a561-647fa10f3218-tls-certs\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.697728 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.697704    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjbmt\" (UniqueName: \"kubernetes.io/projected/8824a445-cd43-4ed6-a561-647fa10f3218-kube-api-access-bjbmt\") pod \"test-model-d060b0-kserve-74955fdb9-g2xcq\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") " pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.710678 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.710652    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:27.853891 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:27.853859    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"]
Jul 24 16:24:27.856151 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:24:27.856120    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8824a445_cd43_4ed6_a561_647fa10f3218.slice/crio-47bef9b051300aca3b72bdc27541adad2fd3e6c98019db4a3dd17142b4c31433 WatchSource:0}: Error finding container 47bef9b051300aca3b72bdc27541adad2fd3e6c98019db4a3dd17142b4c31433: Status 404 returned error can't find the container with id 47bef9b051300aca3b72bdc27541adad2fd3e6c98019db4a3dd17142b4c31433
Jul 24 16:24:28.149002 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:28.148963    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq" event={"ID":"8824a445-cd43-4ed6-a561-647fa10f3218","Type":"ContainerStarted","Data":"31c2cbbf0d0357a1d4061fc3be28d77d33f714c1ab34badd1bcc70a2e844e0a2"}
Jul 24 16:24:28.149188 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:28.149010    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq" event={"ID":"8824a445-cd43-4ed6-a561-647fa10f3218","Type":"ContainerStarted","Data":"47bef9b051300aca3b72bdc27541adad2fd3e6c98019db4a3dd17142b4c31433"}
Jul 24 16:24:28.166787 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:28.166737    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq" podStartSLOduration=1.166721157 podStartE2EDuration="1.166721157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:24:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:24:28.165797925 +0000 UTC m=+2222.228247116" watchObservedRunningTime="2026-07-24 16:24:28.166721157 +0000 UTC m=+2222.229170344"
Jul 24 16:24:37.711714 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:37.711664    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:37.712325 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:37.711729    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:37.724662 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:37.724633    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:24:38.212415 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:24:38.212385    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:25:12.248460 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:12.248357    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"]
Jul 24 16:25:22.942380 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:22.942340    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"]
Jul 24 16:25:22.942996 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:22.942612    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k" podUID="61fb2d07-ef49-4df6-922c-6682e97227de" containerName="payload-pre-processing" containerID="cri-o://49c906ba1e477b52e7ef5243003cb04928b79b7ebd704f6891ff090630505902" gracePeriod=30
Jul 24 16:25:23.203716 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.203645    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"
Jul 24 16:25:23.232312 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.232280    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdr9b\" (UniqueName: \"kubernetes.io/projected/61fb2d07-ef49-4df6-922c-6682e97227de-kube-api-access-zdr9b\") pod \"61fb2d07-ef49-4df6-922c-6682e97227de\" (UID: \"61fb2d07-ef49-4df6-922c-6682e97227de\") "
Jul 24 16:25:23.232468 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.232363    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61fb2d07-ef49-4df6-922c-6682e97227de-plugins-config-volume\") pod \"61fb2d07-ef49-4df6-922c-6682e97227de\" (UID: \"61fb2d07-ef49-4df6-922c-6682e97227de\") "
Jul 24 16:25:23.232733 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.232709    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61fb2d07-ef49-4df6-922c-6682e97227de-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "61fb2d07-ef49-4df6-922c-6682e97227de" (UID: "61fb2d07-ef49-4df6-922c-6682e97227de"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:25:23.234475 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.234442    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61fb2d07-ef49-4df6-922c-6682e97227de-kube-api-access-zdr9b" (OuterVolumeSpecName: "kube-api-access-zdr9b") pod "61fb2d07-ef49-4df6-922c-6682e97227de" (UID: "61fb2d07-ef49-4df6-922c-6682e97227de"). InnerVolumeSpecName "kube-api-access-zdr9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:25:23.333718 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.333679    2553 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61fb2d07-ef49-4df6-922c-6682e97227de-plugins-config-volume\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:23.333718 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.333720    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdr9b\" (UniqueName: \"kubernetes.io/projected/61fb2d07-ef49-4df6-922c-6682e97227de-kube-api-access-zdr9b\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:23.437020 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.436981    2553 generic.go:356] "Generic (PLEG): container finished" podID="61fb2d07-ef49-4df6-922c-6682e97227de" containerID="49c906ba1e477b52e7ef5243003cb04928b79b7ebd704f6891ff090630505902" exitCode=0
Jul 24 16:25:23.437221 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.437030    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"
Jul 24 16:25:23.437221 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.437029    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k" event={"ID":"61fb2d07-ef49-4df6-922c-6682e97227de","Type":"ContainerDied","Data":"49c906ba1e477b52e7ef5243003cb04928b79b7ebd704f6891ff090630505902"}
Jul 24 16:25:23.437221 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.437136    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k" event={"ID":"61fb2d07-ef49-4df6-922c-6682e97227de","Type":"ContainerDied","Data":"0d38eca1c868d09cb179dbc1e1921769ac41a690422e2b94e24bf6ca98d6bea0"}
Jul 24 16:25:23.437221 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.437165    2553 scope.go:117] "RemoveContainer" containerID="49c906ba1e477b52e7ef5243003cb04928b79b7ebd704f6891ff090630505902"
Jul 24 16:25:23.447858 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.447839    2553 scope.go:117] "RemoveContainer" containerID="49c906ba1e477b52e7ef5243003cb04928b79b7ebd704f6891ff090630505902"
Jul 24 16:25:23.448169 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:25:23.448143    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49c906ba1e477b52e7ef5243003cb04928b79b7ebd704f6891ff090630505902\": container with ID starting with 49c906ba1e477b52e7ef5243003cb04928b79b7ebd704f6891ff090630505902 not found: ID does not exist" containerID="49c906ba1e477b52e7ef5243003cb04928b79b7ebd704f6891ff090630505902"
Jul 24 16:25:23.448221 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.448182    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49c906ba1e477b52e7ef5243003cb04928b79b7ebd704f6891ff090630505902"} err="failed to get container status \"49c906ba1e477b52e7ef5243003cb04928b79b7ebd704f6891ff090630505902\": rpc error: code = NotFound desc = could not find container \"49c906ba1e477b52e7ef5243003cb04928b79b7ebd704f6891ff090630505902\": container with ID starting with 49c906ba1e477b52e7ef5243003cb04928b79b7ebd704f6891ff090630505902 not found: ID does not exist"
Jul 24 16:25:23.460973 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.460903    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"]
Jul 24 16:25:23.464911 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:23.464883    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e12d61-5c959d67c6-cxv7k"]
Jul 24 16:25:24.475312 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:24.475278    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61fb2d07-ef49-4df6-922c-6682e97227de" path="/var/lib/kubelet/pods/61fb2d07-ef49-4df6-922c-6682e97227de/volumes"
Jul 24 16:25:27.268309 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.268248    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq" podUID="8824a445-cd43-4ed6-a561-647fa10f3218" containerName="main" containerID="cri-o://31c2cbbf0d0357a1d4061fc3be28d77d33f714c1ab34badd1bcc70a2e844e0a2" gracePeriod=45
Jul 24 16:25:27.464910 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.464875    2553 generic.go:356] "Generic (PLEG): container finished" podID="8824a445-cd43-4ed6-a561-647fa10f3218" containerID="31c2cbbf0d0357a1d4061fc3be28d77d33f714c1ab34badd1bcc70a2e844e0a2" exitCode=0
Jul 24 16:25:27.465098 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.464946    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq" event={"ID":"8824a445-cd43-4ed6-a561-647fa10f3218","Type":"ContainerDied","Data":"31c2cbbf0d0357a1d4061fc3be28d77d33f714c1ab34badd1bcc70a2e844e0a2"}
Jul 24 16:25:27.523947 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.523887    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:25:27.574753 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.574720    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-model-cache\") pod \"8824a445-cd43-4ed6-a561-647fa10f3218\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") "
Jul 24 16:25:27.574938 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.574770    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-tmp-dir\") pod \"8824a445-cd43-4ed6-a561-647fa10f3218\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") "
Jul 24 16:25:27.574938 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.574796    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-home\") pod \"8824a445-cd43-4ed6-a561-647fa10f3218\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") "
Jul 24 16:25:27.574938 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.574836    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-dshm\") pod \"8824a445-cd43-4ed6-a561-647fa10f3218\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") "
Jul 24 16:25:27.574938 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.574868    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjbmt\" (UniqueName: \"kubernetes.io/projected/8824a445-cd43-4ed6-a561-647fa10f3218-kube-api-access-bjbmt\") pod \"8824a445-cd43-4ed6-a561-647fa10f3218\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") "
Jul 24 16:25:27.575167 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.574939    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8824a445-cd43-4ed6-a561-647fa10f3218-tls-certs\") pod \"8824a445-cd43-4ed6-a561-647fa10f3218\" (UID: \"8824a445-cd43-4ed6-a561-647fa10f3218\") "
Jul 24 16:25:27.575167 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.575001    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-model-cache" (OuterVolumeSpecName: "model-cache") pod "8824a445-cd43-4ed6-a561-647fa10f3218" (UID: "8824a445-cd43-4ed6-a561-647fa10f3218"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:25:27.575167 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.575098    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8824a445-cd43-4ed6-a561-647fa10f3218" (UID: "8824a445-cd43-4ed6-a561-647fa10f3218"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:25:27.575167 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.575113    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-home" (OuterVolumeSpecName: "home") pod "8824a445-cd43-4ed6-a561-647fa10f3218" (UID: "8824a445-cd43-4ed6-a561-647fa10f3218"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:25:27.575342 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.575323    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-tmp-dir\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:27.575376 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.575347    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-home\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:27.575376 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.575361    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-model-cache\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:27.577109 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.577087    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8824a445-cd43-4ed6-a561-647fa10f3218-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8824a445-cd43-4ed6-a561-647fa10f3218" (UID: "8824a445-cd43-4ed6-a561-647fa10f3218"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:25:27.577338 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.577323    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-dshm" (OuterVolumeSpecName: "dshm") pod "8824a445-cd43-4ed6-a561-647fa10f3218" (UID: "8824a445-cd43-4ed6-a561-647fa10f3218"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:25:27.577531 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.577505    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8824a445-cd43-4ed6-a561-647fa10f3218-kube-api-access-bjbmt" (OuterVolumeSpecName: "kube-api-access-bjbmt") pod "8824a445-cd43-4ed6-a561-647fa10f3218" (UID: "8824a445-cd43-4ed6-a561-647fa10f3218"). InnerVolumeSpecName "kube-api-access-bjbmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:25:27.676168 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.676123    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8824a445-cd43-4ed6-a561-647fa10f3218-tls-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:27.676168 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.676159    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8824a445-cd43-4ed6-a561-647fa10f3218-dshm\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:27.676168 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:27.676169    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjbmt\" (UniqueName: \"kubernetes.io/projected/8824a445-cd43-4ed6-a561-647fa10f3218-kube-api-access-bjbmt\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:28.471733 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:28.471673    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"
Jul 24 16:25:28.475928 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:28.475900    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq" event={"ID":"8824a445-cd43-4ed6-a561-647fa10f3218","Type":"ContainerDied","Data":"47bef9b051300aca3b72bdc27541adad2fd3e6c98019db4a3dd17142b4c31433"}
Jul 24 16:25:28.476082 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:28.475943    2553 scope.go:117] "RemoveContainer" containerID="31c2cbbf0d0357a1d4061fc3be28d77d33f714c1ab34badd1bcc70a2e844e0a2"
Jul 24 16:25:28.496596 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:28.496559    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"]
Jul 24 16:25:28.502593 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:28.502557    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-d060b0/test-model-d060b0-kserve-74955fdb9-g2xcq"]
Jul 24 16:25:30.474938 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:30.474904    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8824a445-cd43-4ed6-a561-647fa10f3218" path="/var/lib/kubelet/pods/8824a445-cd43-4ed6-a561-647fa10f3218/volumes"
Jul 24 16:25:33.941238 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:33.941196    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"]
Jul 24 16:25:33.941704 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:33.941490    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g" podUID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerName="istio-proxy" containerID="cri-o://e6cf71397736b16ca0ad8f0de1a3ceb4c512694afc7575d859f6ced4abecd525" gracePeriod=30
Jul 24 16:25:39.204384 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.204310    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:25:39.295362 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.295317    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-workload-certs\") pod \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") "
Jul 24 16:25:39.295575 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.295373    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-workload-socket\") pod \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") "
Jul 24 16:25:39.295575 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.295445    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-credential-socket\") pod \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") "
Jul 24 16:25:39.295575 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.295479    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-podinfo\") pod \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") "
Jul 24 16:25:39.295575 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.295511    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istiod-ca-cert\") pod \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") "
Jul 24 16:25:39.295575 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.295550    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-envoy\") pod \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") "
Jul 24 16:25:39.295575 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.295575    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-data\") pod \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") "
Jul 24 16:25:39.295916 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.295638    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4p7c\" (UniqueName: \"kubernetes.io/projected/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-kube-api-access-r4p7c\") pod \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") "
Jul 24 16:25:39.295916 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.295708    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a47657bc-6d76-4ebd-b4fe-b98d67055ebe" (UID: "a47657bc-6d76-4ebd-b4fe-b98d67055ebe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:25:39.296177 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.296143    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a47657bc-6d76-4ebd-b4fe-b98d67055ebe" (UID: "a47657bc-6d76-4ebd-b4fe-b98d67055ebe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:25:39.296269 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.295717    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a47657bc-6d76-4ebd-b4fe-b98d67055ebe" (UID: "a47657bc-6d76-4ebd-b4fe-b98d67055ebe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:25:39.296341 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.296318    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-token\") pod \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\" (UID: \"a47657bc-6d76-4ebd-b4fe-b98d67055ebe\") "
Jul 24 16:25:39.298326 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.298211    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:39.298326 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.298250    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:39.298326 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.298266    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:39.298994 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.298957    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a47657bc-6d76-4ebd-b4fe-b98d67055ebe" (UID: "a47657bc-6d76-4ebd-b4fe-b98d67055ebe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:25:39.304531 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.299195    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-kube-api-access-r4p7c" (OuterVolumeSpecName: "kube-api-access-r4p7c") pod "a47657bc-6d76-4ebd-b4fe-b98d67055ebe" (UID: "a47657bc-6d76-4ebd-b4fe-b98d67055ebe"). InnerVolumeSpecName "kube-api-access-r4p7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:25:39.304531 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.299247    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-data" (OuterVolumeSpecName: "istio-data") pod "a47657bc-6d76-4ebd-b4fe-b98d67055ebe" (UID: "a47657bc-6d76-4ebd-b4fe-b98d67055ebe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:25:39.304531 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.299487    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a47657bc-6d76-4ebd-b4fe-b98d67055ebe" (UID: "a47657bc-6d76-4ebd-b4fe-b98d67055ebe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:25:39.304531 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.299493    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-token" (OuterVolumeSpecName: "istio-token") pod "a47657bc-6d76-4ebd-b4fe-b98d67055ebe" (UID: "a47657bc-6d76-4ebd-b4fe-b98d67055ebe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:25:39.304531 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.300767    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a47657bc-6d76-4ebd-b4fe-b98d67055ebe" (UID: "a47657bc-6d76-4ebd-b4fe-b98d67055ebe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:25:39.399379 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.399333    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:39.399379 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.399370    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:39.399379 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.399380    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:39.399379 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.399389    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:39.399735 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.399398    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4p7c\" (UniqueName: \"kubernetes.io/projected/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-kube-api-access-r4p7c\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:39.399735 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.399408    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a47657bc-6d76-4ebd-b4fe-b98d67055ebe-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:25:39.525348 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.525310    2553 generic.go:356] "Generic (PLEG): container finished" podID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerID="e6cf71397736b16ca0ad8f0de1a3ceb4c512694afc7575d859f6ced4abecd525" exitCode=0
Jul 24 16:25:39.525527 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.525383    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"
Jul 24 16:25:39.525527 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.525401    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g" event={"ID":"a47657bc-6d76-4ebd-b4fe-b98d67055ebe","Type":"ContainerDied","Data":"e6cf71397736b16ca0ad8f0de1a3ceb4c512694afc7575d859f6ced4abecd525"}
Jul 24 16:25:39.525527 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.525460    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g" event={"ID":"a47657bc-6d76-4ebd-b4fe-b98d67055ebe","Type":"ContainerDied","Data":"e8eb66187b8ea43ae85843428160836d1b99872a527c1d8e0f4bc4bef931031e"}
Jul 24 16:25:39.525527 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.525483    2553 scope.go:117] "RemoveContainer" containerID="e6cf71397736b16ca0ad8f0de1a3ceb4c512694afc7575d859f6ced4abecd525"
Jul 24 16:25:39.534771 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.534750    2553 scope.go:117] "RemoveContainer" containerID="bcb08a9d70985abd02b4bd401b99bd1e8a859a6c15448adc50e4f4767f5ba98c"
Jul 24 16:25:39.543523 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.543500    2553 scope.go:117] "RemoveContainer" containerID="e6cf71397736b16ca0ad8f0de1a3ceb4c512694afc7575d859f6ced4abecd525"
Jul 24 16:25:39.543862 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:25:39.543836    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6cf71397736b16ca0ad8f0de1a3ceb4c512694afc7575d859f6ced4abecd525\": container with ID starting with e6cf71397736b16ca0ad8f0de1a3ceb4c512694afc7575d859f6ced4abecd525 not found: ID does not exist" containerID="e6cf71397736b16ca0ad8f0de1a3ceb4c512694afc7575d859f6ced4abecd525"
Jul 24 16:25:39.543952 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.543869    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6cf71397736b16ca0ad8f0de1a3ceb4c512694afc7575d859f6ced4abecd525"} err="failed to get container status \"e6cf71397736b16ca0ad8f0de1a3ceb4c512694afc7575d859f6ced4abecd525\": rpc error: code = NotFound desc = could not find container \"e6cf71397736b16ca0ad8f0de1a3ceb4c512694afc7575d859f6ced4abecd525\": container with ID starting with e6cf71397736b16ca0ad8f0de1a3ceb4c512694afc7575d859f6ced4abecd525 not found: ID does not exist"
Jul 24 16:25:39.543952 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.543887    2553 scope.go:117] "RemoveContainer" containerID="bcb08a9d70985abd02b4bd401b99bd1e8a859a6c15448adc50e4f4767f5ba98c"
Jul 24 16:25:39.544119 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:25:39.544103    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcb08a9d70985abd02b4bd401b99bd1e8a859a6c15448adc50e4f4767f5ba98c\": container with ID starting with bcb08a9d70985abd02b4bd401b99bd1e8a859a6c15448adc50e4f4767f5ba98c not found: ID does not exist" containerID="bcb08a9d70985abd02b4bd401b99bd1e8a859a6c15448adc50e4f4767f5ba98c"
Jul 24 16:25:39.544156 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.544124    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb08a9d70985abd02b4bd401b99bd1e8a859a6c15448adc50e4f4767f5ba98c"} err="failed to get container status \"bcb08a9d70985abd02b4bd401b99bd1e8a859a6c15448adc50e4f4767f5ba98c\": rpc error: code = NotFound desc = could not find container \"bcb08a9d70985abd02b4bd401b99bd1e8a859a6c15448adc50e4f4767f5ba98c\": container with ID starting with bcb08a9d70985abd02b4bd401b99bd1e8a859a6c15448adc50e4f4767f5ba98c not found: ID does not exist"
Jul 24 16:25:39.547908 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.547884    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"]
Jul 24 16:25:39.551912 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:39.551888    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-e12d61-openshift-default-86867786cb-6mj7g"]
Jul 24 16:25:40.474945 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:40.474911    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" path="/var/lib/kubelet/pods/a47657bc-6d76-4ebd-b4fe-b98d67055ebe/volumes"
Jul 24 16:25:55.964252 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:55.964210    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"]
Jul 24 16:25:55.964766 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:55.964505    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8" podUID="43921f28-ed0e-4d15-b17e-7f7720bab0ef" containerName="istio-proxy" containerID="cri-o://82d24830a2b426c912ac3bf2ce0a754d0ab23945b059d67b24e898837f72b4f1" gracePeriod=30
Jul 24 16:25:56.873243 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.873204    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"]
Jul 24 16:25:56.873642 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.873626    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerName="istio-proxy"
Jul 24 16:25:56.873695 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.873643    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerName="istio-proxy"
Jul 24 16:25:56.873695 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.873651    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8824a445-cd43-4ed6-a561-647fa10f3218" containerName="main"
Jul 24 16:25:56.873695 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.873657    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8824a445-cd43-4ed6-a561-647fa10f3218" containerName="main"
Jul 24 16:25:56.873695 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.873668    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61fb2d07-ef49-4df6-922c-6682e97227de" containerName="payload-pre-processing"
Jul 24 16:25:56.873695 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.873674    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="61fb2d07-ef49-4df6-922c-6682e97227de" containerName="payload-pre-processing"
Jul 24 16:25:56.873695 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.873681    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerName="istio-proxy"
Jul 24 16:25:56.873695 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.873688    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerName="istio-proxy"
Jul 24 16:25:56.873949 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.873755    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerName="istio-proxy"
Jul 24 16:25:56.873949 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.873765    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a47657bc-6d76-4ebd-b4fe-b98d67055ebe" containerName="istio-proxy"
Jul 24 16:25:56.873949 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.873772    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="61fb2d07-ef49-4df6-922c-6682e97227de" containerName="payload-pre-processing"
Jul 24 16:25:56.873949 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.873779    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8824a445-cd43-4ed6-a561-647fa10f3218" containerName="main"
Jul 24 16:25:56.876719 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.876696    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:56.879660 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.879637    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-01d58c-openshift-default-dockercfg-5bqr8\""
Jul 24 16:25:56.889616 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.889573    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"]
Jul 24 16:25:56.960691 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.960654    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-token\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:56.960916 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.960707    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-workload-socket\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:56.960916 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.960728    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-envoy\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:56.960916 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.960798    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-479rv\" (UniqueName: \"kubernetes.io/projected/d4897ec4-1197-42fe-ad3f-9020b6095ab5-kube-api-access-479rv\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:56.960916 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.960881    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-data\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:56.961153 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.960924    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-credential-socket\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:56.961153 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.960985    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-workload-certs\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:56.961153 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.961010    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istiod-ca-cert\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:56.961153 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:56.961031    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-podinfo\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.061815 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.061772    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-workload-certs\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.062294 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.061824    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istiod-ca-cert\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.062294 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.061857    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-podinfo\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.062294 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.061912    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-token\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.062294 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.061955    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-workload-socket\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.062294 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.061978    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-envoy\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.062294 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.062038    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-479rv\" (UniqueName: \"kubernetes.io/projected/d4897ec4-1197-42fe-ad3f-9020b6095ab5-kube-api-access-479rv\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.062294 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.062077    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-data\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.062294 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.062106    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-credential-socket\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.062294 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.062235    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-workload-certs\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.062812 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.062311    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-workload-socket\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.062812 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.062436    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-credential-socket\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.062812 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.062612    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istiod-ca-cert\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.062812 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.062667    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-data\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.064390 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.064366    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-envoy\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.064701 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.064680    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-podinfo\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.070537 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.070499    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-token\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.071517 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.071489    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-479rv\" (UniqueName: \"kubernetes.io/projected/d4897ec4-1197-42fe-ad3f-9020b6095ab5-kube-api-access-479rv\") pod \"e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") " pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.187517 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.187413    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:57.334508 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.334313    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"]
Jul 24 16:25:57.337506 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:25:57.337473    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4897ec4_1197_42fe_ad3f_9020b6095ab5.slice/crio-3a1cb1e92ea987c271772f25927166ff1eefa85fee5c260b729888201e3df1ed WatchSource:0}: Error finding container 3a1cb1e92ea987c271772f25927166ff1eefa85fee5c260b729888201e3df1ed: Status 404 returned error can't find the container with id 3a1cb1e92ea987c271772f25927166ff1eefa85fee5c260b729888201e3df1ed
Jul 24 16:25:57.339904 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.339870    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:25:57.339987 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.339939    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:25:57.339987 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.339969    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:25:57.629555 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.629500    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc" event={"ID":"d4897ec4-1197-42fe-ad3f-9020b6095ab5","Type":"ContainerStarted","Data":"33d9ae168c8ba23f52a811d865939cae5080e750e54f7fb8f1ed89ef0aaaf709"}
Jul 24 16:25:57.629829 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.629623    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc" event={"ID":"d4897ec4-1197-42fe-ad3f-9020b6095ab5","Type":"ContainerStarted","Data":"3a1cb1e92ea987c271772f25927166ff1eefa85fee5c260b729888201e3df1ed"}
Jul 24 16:25:57.656129 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:57.656073    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc" podStartSLOduration=1.656056382 podStartE2EDuration="1.656056382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:25:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:25:57.653980845 +0000 UTC m=+2311.716430052" watchObservedRunningTime="2026-07-24 16:25:57.656056382 +0000 UTC m=+2311.718505569"
Jul 24 16:25:58.188122 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:58.188084    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:58.193006 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:58.192978    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:58.635401 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:58.635363    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:25:58.636490 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:25:58.636463    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:26:01.217431 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.217404    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:26:01.306755 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.306723    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istiod-ca-cert\") pod \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") "
Jul 24 16:26:01.306963 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.306769    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hz8n\" (UniqueName: \"kubernetes.io/projected/43921f28-ed0e-4d15-b17e-7f7720bab0ef-kube-api-access-5hz8n\") pod \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") "
Jul 24 16:26:01.306963 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.306839    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-envoy\") pod \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") "
Jul 24 16:26:01.306963 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.306874    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-token\") pod \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") "
Jul 24 16:26:01.306963 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.306915    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-credential-socket\") pod \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") "
Jul 24 16:26:01.306963 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.306954    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-podinfo\") pod \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") "
Jul 24 16:26:01.307236 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.307003    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-data\") pod \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") "
Jul 24 16:26:01.307236 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.307025    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-workload-socket\") pod \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") "
Jul 24 16:26:01.307236 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.307069    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-workload-certs\") pod \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\" (UID: \"43921f28-ed0e-4d15-b17e-7f7720bab0ef\") "
Jul 24 16:26:01.307236 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.307189    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "43921f28-ed0e-4d15-b17e-7f7720bab0ef" (UID: "43921f28-ed0e-4d15-b17e-7f7720bab0ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:26:01.307236 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.307223    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "43921f28-ed0e-4d15-b17e-7f7720bab0ef" (UID: "43921f28-ed0e-4d15-b17e-7f7720bab0ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:26:01.307511 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.307469    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:01.307511 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.307489    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:01.307511 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.307499    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "43921f28-ed0e-4d15-b17e-7f7720bab0ef" (UID: "43921f28-ed0e-4d15-b17e-7f7720bab0ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:26:01.307726 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.307527    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "43921f28-ed0e-4d15-b17e-7f7720bab0ef" (UID: "43921f28-ed0e-4d15-b17e-7f7720bab0ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:26:01.307964 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.307936    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "43921f28-ed0e-4d15-b17e-7f7720bab0ef" (UID: "43921f28-ed0e-4d15-b17e-7f7720bab0ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:26:01.309350 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.309328    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43921f28-ed0e-4d15-b17e-7f7720bab0ef-kube-api-access-5hz8n" (OuterVolumeSpecName: "kube-api-access-5hz8n") pod "43921f28-ed0e-4d15-b17e-7f7720bab0ef" (UID: "43921f28-ed0e-4d15-b17e-7f7720bab0ef"). InnerVolumeSpecName "kube-api-access-5hz8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:26:01.309454 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.309401    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "43921f28-ed0e-4d15-b17e-7f7720bab0ef" (UID: "43921f28-ed0e-4d15-b17e-7f7720bab0ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:26:01.309498 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.309467    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "43921f28-ed0e-4d15-b17e-7f7720bab0ef" (UID: "43921f28-ed0e-4d15-b17e-7f7720bab0ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:26:01.309498 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.309475    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "43921f28-ed0e-4d15-b17e-7f7720bab0ef" (UID: "43921f28-ed0e-4d15-b17e-7f7720bab0ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:26:01.408170 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.408127    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:01.408170 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.408163    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hz8n\" (UniqueName: \"kubernetes.io/projected/43921f28-ed0e-4d15-b17e-7f7720bab0ef-kube-api-access-5hz8n\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:01.408170 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.408175    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:01.408406 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.408186    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:01.408406 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.408195    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:01.408406 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.408203    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:01.408406 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.408211    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43921f28-ed0e-4d15-b17e-7f7720bab0ef-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:01.653256 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.653168    2553 generic.go:356] "Generic (PLEG): container finished" podID="43921f28-ed0e-4d15-b17e-7f7720bab0ef" containerID="82d24830a2b426c912ac3bf2ce0a754d0ab23945b059d67b24e898837f72b4f1" exitCode=0
Jul 24 16:26:01.653256 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.653215    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"
Jul 24 16:26:01.653434 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.653250    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8" event={"ID":"43921f28-ed0e-4d15-b17e-7f7720bab0ef","Type":"ContainerDied","Data":"82d24830a2b426c912ac3bf2ce0a754d0ab23945b059d67b24e898837f72b4f1"}
Jul 24 16:26:01.653434 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.653305    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8" event={"ID":"43921f28-ed0e-4d15-b17e-7f7720bab0ef","Type":"ContainerDied","Data":"e30d8477f4b6c01e46a37e68f7422004270481693fd66e1adc42fde756edf05e"}
Jul 24 16:26:01.653434 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.653328    2553 scope.go:117] "RemoveContainer" containerID="82d24830a2b426c912ac3bf2ce0a754d0ab23945b059d67b24e898837f72b4f1"
Jul 24 16:26:01.663347 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.663328    2553 scope.go:117] "RemoveContainer" containerID="93a38c4673f0d2af5ae44790bde38cbf25a5b1f31c1818333f767b5c0d4f4d10"
Jul 24 16:26:01.671850 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.671829    2553 scope.go:117] "RemoveContainer" containerID="82d24830a2b426c912ac3bf2ce0a754d0ab23945b059d67b24e898837f72b4f1"
Jul 24 16:26:01.672135 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:26:01.672113    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82d24830a2b426c912ac3bf2ce0a754d0ab23945b059d67b24e898837f72b4f1\": container with ID starting with 82d24830a2b426c912ac3bf2ce0a754d0ab23945b059d67b24e898837f72b4f1 not found: ID does not exist" containerID="82d24830a2b426c912ac3bf2ce0a754d0ab23945b059d67b24e898837f72b4f1"
Jul 24 16:26:01.672181 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.672148    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82d24830a2b426c912ac3bf2ce0a754d0ab23945b059d67b24e898837f72b4f1"} err="failed to get container status \"82d24830a2b426c912ac3bf2ce0a754d0ab23945b059d67b24e898837f72b4f1\": rpc error: code = NotFound desc = could not find container \"82d24830a2b426c912ac3bf2ce0a754d0ab23945b059d67b24e898837f72b4f1\": container with ID starting with 82d24830a2b426c912ac3bf2ce0a754d0ab23945b059d67b24e898837f72b4f1 not found: ID does not exist"
Jul 24 16:26:01.672181 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.672167    2553 scope.go:117] "RemoveContainer" containerID="93a38c4673f0d2af5ae44790bde38cbf25a5b1f31c1818333f767b5c0d4f4d10"
Jul 24 16:26:01.672439 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:26:01.672418    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93a38c4673f0d2af5ae44790bde38cbf25a5b1f31c1818333f767b5c0d4f4d10\": container with ID starting with 93a38c4673f0d2af5ae44790bde38cbf25a5b1f31c1818333f767b5c0d4f4d10 not found: ID does not exist" containerID="93a38c4673f0d2af5ae44790bde38cbf25a5b1f31c1818333f767b5c0d4f4d10"
Jul 24 16:26:01.672497 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.672446    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a38c4673f0d2af5ae44790bde38cbf25a5b1f31c1818333f767b5c0d4f4d10"} err="failed to get container status \"93a38c4673f0d2af5ae44790bde38cbf25a5b1f31c1818333f767b5c0d4f4d10\": rpc error: code = NotFound desc = could not find container \"93a38c4673f0d2af5ae44790bde38cbf25a5b1f31c1818333f767b5c0d4f4d10\": container with ID starting with 93a38c4673f0d2af5ae44790bde38cbf25a5b1f31c1818333f767b5c0d4f4d10 not found: ID does not exist"
Jul 24 16:26:01.696341 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.696300    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"]
Jul 24 16:26:01.703115 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:01.703083    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-d060b0-openshift-default-775b9b64d4-994c8"]
Jul 24 16:26:02.479615 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:02.478203    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43921f28-ed0e-4d15-b17e-7f7720bab0ef" path="/var/lib/kubelet/pods/43921f28-ed0e-4d15-b17e-7f7720bab0ef/volumes"
Jul 24 16:26:04.892761 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.892727    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"]
Jul 24 16:26:04.893247 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.893104    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43921f28-ed0e-4d15-b17e-7f7720bab0ef" containerName="istio-proxy"
Jul 24 16:26:04.893247 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.893116    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="43921f28-ed0e-4d15-b17e-7f7720bab0ef" containerName="istio-proxy"
Jul 24 16:26:04.893247 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.893175    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="43921f28-ed0e-4d15-b17e-7f7720bab0ef" containerName="istio-proxy"
Jul 24 16:26:04.893247 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.893184    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="43921f28-ed0e-4d15-b17e-7f7720bab0ef" containerName="istio-proxy"
Jul 24 16:26:04.896314 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.896289    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:04.899257 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.899228    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-2c74ca-openshift-default-dockercfg-8tmf6\""
Jul 24 16:26:04.908632 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.908573    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"]
Jul 24 16:26:04.941090 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.941032    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-workload-certs\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:04.941273 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.941104    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b628b10-da56-41a6-97e9-618a857f7838-istiod-ca-cert\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:04.941273 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.941140    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-istio-data\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:04.941946 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.941912    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b628b10-da56-41a6-97e9-618a857f7838-istio-token\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:04.942118 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.941988    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-istio-envoy\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:04.942118 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.942015    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b628b10-da56-41a6-97e9-618a857f7838-istio-podinfo\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:04.942300 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.942146    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-credential-socket\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:04.942300 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.942202    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-workload-socket\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:04.942300 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:04.942228    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5nxn\" (UniqueName: \"kubernetes.io/projected/0b628b10-da56-41a6-97e9-618a857f7838-kube-api-access-v5nxn\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.043540 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.043499    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-workload-socket\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.043762 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.043550    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5nxn\" (UniqueName: \"kubernetes.io/projected/0b628b10-da56-41a6-97e9-618a857f7838-kube-api-access-v5nxn\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.043762 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.043732    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-workload-certs\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.043896 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.043810    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b628b10-da56-41a6-97e9-618a857f7838-istiod-ca-cert\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.043896 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.043867    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-istio-data\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.044008 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.043893    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b628b10-da56-41a6-97e9-618a857f7838-istio-token\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.044008 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.043938    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-istio-envoy\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.044008 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.043967    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b628b10-da56-41a6-97e9-618a857f7838-istio-podinfo\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.044156 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.044002    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-workload-socket\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.044156 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.044122    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-credential-socket\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.044553 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.044526    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-credential-socket\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.044716 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.044617    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b628b10-da56-41a6-97e9-618a857f7838-istiod-ca-cert\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.044716 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.044699    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-workload-certs\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.044865 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.044846    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-istio-data\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.047164 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.047146    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-istio-envoy\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.047309 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.047290    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b628b10-da56-41a6-97e9-618a857f7838-istio-podinfo\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.053720 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.053696    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5nxn\" (UniqueName: \"kubernetes.io/projected/0b628b10-da56-41a6-97e9-618a857f7838-kube-api-access-v5nxn\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.053815 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.053795    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b628b10-da56-41a6-97e9-618a857f7838-istio-token\") pod \"e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") " pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.209339 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.209235    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:05.358929 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.358903    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"]
Jul 24 16:26:05.361017 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:26:05.360985    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b628b10_da56_41a6_97e9_618a857f7838.slice/crio-bc3566dd3cc2ba087df64d6b54f7202b347713171771be0c76bf78e1ac79680f WatchSource:0}: Error finding container bc3566dd3cc2ba087df64d6b54f7202b347713171771be0c76bf78e1ac79680f: Status 404 returned error can't find the container with id bc3566dd3cc2ba087df64d6b54f7202b347713171771be0c76bf78e1ac79680f
Jul 24 16:26:05.363474 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.363430    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:26:05.363546 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.363525    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:26:05.363608 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.363564    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:26:05.675785 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.675742    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw" event={"ID":"0b628b10-da56-41a6-97e9-618a857f7838","Type":"ContainerStarted","Data":"ba402c79b62b855766b36814be3dfc240432c4168dea2ee00fbee353de689a7d"}
Jul 24 16:26:05.675974 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.675808    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw" event={"ID":"0b628b10-da56-41a6-97e9-618a857f7838","Type":"ContainerStarted","Data":"bc3566dd3cc2ba087df64d6b54f7202b347713171771be0c76bf78e1ac79680f"}
Jul 24 16:26:05.696525 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:05.696468    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw" podStartSLOduration=1.696448902 podStartE2EDuration="1.696448902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:26:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:26:05.694980453 +0000 UTC m=+2319.757429639" watchObservedRunningTime="2026-07-24 16:26:05.696448902 +0000 UTC m=+2319.758898089"
Jul 24 16:26:06.209746 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:06.209673    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:06.214800 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:06.214771    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:06.683435 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:06.683395    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:06.687246 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:06.687217    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:13.636747 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:13.636652    2553 patch_prober.go:28] interesting pod/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 24 16:26:13.636747 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:13.636720    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc" podUID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 24 16:26:13.725670 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:13.725555    2553 generic.go:356] "Generic (PLEG): container finished" podID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerID="33d9ae168c8ba23f52a811d865939cae5080e750e54f7fb8f1ed89ef0aaaf709" exitCode=0
Jul 24 16:26:13.725670 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:13.725623    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc" event={"ID":"d4897ec4-1197-42fe-ad3f-9020b6095ab5","Type":"ContainerDied","Data":"33d9ae168c8ba23f52a811d865939cae5080e750e54f7fb8f1ed89ef0aaaf709"}
Jul 24 16:26:13.726123 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:13.726105    2553 scope.go:117] "RemoveContainer" containerID="33d9ae168c8ba23f52a811d865939cae5080e750e54f7fb8f1ed89ef0aaaf709"
Jul 24 16:26:13.727261 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:13.727232    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:26:13.727347 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:13.727331    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:26:13.727391 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:13.727370    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:26:14.732018 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:14.731975    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc" event={"ID":"d4897ec4-1197-42fe-ad3f-9020b6095ab5","Type":"ContainerStarted","Data":"445ae84c7cc40ff614c19db6fce56dc74277bbc0a31101caa3fbacb0496207a5"}
Jul 24 16:26:15.188693 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:15.188640    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:26:15.188920 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:15.188783    2553 patch_prober.go:28] interesting pod/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 24 16:26:15.188920 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:15.188827    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc" podUID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 24 16:26:16.188248 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:16.188199    2553 patch_prober.go:28] interesting pod/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 24 16:26:16.188787 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:16.188271    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc" podUID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 24 16:26:17.188984 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:17.188936    2553 patch_prober.go:28] interesting pod/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 24 16:26:17.189500 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:17.189005    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc" podUID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 24 16:26:18.188403 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:18.188363    2553 patch_prober.go:28] interesting pod/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 24 16:26:18.188618 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:18.188431    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc" podUID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 24 16:26:19.193283 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:19.193246    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:26:19.193820 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:19.193534    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:26:19.194243 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:19.194223    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:26:21.684690 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:21.684652    2553 patch_prober.go:28] interesting pod/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 24 16:26:21.685213 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:21.684719    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw" podUID="0b628b10-da56-41a6-97e9-618a857f7838" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 24 16:26:21.776541 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:21.776505    2553 generic.go:356] "Generic (PLEG): container finished" podID="0b628b10-da56-41a6-97e9-618a857f7838" containerID="ba402c79b62b855766b36814be3dfc240432c4168dea2ee00fbee353de689a7d" exitCode=0
Jul 24 16:26:21.776752 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:21.776579    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw" event={"ID":"0b628b10-da56-41a6-97e9-618a857f7838","Type":"ContainerDied","Data":"ba402c79b62b855766b36814be3dfc240432c4168dea2ee00fbee353de689a7d"}
Jul 24 16:26:21.777017 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:21.777002    2553 scope.go:117] "RemoveContainer" containerID="ba402c79b62b855766b36814be3dfc240432c4168dea2ee00fbee353de689a7d"
Jul 24 16:26:21.778004 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:21.777977    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:26:21.778107 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:21.778043    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:26:21.778107 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:21.778075    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:26:22.784430 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:22.784396    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw" event={"ID":"0b628b10-da56-41a6-97e9-618a857f7838","Type":"ContainerStarted","Data":"28c8f6564e577a2de0af5da11b6ecbffb188d576456c3d52ee062e1c73f66ff6"}
Jul 24 16:26:23.209700 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:23.209557    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:23.209919 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:23.209895    2553 patch_prober.go:28] interesting pod/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 24 16:26:23.210017 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:23.209940    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw" podUID="0b628b10-da56-41a6-97e9-618a857f7838" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 24 16:26:24.209744 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:24.209696    2553 patch_prober.go:28] interesting pod/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 24 16:26:24.210249 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:24.209766    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw" podUID="0b628b10-da56-41a6-97e9-618a857f7838" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 24 16:26:25.210676 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:25.210636    2553 patch_prober.go:28] interesting pod/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 24 16:26:25.211097 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:25.210709    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw" podUID="0b628b10-da56-41a6-97e9-618a857f7838" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 24 16:26:26.209922 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:26.209881    2553 patch_prober.go:28] interesting pod/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 24 16:26:26.210148 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:26.209949    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw" podUID="0b628b10-da56-41a6-97e9-618a857f7838" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 24 16:26:27.213941 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:27.213907    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:27.214418 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:27.214171    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:27.214937 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:27.214921    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:26:47.111542 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:47.111507    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"]
Jul 24 16:26:47.112097 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:47.111782    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc" podUID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerName="istio-proxy" containerID="cri-o://445ae84c7cc40ff614c19db6fce56dc74277bbc0a31101caa3fbacb0496207a5" gracePeriod=30
Jul 24 16:26:49.195777 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:49.195733    2553 patch_prober.go:28] interesting pod/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 16:26:49.196173 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:49.195801    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc" podUID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 16:26:52.369470 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.369441    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:26:52.430467 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.430378    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-479rv\" (UniqueName: \"kubernetes.io/projected/d4897ec4-1197-42fe-ad3f-9020b6095ab5-kube-api-access-479rv\") pod \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") "
Jul 24 16:26:52.430467 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.430432    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-envoy\") pod \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") "
Jul 24 16:26:52.430467 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.430465    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-workload-certs\") pod \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") "
Jul 24 16:26:52.430763 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.430488    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-credential-socket\") pod \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") "
Jul 24 16:26:52.430763 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.430543    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istiod-ca-cert\") pod \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") "
Jul 24 16:26:52.430763 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.430577    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-data\") pod \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") "
Jul 24 16:26:52.430763 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.430628    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-podinfo\") pod \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") "
Jul 24 16:26:52.430763 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.430663    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-token\") pod \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") "
Jul 24 16:26:52.430763 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.430698    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-workload-socket\") pod \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\" (UID: \"d4897ec4-1197-42fe-ad3f-9020b6095ab5\") "
Jul 24 16:26:52.431070 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.430834    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4897ec4-1197-42fe-ad3f-9020b6095ab5" (UID: "d4897ec4-1197-42fe-ad3f-9020b6095ab5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:26:52.431070 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.430897    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4897ec4-1197-42fe-ad3f-9020b6095ab5" (UID: "d4897ec4-1197-42fe-ad3f-9020b6095ab5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:26:52.431070 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.431047    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4897ec4-1197-42fe-ad3f-9020b6095ab5" (UID: "d4897ec4-1197-42fe-ad3f-9020b6095ab5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:26:52.431218 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.431069    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4897ec4-1197-42fe-ad3f-9020b6095ab5" (UID: "d4897ec4-1197-42fe-ad3f-9020b6095ab5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:26:52.431218 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.431177    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:52.431218 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.431195    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:52.431218 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.431209    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:52.431357 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.431220    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:52.431725 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.431704    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4897ec4-1197-42fe-ad3f-9020b6095ab5" (UID: "d4897ec4-1197-42fe-ad3f-9020b6095ab5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:26:52.433191 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.433165    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4897ec4-1197-42fe-ad3f-9020b6095ab5" (UID: "d4897ec4-1197-42fe-ad3f-9020b6095ab5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:26:52.433191 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.433182    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4897ec4-1197-42fe-ad3f-9020b6095ab5" (UID: "d4897ec4-1197-42fe-ad3f-9020b6095ab5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:26:52.433303 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.433220    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4897ec4-1197-42fe-ad3f-9020b6095ab5-kube-api-access-479rv" (OuterVolumeSpecName: "kube-api-access-479rv") pod "d4897ec4-1197-42fe-ad3f-9020b6095ab5" (UID: "d4897ec4-1197-42fe-ad3f-9020b6095ab5"). InnerVolumeSpecName "kube-api-access-479rv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:26:52.433303 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.433228    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4897ec4-1197-42fe-ad3f-9020b6095ab5" (UID: "d4897ec4-1197-42fe-ad3f-9020b6095ab5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:26:52.532388 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.532350    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:52.532388 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.532381    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:52.532388 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.532390    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:52.532659 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.532400    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-479rv\" (UniqueName: \"kubernetes.io/projected/d4897ec4-1197-42fe-ad3f-9020b6095ab5-kube-api-access-479rv\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:52.532659 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.532409    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4897ec4-1197-42fe-ad3f-9020b6095ab5-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:26:52.932270 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.932238    2553 generic.go:356] "Generic (PLEG): container finished" podID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerID="445ae84c7cc40ff614c19db6fce56dc74277bbc0a31101caa3fbacb0496207a5" exitCode=0
Jul 24 16:26:52.932482 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.932293    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"
Jul 24 16:26:52.932482 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.932325    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc" event={"ID":"d4897ec4-1197-42fe-ad3f-9020b6095ab5","Type":"ContainerDied","Data":"445ae84c7cc40ff614c19db6fce56dc74277bbc0a31101caa3fbacb0496207a5"}
Jul 24 16:26:52.932482 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.932392    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc" event={"ID":"d4897ec4-1197-42fe-ad3f-9020b6095ab5","Type":"ContainerDied","Data":"3a1cb1e92ea987c271772f25927166ff1eefa85fee5c260b729888201e3df1ed"}
Jul 24 16:26:52.932482 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.932424    2553 scope.go:117] "RemoveContainer" containerID="445ae84c7cc40ff614c19db6fce56dc74277bbc0a31101caa3fbacb0496207a5"
Jul 24 16:26:52.941306 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.941287    2553 scope.go:117] "RemoveContainer" containerID="33d9ae168c8ba23f52a811d865939cae5080e750e54f7fb8f1ed89ef0aaaf709"
Jul 24 16:26:52.949557 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.949540    2553 scope.go:117] "RemoveContainer" containerID="445ae84c7cc40ff614c19db6fce56dc74277bbc0a31101caa3fbacb0496207a5"
Jul 24 16:26:52.949847 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:26:52.949823    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445ae84c7cc40ff614c19db6fce56dc74277bbc0a31101caa3fbacb0496207a5\": container with ID starting with 445ae84c7cc40ff614c19db6fce56dc74277bbc0a31101caa3fbacb0496207a5 not found: ID does not exist" containerID="445ae84c7cc40ff614c19db6fce56dc74277bbc0a31101caa3fbacb0496207a5"
Jul 24 16:26:52.949895 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.949855    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445ae84c7cc40ff614c19db6fce56dc74277bbc0a31101caa3fbacb0496207a5"} err="failed to get container status \"445ae84c7cc40ff614c19db6fce56dc74277bbc0a31101caa3fbacb0496207a5\": rpc error: code = NotFound desc = could not find container \"445ae84c7cc40ff614c19db6fce56dc74277bbc0a31101caa3fbacb0496207a5\": container with ID starting with 445ae84c7cc40ff614c19db6fce56dc74277bbc0a31101caa3fbacb0496207a5 not found: ID does not exist"
Jul 24 16:26:52.949895 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.949873    2553 scope.go:117] "RemoveContainer" containerID="33d9ae168c8ba23f52a811d865939cae5080e750e54f7fb8f1ed89ef0aaaf709"
Jul 24 16:26:52.950126 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:26:52.950106    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33d9ae168c8ba23f52a811d865939cae5080e750e54f7fb8f1ed89ef0aaaf709\": container with ID starting with 33d9ae168c8ba23f52a811d865939cae5080e750e54f7fb8f1ed89ef0aaaf709 not found: ID does not exist" containerID="33d9ae168c8ba23f52a811d865939cae5080e750e54f7fb8f1ed89ef0aaaf709"
Jul 24 16:26:52.950172 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.950132    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d9ae168c8ba23f52a811d865939cae5080e750e54f7fb8f1ed89ef0aaaf709"} err="failed to get container status \"33d9ae168c8ba23f52a811d865939cae5080e750e54f7fb8f1ed89ef0aaaf709\": rpc error: code = NotFound desc = could not find container \"33d9ae168c8ba23f52a811d865939cae5080e750e54f7fb8f1ed89ef0aaaf709\": container with ID starting with 33d9ae168c8ba23f52a811d865939cae5080e750e54f7fb8f1ed89ef0aaaf709 not found: ID does not exist"
Jul 24 16:26:52.954734 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.954712    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"]
Jul 24 16:26:52.960168 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:52.960147    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-01d58c-openshift-default-86bc4f774b-r5wtc"]
Jul 24 16:26:54.474666 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:26:54.474632    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" path="/var/lib/kubelet/pods/d4897ec4-1197-42fe-ad3f-9020b6095ab5/volumes"
Jul 24 16:27:14.113502 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:14.113468    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"]
Jul 24 16:27:14.114032 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:14.113754    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw" podUID="0b628b10-da56-41a6-97e9-618a857f7838" containerName="istio-proxy" containerID="cri-o://28c8f6564e577a2de0af5da11b6ecbffb188d576456c3d52ee062e1c73f66ff6" gracePeriod=30
Jul 24 16:27:14.995741 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:14.995704    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"]
Jul 24 16:27:14.996096 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:14.996084    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerName="istio-proxy"
Jul 24 16:27:14.996157 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:14.996097    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerName="istio-proxy"
Jul 24 16:27:14.996157 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:14.996114    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43921f28-ed0e-4d15-b17e-7f7720bab0ef" containerName="istio-proxy"
Jul 24 16:27:14.996157 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:14.996120    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="43921f28-ed0e-4d15-b17e-7f7720bab0ef" containerName="istio-proxy"
Jul 24 16:27:14.996157 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:14.996130    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerName="istio-proxy"
Jul 24 16:27:14.996157 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:14.996135    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerName="istio-proxy"
Jul 24 16:27:14.996327 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:14.996190    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerName="istio-proxy"
Jul 24 16:27:14.996327 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:14.996198    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4897ec4-1197-42fe-ad3f-9020b6095ab5" containerName="istio-proxy"
Jul 24 16:27:14.998488 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:14.998463    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.002321 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.002297    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-a5fa08-openshift-default-dockercfg-zw452\""
Jul 24 16:27:15.013152 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.013126    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"]
Jul 24 16:27:15.042730 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.042694    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756274b7-921a-4fda-8618-403ddf10d71f-istio-token\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.042933 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.042803    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-istio-data\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.042933 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.042860    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756274b7-921a-4fda-8618-403ddf10d71f-istio-podinfo\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.042933 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.042887    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8qsb\" (UniqueName: \"kubernetes.io/projected/756274b7-921a-4fda-8618-403ddf10d71f-kube-api-access-d8qsb\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.043073 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.042957    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-credential-socket\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.043073 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.042994    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-workload-certs\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.043073 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.043049    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-workload-socket\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.043186 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.043077    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756274b7-921a-4fda-8618-403ddf10d71f-istiod-ca-cert\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.043186 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.043106    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-istio-envoy\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.144006 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.143959    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-credential-socket\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.144510 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.144031    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-workload-certs\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.144510 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.144088    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-workload-socket\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.144510 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.144110    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756274b7-921a-4fda-8618-403ddf10d71f-istiod-ca-cert\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.144510 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.144141    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-istio-envoy\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.144510 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.144196    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756274b7-921a-4fda-8618-403ddf10d71f-istio-token\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.144510 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.144234    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-istio-data\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.144510 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.144262    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756274b7-921a-4fda-8618-403ddf10d71f-istio-podinfo\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.144510 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.144284    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8qsb\" (UniqueName: \"kubernetes.io/projected/756274b7-921a-4fda-8618-403ddf10d71f-kube-api-access-d8qsb\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.144510 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.144447    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-credential-socket\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.144510 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.144461    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-workload-socket\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.144510 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.144498    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-workload-certs\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.145120 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.144714    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-istio-data\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.145178 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.145138    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756274b7-921a-4fda-8618-403ddf10d71f-istiod-ca-cert\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.146926 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.146906    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-istio-envoy\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.147346 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.147329    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756274b7-921a-4fda-8618-403ddf10d71f-istio-podinfo\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.154162 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.154124    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756274b7-921a-4fda-8618-403ddf10d71f-istio-token\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.154282 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.154190    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8qsb\" (UniqueName: \"kubernetes.io/projected/756274b7-921a-4fda-8618-403ddf10d71f-kube-api-access-d8qsb\") pod \"e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") " pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.309696 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.309577    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:15.447102 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.447060    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"]
Jul 24 16:27:15.449148 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:27:15.449125    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756274b7_921a_4fda_8618_403ddf10d71f.slice/crio-d036438f9a96470bd4129514a8310b329239d01d592f1b28e2f996d658ecddbd WatchSource:0}: Error finding container d036438f9a96470bd4129514a8310b329239d01d592f1b28e2f996d658ecddbd: Status 404 returned error can't find the container with id d036438f9a96470bd4129514a8310b329239d01d592f1b28e2f996d658ecddbd
Jul 24 16:27:15.451563 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.451531    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:27:15.451685 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.451635    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:27:15.451685 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:15.451666    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:27:16.050566 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:16.050528    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4" event={"ID":"756274b7-921a-4fda-8618-403ddf10d71f","Type":"ContainerStarted","Data":"1f2d807778771600b4d206246df17b94d85eb725c7eb61038e1fb238df905afd"}
Jul 24 16:27:16.050792 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:16.050595    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4" event={"ID":"756274b7-921a-4fda-8618-403ddf10d71f","Type":"ContainerStarted","Data":"d036438f9a96470bd4129514a8310b329239d01d592f1b28e2f996d658ecddbd"}
Jul 24 16:27:16.073227 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:16.073176    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4" podStartSLOduration=2.073161402 podStartE2EDuration="2.073161402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:27:16.071247139 +0000 UTC m=+2390.133696346" watchObservedRunningTime="2026-07-24 16:27:16.073161402 +0000 UTC m=+2390.135610589"
Jul 24 16:27:16.310470 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:16.310361    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:16.315374 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:16.315349    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:17.055669 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:17.055639    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:17.056558 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:17.056527    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:19.380998 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.380932    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:27:19.488186 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488148    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b628b10-da56-41a6-97e9-618a857f7838-istio-token\") pod \"0b628b10-da56-41a6-97e9-618a857f7838\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") "
Jul 24 16:27:19.488186 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488187    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-istio-envoy\") pod \"0b628b10-da56-41a6-97e9-618a857f7838\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") "
Jul 24 16:27:19.488440 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488209    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b628b10-da56-41a6-97e9-618a857f7838-istiod-ca-cert\") pod \"0b628b10-da56-41a6-97e9-618a857f7838\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") "
Jul 24 16:27:19.488440 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488224    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-credential-socket\") pod \"0b628b10-da56-41a6-97e9-618a857f7838\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") "
Jul 24 16:27:19.488440 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488257    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-workload-socket\") pod \"0b628b10-da56-41a6-97e9-618a857f7838\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") "
Jul 24 16:27:19.488440 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488292    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-workload-certs\") pod \"0b628b10-da56-41a6-97e9-618a857f7838\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") "
Jul 24 16:27:19.488440 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488341    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-istio-data\") pod \"0b628b10-da56-41a6-97e9-618a857f7838\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") "
Jul 24 16:27:19.488440 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488386    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5nxn\" (UniqueName: \"kubernetes.io/projected/0b628b10-da56-41a6-97e9-618a857f7838-kube-api-access-v5nxn\") pod \"0b628b10-da56-41a6-97e9-618a857f7838\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") "
Jul 24 16:27:19.488440 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488413    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b628b10-da56-41a6-97e9-618a857f7838-istio-podinfo\") pod \"0b628b10-da56-41a6-97e9-618a857f7838\" (UID: \"0b628b10-da56-41a6-97e9-618a857f7838\") "
Jul 24 16:27:19.488833 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488525    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0b628b10-da56-41a6-97e9-618a857f7838" (UID: "0b628b10-da56-41a6-97e9-618a857f7838"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:27:19.488833 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488641    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0b628b10-da56-41a6-97e9-618a857f7838" (UID: "0b628b10-da56-41a6-97e9-618a857f7838"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:27:19.488833 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488691    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b628b10-da56-41a6-97e9-618a857f7838-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0b628b10-da56-41a6-97e9-618a857f7838" (UID: "0b628b10-da56-41a6-97e9-618a857f7838"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:27:19.488993 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488827    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0b628b10-da56-41a6-97e9-618a857f7838" (UID: "0b628b10-da56-41a6-97e9-618a857f7838"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:27:19.488993 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488958    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b628b10-da56-41a6-97e9-618a857f7838-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:27:19.488993 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488976    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:27:19.488993 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.488990    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:27:19.489210 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.489003    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:27:19.489446 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.489417    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-istio-data" (OuterVolumeSpecName: "istio-data") pod "0b628b10-da56-41a6-97e9-618a857f7838" (UID: "0b628b10-da56-41a6-97e9-618a857f7838"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:27:19.490418 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.490392    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b628b10-da56-41a6-97e9-618a857f7838-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b628b10-da56-41a6-97e9-618a857f7838" (UID: "0b628b10-da56-41a6-97e9-618a857f7838"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:27:19.490635 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.490615    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0b628b10-da56-41a6-97e9-618a857f7838" (UID: "0b628b10-da56-41a6-97e9-618a857f7838"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:27:19.490719 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.490640    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b628b10-da56-41a6-97e9-618a857f7838-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0b628b10-da56-41a6-97e9-618a857f7838" (UID: "0b628b10-da56-41a6-97e9-618a857f7838"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:27:19.491119 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.491099    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b628b10-da56-41a6-97e9-618a857f7838-kube-api-access-v5nxn" (OuterVolumeSpecName: "kube-api-access-v5nxn") pod "0b628b10-da56-41a6-97e9-618a857f7838" (UID: "0b628b10-da56-41a6-97e9-618a857f7838"). InnerVolumeSpecName "kube-api-access-v5nxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:27:19.590094 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.590055    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b628b10-da56-41a6-97e9-618a857f7838-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:27:19.590094 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.590086    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:27:19.590094 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.590096    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b628b10-da56-41a6-97e9-618a857f7838-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:27:19.590094 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.590105    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5nxn\" (UniqueName: \"kubernetes.io/projected/0b628b10-da56-41a6-97e9-618a857f7838-kube-api-access-v5nxn\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:27:19.590378 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:19.590113    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b628b10-da56-41a6-97e9-618a857f7838-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:27:20.071676 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:20.071640    2553 generic.go:356] "Generic (PLEG): container finished" podID="0b628b10-da56-41a6-97e9-618a857f7838" containerID="28c8f6564e577a2de0af5da11b6ecbffb188d576456c3d52ee062e1c73f66ff6" exitCode=0
Jul 24 16:27:20.071868 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:20.071692    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"
Jul 24 16:27:20.071868 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:20.071725    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw" event={"ID":"0b628b10-da56-41a6-97e9-618a857f7838","Type":"ContainerDied","Data":"28c8f6564e577a2de0af5da11b6ecbffb188d576456c3d52ee062e1c73f66ff6"}
Jul 24 16:27:20.071868 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:20.071781    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw" event={"ID":"0b628b10-da56-41a6-97e9-618a857f7838","Type":"ContainerDied","Data":"bc3566dd3cc2ba087df64d6b54f7202b347713171771be0c76bf78e1ac79680f"}
Jul 24 16:27:20.071868 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:20.071803    2553 scope.go:117] "RemoveContainer" containerID="28c8f6564e577a2de0af5da11b6ecbffb188d576456c3d52ee062e1c73f66ff6"
Jul 24 16:27:20.081382 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:20.081363    2553 scope.go:117] "RemoveContainer" containerID="ba402c79b62b855766b36814be3dfc240432c4168dea2ee00fbee353de689a7d"
Jul 24 16:27:20.088988 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:20.088968    2553 scope.go:117] "RemoveContainer" containerID="28c8f6564e577a2de0af5da11b6ecbffb188d576456c3d52ee062e1c73f66ff6"
Jul 24 16:27:20.089247 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:27:20.089226    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28c8f6564e577a2de0af5da11b6ecbffb188d576456c3d52ee062e1c73f66ff6\": container with ID starting with 28c8f6564e577a2de0af5da11b6ecbffb188d576456c3d52ee062e1c73f66ff6 not found: ID does not exist" containerID="28c8f6564e577a2de0af5da11b6ecbffb188d576456c3d52ee062e1c73f66ff6"
Jul 24 16:27:20.089311 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:20.089256    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28c8f6564e577a2de0af5da11b6ecbffb188d576456c3d52ee062e1c73f66ff6"} err="failed to get container status \"28c8f6564e577a2de0af5da11b6ecbffb188d576456c3d52ee062e1c73f66ff6\": rpc error: code = NotFound desc = could not find container \"28c8f6564e577a2de0af5da11b6ecbffb188d576456c3d52ee062e1c73f66ff6\": container with ID starting with 28c8f6564e577a2de0af5da11b6ecbffb188d576456c3d52ee062e1c73f66ff6 not found: ID does not exist"
Jul 24 16:27:20.089311 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:20.089273    2553 scope.go:117] "RemoveContainer" containerID="ba402c79b62b855766b36814be3dfc240432c4168dea2ee00fbee353de689a7d"
Jul 24 16:27:20.089484 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:27:20.089470    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba402c79b62b855766b36814be3dfc240432c4168dea2ee00fbee353de689a7d\": container with ID starting with ba402c79b62b855766b36814be3dfc240432c4168dea2ee00fbee353de689a7d not found: ID does not exist" containerID="ba402c79b62b855766b36814be3dfc240432c4168dea2ee00fbee353de689a7d"
Jul 24 16:27:20.089525 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:20.089487    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba402c79b62b855766b36814be3dfc240432c4168dea2ee00fbee353de689a7d"} err="failed to get container status \"ba402c79b62b855766b36814be3dfc240432c4168dea2ee00fbee353de689a7d\": rpc error: code = NotFound desc = could not find container \"ba402c79b62b855766b36814be3dfc240432c4168dea2ee00fbee353de689a7d\": container with ID starting with ba402c79b62b855766b36814be3dfc240432c4168dea2ee00fbee353de689a7d not found: ID does not exist"
Jul 24 16:27:20.097378 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:20.097351    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"]
Jul 24 16:27:20.102632 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:20.102602    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-2c74ca-openshift-default-fd7df8c86-cdtcw"]
Jul 24 16:27:20.475326 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:20.475243    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b628b10-da56-41a6-97e9-618a857f7838" path="/var/lib/kubelet/pods/0b628b10-da56-41a6-97e9-618a857f7838/volumes"
Jul 24 16:27:23.090015 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.089973    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"]
Jul 24 16:27:23.090556 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.090536    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b628b10-da56-41a6-97e9-618a857f7838" containerName="istio-proxy"
Jul 24 16:27:23.090676 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.090559    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b628b10-da56-41a6-97e9-618a857f7838" containerName="istio-proxy"
Jul 24 16:27:23.090735 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.090693    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b628b10-da56-41a6-97e9-618a857f7838" containerName="istio-proxy"
Jul 24 16:27:23.093837 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.093807    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.096950 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.096927    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-675edf-openshift-default-dockercfg-sc472\""
Jul 24 16:27:23.110099 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.110058    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"]
Jul 24 16:27:23.125042 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.124993    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-token\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.125236 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.125057    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-credential-socket\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.125236 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.125086    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-workload-certs\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.125236 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.125144    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhcxq\" (UniqueName: \"kubernetes.io/projected/44a17560-764b-43b8-a613-d1a5cbb7c11e-kube-api-access-qhcxq\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.125236 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.125195    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-workload-socket\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.125236 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.125220    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-podinfo\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.125534 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.125292    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-envoy\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.125534 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.125321    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-data\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.125534 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.125368    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44a17560-764b-43b8-a613-d1a5cbb7c11e-istiod-ca-cert\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.226018 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.225981    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-token\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.226221 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.226035    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-credential-socket\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.226221 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.226063    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-workload-certs\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.226221 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.226092    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhcxq\" (UniqueName: \"kubernetes.io/projected/44a17560-764b-43b8-a613-d1a5cbb7c11e-kube-api-access-qhcxq\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.226221 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.226123    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-workload-socket\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.226221 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.226145    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-podinfo\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.226221 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.226210    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-envoy\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.226531 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.226242    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-data\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.226531 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.226290    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44a17560-764b-43b8-a613-d1a5cbb7c11e-istiod-ca-cert\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.226627 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.226526    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-credential-socket\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.226717 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.226693    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-workload-certs\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.226848 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.226828    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-workload-socket\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.226909 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.226844    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-data\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.227064 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.227041    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44a17560-764b-43b8-a613-d1a5cbb7c11e-istiod-ca-cert\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.228524 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.228505    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-envoy\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.228965 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.228942    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-podinfo\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.240345 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.240315    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhcxq\" (UniqueName: \"kubernetes.io/projected/44a17560-764b-43b8-a613-d1a5cbb7c11e-kube-api-access-qhcxq\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.250644 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.250553    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-token\") pod \"e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") " pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.405408 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.405311    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:23.623960 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.623936    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"]
Jul 24 16:27:23.625892 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:27:23.625859    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a17560_764b_43b8_a613_d1a5cbb7c11e.slice/crio-d02766b5dcb0e88d676e5ab80abf2431e4803ad08b606e5d95b3c1ae1098603f WatchSource:0}: Error finding container d02766b5dcb0e88d676e5ab80abf2431e4803ad08b606e5d95b3c1ae1098603f: Status 404 returned error can't find the container with id d02766b5dcb0e88d676e5ab80abf2431e4803ad08b606e5d95b3c1ae1098603f
Jul 24 16:27:23.628022 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.627991    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:27:23.628129 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.628070    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:27:23.628129 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:23.628111    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:27:24.095033 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:24.095001    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w" event={"ID":"44a17560-764b-43b8-a613-d1a5cbb7c11e","Type":"ContainerStarted","Data":"ff9781822f8550c8b902d55fa7a47cf9a89c7ea669cb5b897b726c5965d98572"}
Jul 24 16:27:24.095431 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:24.095057    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w" event={"ID":"44a17560-764b-43b8-a613-d1a5cbb7c11e","Type":"ContainerStarted","Data":"d02766b5dcb0e88d676e5ab80abf2431e4803ad08b606e5d95b3c1ae1098603f"}
Jul 24 16:27:24.114548 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:24.114485    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w" podStartSLOduration=1.114464951 podStartE2EDuration="1.114464951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:27:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:27:24.113889632 +0000 UTC m=+2398.176338820" watchObservedRunningTime="2026-07-24 16:27:24.114464951 +0000 UTC m=+2398.176914141"
Jul 24 16:27:24.406314 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:24.406224    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:24.411239 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:24.411210    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:25.100950 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:25.100915    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:25.101983 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:25.101962    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:26.722002 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:26.721972    2553 scope.go:117] "RemoveContainer" containerID="3a5d10e6c8bf52d3c2925bb913b22204ba5647bd6c94098c9e087d95ee4c6c1f"
Jul 24 16:27:30.127954 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:30.127871    2553 generic.go:356] "Generic (PLEG): container finished" podID="756274b7-921a-4fda-8618-403ddf10d71f" containerID="1f2d807778771600b4d206246df17b94d85eb725c7eb61038e1fb238df905afd" exitCode=0
Jul 24 16:27:30.127954 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:30.127941    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4" event={"ID":"756274b7-921a-4fda-8618-403ddf10d71f","Type":"ContainerDied","Data":"1f2d807778771600b4d206246df17b94d85eb725c7eb61038e1fb238df905afd"}
Jul 24 16:27:30.128393 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:30.128347    2553 scope.go:117] "RemoveContainer" containerID="1f2d807778771600b4d206246df17b94d85eb725c7eb61038e1fb238df905afd"
Jul 24 16:27:30.129451 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:30.129423    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:27:30.129512 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:30.129491    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:27:30.129560 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:30.129523    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:27:31.134675 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:31.134635    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4" event={"ID":"756274b7-921a-4fda-8618-403ddf10d71f","Type":"ContainerStarted","Data":"9cf234471200f442e911bd17eac770b3d729d542aff9d8bd78e77db6c1a0205e"}
Jul 24 16:27:31.309778 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:31.309741    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:31.310749 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:31.310723    2553 patch_prober.go:28] interesting pod/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 24 16:27:31.310859 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:31.310771    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4" podUID="756274b7-921a-4fda-8618-403ddf10d71f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 24 16:27:32.055777 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:32.055736    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:32.310793 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:32.310699    2553 patch_prober.go:28] interesting pod/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 24 16:27:32.310793 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:32.310761    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4" podUID="756274b7-921a-4fda-8618-403ddf10d71f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 24 16:27:33.310484 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:33.310445    2553 patch_prober.go:28] interesting pod/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 24 16:27:33.310682 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:33.310514    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4" podUID="756274b7-921a-4fda-8618-403ddf10d71f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 24 16:27:34.310287 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:34.310245    2553 patch_prober.go:28] interesting pod/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 24 16:27:34.310749 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:34.310309    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4" podUID="756274b7-921a-4fda-8618-403ddf10d71f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 24 16:27:35.313903 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:35.313871    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:35.320721 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:35.315270    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:27:39.399909 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.399871    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"]
Jul 24 16:27:39.400300 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.400279    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b628b10-da56-41a6-97e9-618a857f7838" containerName="istio-proxy"
Jul 24 16:27:39.400300 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.400290    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b628b10-da56-41a6-97e9-618a857f7838" containerName="istio-proxy"
Jul 24 16:27:39.400382 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.400371    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b628b10-da56-41a6-97e9-618a857f7838" containerName="istio-proxy"
Jul 24 16:27:39.402573 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.402556    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.407197 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.407165    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a5fa08\"/\"default-dockercfg-drx6f\""
Jul 24 16:27:39.407197 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.407171    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a5fa08\"/\"auth-test-model-a5fa08-kserve-self-signed-certs\""
Jul 24 16:27:39.407425 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.407171    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a5fa08\"/\"kube-root-ca.crt\""
Jul 24 16:27:39.407425 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.407194    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a5fa08\"/\"openshift-service-ca.crt\""
Jul 24 16:27:39.411856 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.411831    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"]
Jul 24 16:27:39.504403 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.504368    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-model-cache\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.504566 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.504429    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-tmp-dir\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.504566 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.504487    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4zd6\" (UniqueName: \"kubernetes.io/projected/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-kube-api-access-w4zd6\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.504566 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.504509    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-dshm\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.504712 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.504581    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-tls-certs\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.504712 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.504644    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-home\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.605798 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.605757    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-model-cache\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.605980 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.605820    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-tmp-dir\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.605980 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.605860    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4zd6\" (UniqueName: \"kubernetes.io/projected/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-kube-api-access-w4zd6\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.605980 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.605878    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-dshm\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.605980 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.605919    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-tls-certs\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.606180 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.606123    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-home\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.606252 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.606224    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-model-cache\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.606311 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.606292    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-tmp-dir\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.606456 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.606429    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-home\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.608232 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.608203    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-dshm\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.608321 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.608302    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-tls-certs\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.614494 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.614475    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4zd6\" (UniqueName: \"kubernetes.io/projected/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-kube-api-access-w4zd6\") pod \"auth-test-model-a5fa08-kserve-58458db58c-scjgn\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") " pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.713487 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.713389    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:39.904810 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:39.904782    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"]
Jul 24 16:27:39.906466 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:27:39.906435    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c5290ab_4df6_4dc6_9ee9_7b0f3526333f.slice/crio-884d1860137229ce9c6c4d903d806d89da816745accafdeb566fec2425379378 WatchSource:0}: Error finding container 884d1860137229ce9c6c4d903d806d89da816745accafdeb566fec2425379378: Status 404 returned error can't find the container with id 884d1860137229ce9c6c4d903d806d89da816745accafdeb566fec2425379378
Jul 24 16:27:40.189576 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:40.189536    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn" event={"ID":"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f","Type":"ContainerStarted","Data":"0b5f07a030523d92742ac5af9d396745bbeb0cfb49a6c9e97ed692af11993a32"}
Jul 24 16:27:40.189766 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:40.189613    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn" event={"ID":"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f","Type":"ContainerStarted","Data":"884d1860137229ce9c6c4d903d806d89da816745accafdeb566fec2425379378"}
Jul 24 16:27:40.209431 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:40.209383    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn" podStartSLOduration=1.209367994 podStartE2EDuration="1.209367994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:27:40.207636314 +0000 UTC m=+2414.270085511" watchObservedRunningTime="2026-07-24 16:27:40.209367994 +0000 UTC m=+2414.271817219"
Jul 24 16:27:45.217500 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:45.217460    2553 generic.go:356] "Generic (PLEG): container finished" podID="44a17560-764b-43b8-a613-d1a5cbb7c11e" containerID="ff9781822f8550c8b902d55fa7a47cf9a89c7ea669cb5b897b726c5965d98572" exitCode=0
Jul 24 16:27:45.218007 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:45.217531    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w" event={"ID":"44a17560-764b-43b8-a613-d1a5cbb7c11e","Type":"ContainerDied","Data":"ff9781822f8550c8b902d55fa7a47cf9a89c7ea669cb5b897b726c5965d98572"}
Jul 24 16:27:45.218007 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:45.217965    2553 scope.go:117] "RemoveContainer" containerID="ff9781822f8550c8b902d55fa7a47cf9a89c7ea669cb5b897b726c5965d98572"
Jul 24 16:27:45.218983 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:45.218956    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:27:45.219071 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:45.219032    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:27:45.219071 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:45.219065    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:27:46.225374 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:46.225340    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w" event={"ID":"44a17560-764b-43b8-a613-d1a5cbb7c11e","Type":"ContainerStarted","Data":"fb2dbf1012acd91a25cfb08e21bb49b8b49c9b117ac0078f93617cdef61d03a3"}
Jul 24 16:27:46.405860 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:46.405823    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:46.406077 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:46.406060    2553 patch_prober.go:28] interesting pod/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 24 16:27:46.406131 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:46.406113    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w" podUID="44a17560-764b-43b8-a613-d1a5cbb7c11e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 24 16:27:47.406153 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:47.406115    2553 patch_prober.go:28] interesting pod/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 24 16:27:47.406563 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:47.406187    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w" podUID="44a17560-764b-43b8-a613-d1a5cbb7c11e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 24 16:27:48.406219 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:48.406132    2553 patch_prober.go:28] interesting pod/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 24 16:27:48.406219 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:48.406194    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w" podUID="44a17560-764b-43b8-a613-d1a5cbb7c11e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 24 16:27:49.405759 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:49.405722    2553 patch_prober.go:28] interesting pod/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 24 16:27:49.405937 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:49.405786    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w" podUID="44a17560-764b-43b8-a613-d1a5cbb7c11e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 24 16:27:49.713650 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:49.713528    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:49.713650 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:49.713603    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:49.726661 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:49.726633    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:50.259932 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:50.259900    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:27:50.409769 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:50.409738    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:50.410027 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:50.410006    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:27:50.410739 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:27:50.410720    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:32:36.949139 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:36.949052    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"]
Jul 24 16:32:51.802062 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.802020    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"]
Jul 24 16:32:51.805764 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.805742    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.808449 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.808424    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a5fa08\"/\"sub-test-model-a5fa08-kserve-self-signed-certs\""
Jul 24 16:32:51.814050 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.814025    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"]
Jul 24 16:32:51.869243 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.869210    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-model-cache\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.869416 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.869253    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-home\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.869416 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.869286    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97541014-c3dd-42aa-9a7d-20e7e7d40603-tls-certs\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.869416 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.869321    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9m52\" (UniqueName: \"kubernetes.io/projected/97541014-c3dd-42aa-9a7d-20e7e7d40603-kube-api-access-s9m52\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.869416 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.869346    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-tmp-dir\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.869571 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.869421    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-dshm\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.968159 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.968119    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn" podUID="3c5290ab-4df6-4dc6-9ee9-7b0f3526333f" containerName="main" containerID="cri-o://0b5f07a030523d92742ac5af9d396745bbeb0cfb49a6c9e97ed692af11993a32" gracePeriod=45
Jul 24 16:32:51.971055 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.971028    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-model-cache\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.971200 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.971170    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-home\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.971261 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.971247    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97541014-c3dd-42aa-9a7d-20e7e7d40603-tls-certs\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.971309 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.971279    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9m52\" (UniqueName: \"kubernetes.io/projected/97541014-c3dd-42aa-9a7d-20e7e7d40603-kube-api-access-s9m52\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.971363 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.971323    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-tmp-dir\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.971417 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.971364    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-model-cache\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.971417 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.971386    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-dshm\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.971523 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.971485    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-home\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.971681 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.971655    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-tmp-dir\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.973621 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.973573    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-dshm\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.974032 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.974013    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97541014-c3dd-42aa-9a7d-20e7e7d40603-tls-certs\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:51.980035 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:51.980009    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9m52\" (UniqueName: \"kubernetes.io/projected/97541014-c3dd-42aa-9a7d-20e7e7d40603-kube-api-access-s9m52\") pod \"sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") " pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:52.115987 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.115947    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:32:52.241606 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.241563    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:32:52.274608 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.274560    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"]
Jul 24 16:32:52.275631 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:32:52.275578    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97541014_c3dd_42aa_9a7d_20e7e7d40603.slice/crio-e1537ef7370933b7720ba221e0f522781362300b012dc3149ee79b74fe68243a WatchSource:0}: Error finding container e1537ef7370933b7720ba221e0f522781362300b012dc3149ee79b74fe68243a: Status 404 returned error can't find the container with id e1537ef7370933b7720ba221e0f522781362300b012dc3149ee79b74fe68243a
Jul 24 16:32:52.376475 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.376381    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-tls-certs\") pod \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") "
Jul 24 16:32:52.376475 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.376468    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-dshm\") pod \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") "
Jul 24 16:32:52.376695 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.376543    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4zd6\" (UniqueName: \"kubernetes.io/projected/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-kube-api-access-w4zd6\") pod \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") "
Jul 24 16:32:52.376695 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.376577    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-home\") pod \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") "
Jul 24 16:32:52.376805 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.376763    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-tmp-dir\") pod \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") "
Jul 24 16:32:52.376805 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.376793    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-home" (OuterVolumeSpecName: "home") pod "3c5290ab-4df6-4dc6-9ee9-7b0f3526333f" (UID: "3c5290ab-4df6-4dc6-9ee9-7b0f3526333f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:32:52.376911 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.376830    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-model-cache\") pod \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\" (UID: \"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f\") "
Jul 24 16:32:52.377035 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.376988    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3c5290ab-4df6-4dc6-9ee9-7b0f3526333f" (UID: "3c5290ab-4df6-4dc6-9ee9-7b0f3526333f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:32:52.377035 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.377020    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-model-cache" (OuterVolumeSpecName: "model-cache") pod "3c5290ab-4df6-4dc6-9ee9-7b0f3526333f" (UID: "3c5290ab-4df6-4dc6-9ee9-7b0f3526333f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:32:52.377247 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.377230    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-home\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:32:52.377305 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.377253    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-tmp-dir\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:32:52.377305 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.377268    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-model-cache\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:32:52.378806 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.378780    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-dshm" (OuterVolumeSpecName: "dshm") pod "3c5290ab-4df6-4dc6-9ee9-7b0f3526333f" (UID: "3c5290ab-4df6-4dc6-9ee9-7b0f3526333f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:32:52.379014 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.378997    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3c5290ab-4df6-4dc6-9ee9-7b0f3526333f" (UID: "3c5290ab-4df6-4dc6-9ee9-7b0f3526333f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:32:52.379066 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.379026    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-kube-api-access-w4zd6" (OuterVolumeSpecName: "kube-api-access-w4zd6") pod "3c5290ab-4df6-4dc6-9ee9-7b0f3526333f" (UID: "3c5290ab-4df6-4dc6-9ee9-7b0f3526333f"). InnerVolumeSpecName "kube-api-access-w4zd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:32:52.477822 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.477790    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-dshm\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:32:52.477822 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.477819    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4zd6\" (UniqueName: \"kubernetes.io/projected/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-kube-api-access-w4zd6\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:32:52.478030 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.477835    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f-tls-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:32:52.768600 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.768555    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf" event={"ID":"97541014-c3dd-42aa-9a7d-20e7e7d40603","Type":"ContainerStarted","Data":"fe21a1ebdd8ee72066172238eb76e424f29ed436022df58c8ac2b04aa25f8d57"}
Jul 24 16:32:52.768818 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.768608    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf" event={"ID":"97541014-c3dd-42aa-9a7d-20e7e7d40603","Type":"ContainerStarted","Data":"e1537ef7370933b7720ba221e0f522781362300b012dc3149ee79b74fe68243a"}
Jul 24 16:32:52.769839 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.769815    2553 generic.go:356] "Generic (PLEG): container finished" podID="3c5290ab-4df6-4dc6-9ee9-7b0f3526333f" containerID="0b5f07a030523d92742ac5af9d396745bbeb0cfb49a6c9e97ed692af11993a32" exitCode=0
Jul 24 16:32:52.769947 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.769861    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"
Jul 24 16:32:52.769947 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.769898    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn" event={"ID":"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f","Type":"ContainerDied","Data":"0b5f07a030523d92742ac5af9d396745bbeb0cfb49a6c9e97ed692af11993a32"}
Jul 24 16:32:52.769947 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.769935    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn" event={"ID":"3c5290ab-4df6-4dc6-9ee9-7b0f3526333f","Type":"ContainerDied","Data":"884d1860137229ce9c6c4d903d806d89da816745accafdeb566fec2425379378"}
Jul 24 16:32:52.770076 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.769952    2553 scope.go:117] "RemoveContainer" containerID="0b5f07a030523d92742ac5af9d396745bbeb0cfb49a6c9e97ed692af11993a32"
Jul 24 16:32:52.778381 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.778362    2553 scope.go:117] "RemoveContainer" containerID="0b5f07a030523d92742ac5af9d396745bbeb0cfb49a6c9e97ed692af11993a32"
Jul 24 16:32:52.778720 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:32:52.778694    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b5f07a030523d92742ac5af9d396745bbeb0cfb49a6c9e97ed692af11993a32\": container with ID starting with 0b5f07a030523d92742ac5af9d396745bbeb0cfb49a6c9e97ed692af11993a32 not found: ID does not exist" containerID="0b5f07a030523d92742ac5af9d396745bbeb0cfb49a6c9e97ed692af11993a32"
Jul 24 16:32:52.778817 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.778721    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b5f07a030523d92742ac5af9d396745bbeb0cfb49a6c9e97ed692af11993a32"} err="failed to get container status \"0b5f07a030523d92742ac5af9d396745bbeb0cfb49a6c9e97ed692af11993a32\": rpc error: code = NotFound desc = could not find container \"0b5f07a030523d92742ac5af9d396745bbeb0cfb49a6c9e97ed692af11993a32\": container with ID starting with 0b5f07a030523d92742ac5af9d396745bbeb0cfb49a6c9e97ed692af11993a32 not found: ID does not exist"
Jul 24 16:32:52.787893 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.787846    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf" podStartSLOduration=1.787831344 podStartE2EDuration="1.787831344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:32:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:32:52.785159303 +0000 UTC m=+2726.847608490" watchObservedRunningTime="2026-07-24 16:32:52.787831344 +0000 UTC m=+2726.850280531"
Jul 24 16:32:52.808397 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.808359    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"]
Jul 24 16:32:52.813034 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:52.813003    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/auth-test-model-a5fa08-kserve-58458db58c-scjgn"]
Jul 24 16:32:54.475414 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:32:54.475383    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c5290ab-4df6-4dc6-9ee9-7b0f3526333f" path="/var/lib/kubelet/pods/3c5290ab-4df6-4dc6-9ee9-7b0f3526333f/volumes"
Jul 24 16:33:02.116927 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:33:02.116882    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:33:02.117340 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:33:02.116944    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:33:02.129242 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:33:02.129210    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:33:02.840863 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:33:02.840826    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:34:42.212855 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:42.212822    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"]
Jul 24 16:34:57.232124 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.232060    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf" podUID="97541014-c3dd-42aa-9a7d-20e7e7d40603" containerName="main" containerID="cri-o://fe21a1ebdd8ee72066172238eb76e424f29ed436022df58c8ac2b04aa25f8d57" gracePeriod=45
Jul 24 16:34:57.418634 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.418578    2553 generic.go:356] "Generic (PLEG): container finished" podID="97541014-c3dd-42aa-9a7d-20e7e7d40603" containerID="fe21a1ebdd8ee72066172238eb76e424f29ed436022df58c8ac2b04aa25f8d57" exitCode=0
Jul 24 16:34:57.418634 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.418622    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf" event={"ID":"97541014-c3dd-42aa-9a7d-20e7e7d40603","Type":"ContainerDied","Data":"fe21a1ebdd8ee72066172238eb76e424f29ed436022df58c8ac2b04aa25f8d57"}
Jul 24 16:34:57.487152 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.487087    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:34:57.592155 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.592124    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-tmp-dir\") pod \"97541014-c3dd-42aa-9a7d-20e7e7d40603\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") "
Jul 24 16:34:57.592348 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.592183    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-dshm\") pod \"97541014-c3dd-42aa-9a7d-20e7e7d40603\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") "
Jul 24 16:34:57.592348 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.592215    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-home\") pod \"97541014-c3dd-42aa-9a7d-20e7e7d40603\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") "
Jul 24 16:34:57.592348 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.592270    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9m52\" (UniqueName: \"kubernetes.io/projected/97541014-c3dd-42aa-9a7d-20e7e7d40603-kube-api-access-s9m52\") pod \"97541014-c3dd-42aa-9a7d-20e7e7d40603\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") "
Jul 24 16:34:57.592348 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.592318    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97541014-c3dd-42aa-9a7d-20e7e7d40603-tls-certs\") pod \"97541014-c3dd-42aa-9a7d-20e7e7d40603\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") "
Jul 24 16:34:57.592621 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.592349    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-model-cache\") pod \"97541014-c3dd-42aa-9a7d-20e7e7d40603\" (UID: \"97541014-c3dd-42aa-9a7d-20e7e7d40603\") "
Jul 24 16:34:57.592621 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.592431    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "97541014-c3dd-42aa-9a7d-20e7e7d40603" (UID: "97541014-c3dd-42aa-9a7d-20e7e7d40603"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:34:57.592741 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.592678    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-model-cache" (OuterVolumeSpecName: "model-cache") pod "97541014-c3dd-42aa-9a7d-20e7e7d40603" (UID: "97541014-c3dd-42aa-9a7d-20e7e7d40603"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:34:57.592741 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.592689    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-home" (OuterVolumeSpecName: "home") pod "97541014-c3dd-42aa-9a7d-20e7e7d40603" (UID: "97541014-c3dd-42aa-9a7d-20e7e7d40603"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:34:57.592836 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.592735    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-tmp-dir\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:34:57.594481 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.594456    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97541014-c3dd-42aa-9a7d-20e7e7d40603-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "97541014-c3dd-42aa-9a7d-20e7e7d40603" (UID: "97541014-c3dd-42aa-9a7d-20e7e7d40603"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:34:57.594765 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.594743    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-dshm" (OuterVolumeSpecName: "dshm") pod "97541014-c3dd-42aa-9a7d-20e7e7d40603" (UID: "97541014-c3dd-42aa-9a7d-20e7e7d40603"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:34:57.594847 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.594820    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97541014-c3dd-42aa-9a7d-20e7e7d40603-kube-api-access-s9m52" (OuterVolumeSpecName: "kube-api-access-s9m52") pod "97541014-c3dd-42aa-9a7d-20e7e7d40603" (UID: "97541014-c3dd-42aa-9a7d-20e7e7d40603"). InnerVolumeSpecName "kube-api-access-s9m52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:34:57.693575 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.693530    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9m52\" (UniqueName: \"kubernetes.io/projected/97541014-c3dd-42aa-9a7d-20e7e7d40603-kube-api-access-s9m52\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:34:57.693575 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.693568    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97541014-c3dd-42aa-9a7d-20e7e7d40603-tls-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:34:57.693575 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.693600    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-model-cache\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:34:57.693836 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.693611    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-dshm\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:34:57.693836 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:57.693622    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97541014-c3dd-42aa-9a7d-20e7e7d40603-home\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:34:58.424901 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:58.424867    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"
Jul 24 16:34:58.425387 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:58.424870    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf" event={"ID":"97541014-c3dd-42aa-9a7d-20e7e7d40603","Type":"ContainerDied","Data":"e1537ef7370933b7720ba221e0f522781362300b012dc3149ee79b74fe68243a"}
Jul 24 16:34:58.425387 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:58.424998    2553 scope.go:117] "RemoveContainer" containerID="fe21a1ebdd8ee72066172238eb76e424f29ed436022df58c8ac2b04aa25f8d57"
Jul 24 16:34:58.448105 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:58.448076    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"]
Jul 24 16:34:58.452240 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:58.452203    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/sub-test-model-a5fa08-kserve-55c4f5f869-b7nwf"]
Jul 24 16:34:58.475352 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:34:58.475317    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97541014-c3dd-42aa-9a7d-20e7e7d40603" path="/var/lib/kubelet/pods/97541014-c3dd-42aa-9a7d-20e7e7d40603/volumes"
Jul 24 16:35:04.507799 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.507767    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"]
Jul 24 16:35:04.508243 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.508187    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97541014-c3dd-42aa-9a7d-20e7e7d40603" containerName="main"
Jul 24 16:35:04.508243 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.508200    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="97541014-c3dd-42aa-9a7d-20e7e7d40603" containerName="main"
Jul 24 16:35:04.508243 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.508214    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c5290ab-4df6-4dc6-9ee9-7b0f3526333f" containerName="main"
Jul 24 16:35:04.508243 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.508220    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c5290ab-4df6-4dc6-9ee9-7b0f3526333f" containerName="main"
Jul 24 16:35:04.508378 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.508273    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c5290ab-4df6-4dc6-9ee9-7b0f3526333f" containerName="main"
Jul 24 16:35:04.508378 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.508280    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="97541014-c3dd-42aa-9a7d-20e7e7d40603" containerName="main"
Jul 24 16:35:04.512932 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.512914    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.517139 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.517075    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a5fa08\"/\"default-dockercfg-drx6f\""
Jul 24 16:35:04.517139 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.517085    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a5fa08\"/\"kube-root-ca.crt\""
Jul 24 16:35:04.517139 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.517120    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a5fa08\"/\"rate-test-model-a5fa08-kserve-self-signed-certs\""
Jul 24 16:35:04.517434 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.517123    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a5fa08\"/\"openshift-service-ca.crt\""
Jul 24 16:35:04.521054 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.521031    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"]
Jul 24 16:35:04.663488 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.663454    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-dshm\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.663698 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.663506    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-home\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.663698 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.663573    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwgmj\" (UniqueName: \"kubernetes.io/projected/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-kube-api-access-qwgmj\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.663698 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.663677    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-model-cache\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.663831 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.663761    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-tmp-dir\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.663831 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.663786    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-tls-certs\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.765019 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.764930    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-model-cache\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.765178 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.765080    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-tmp-dir\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.765178 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.765101    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-tls-certs\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.765178 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.765131    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-dshm\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.765178 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.765174    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-home\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.765351 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.765204    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwgmj\" (UniqueName: \"kubernetes.io/projected/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-kube-api-access-qwgmj\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.765421 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.765396    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-model-cache\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.765466 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.765414    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-tmp-dir\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.765635 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.765576    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-home\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.767329 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.767310    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-dshm\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.767612 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.767577    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-tls-certs\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.775088 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.775064    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwgmj\" (UniqueName: \"kubernetes.io/projected/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-kube-api-access-qwgmj\") pod \"rate-test-model-a5fa08-kserve-59477ddc87-bxtw2\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") " pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.823993 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.823951    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:04.966519 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:04.966494    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"]
Jul 24 16:35:04.969412 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:35:04.969372    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca9feaf2_1d18_4ecc_a21a_e75902d4e611.slice/crio-717bcfb98e1f2b9b7c7f3fcce0591b0ce44bacc3573c63624c5615d2ac98df74 WatchSource:0}: Error finding container 717bcfb98e1f2b9b7c7f3fcce0591b0ce44bacc3573c63624c5615d2ac98df74: Status 404 returned error can't find the container with id 717bcfb98e1f2b9b7c7f3fcce0591b0ce44bacc3573c63624c5615d2ac98df74
Jul 24 16:35:05.461141 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:05.461049    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2" event={"ID":"ca9feaf2-1d18-4ecc-a21a-e75902d4e611","Type":"ContainerStarted","Data":"261a937ee445af8702625afe033f9d6bdcc5944bbbe7031ed792f89b4bb2161c"}
Jul 24 16:35:05.461141 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:05.461092    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2" event={"ID":"ca9feaf2-1d18-4ecc-a21a-e75902d4e611","Type":"ContainerStarted","Data":"717bcfb98e1f2b9b7c7f3fcce0591b0ce44bacc3573c63624c5615d2ac98df74"}
Jul 24 16:35:05.485605 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:05.485527    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2" podStartSLOduration=1.4855118379999999 podStartE2EDuration="1.485511838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:35:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:35:05.484184186 +0000 UTC m=+2859.546633372" watchObservedRunningTime="2026-07-24 16:35:05.485511838 +0000 UTC m=+2859.547961025"
Jul 24 16:35:14.824256 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:14.824214    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:14.824844 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:14.824307    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:14.837150 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:14.837120    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:35:15.522018 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:35:15.521990    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:36:37.724835 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:37.724790    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"]
Jul 24 16:36:52.746440 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:52.746311    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2" podUID="ca9feaf2-1d18-4ecc-a21a-e75902d4e611" containerName="main" containerID="cri-o://261a937ee445af8702625afe033f9d6bdcc5944bbbe7031ed792f89b4bb2161c" gracePeriod=45
Jul 24 16:36:53.004041 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.003966    2553 generic.go:356] "Generic (PLEG): container finished" podID="ca9feaf2-1d18-4ecc-a21a-e75902d4e611" containerID="261a937ee445af8702625afe033f9d6bdcc5944bbbe7031ed792f89b4bb2161c" exitCode=0
Jul 24 16:36:53.004174 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.004033    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2" event={"ID":"ca9feaf2-1d18-4ecc-a21a-e75902d4e611","Type":"ContainerDied","Data":"261a937ee445af8702625afe033f9d6bdcc5944bbbe7031ed792f89b4bb2161c"}
Jul 24 16:36:53.004174 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.004072    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2" event={"ID":"ca9feaf2-1d18-4ecc-a21a-e75902d4e611","Type":"ContainerDied","Data":"717bcfb98e1f2b9b7c7f3fcce0591b0ce44bacc3573c63624c5615d2ac98df74"}
Jul 24 16:36:53.004174 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.004083    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="717bcfb98e1f2b9b7c7f3fcce0591b0ce44bacc3573c63624c5615d2ac98df74"
Jul 24 16:36:53.005692 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.005674    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:36:53.125835 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.125796    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-dshm\") pod \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") "
Jul 24 16:36:53.125835 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.125836    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-home\") pod \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") "
Jul 24 16:36:53.126104 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.125863    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-tmp-dir\") pod \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") "
Jul 24 16:36:53.126104 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.125905    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwgmj\" (UniqueName: \"kubernetes.io/projected/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-kube-api-access-qwgmj\") pod \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") "
Jul 24 16:36:53.126104 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.125935    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-tls-certs\") pod \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") "
Jul 24 16:36:53.126104 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.126029    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-model-cache\") pod \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\" (UID: \"ca9feaf2-1d18-4ecc-a21a-e75902d4e611\") "
Jul 24 16:36:53.126308 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.126154    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ca9feaf2-1d18-4ecc-a21a-e75902d4e611" (UID: "ca9feaf2-1d18-4ecc-a21a-e75902d4e611"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:36:53.126308 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.126168    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-home" (OuterVolumeSpecName: "home") pod "ca9feaf2-1d18-4ecc-a21a-e75902d4e611" (UID: "ca9feaf2-1d18-4ecc-a21a-e75902d4e611"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:36:53.126389 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.126354    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-model-cache" (OuterVolumeSpecName: "model-cache") pod "ca9feaf2-1d18-4ecc-a21a-e75902d4e611" (UID: "ca9feaf2-1d18-4ecc-a21a-e75902d4e611"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:36:53.126455 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.126438    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-home\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:36:53.126505 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.126461    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-tmp-dir\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:36:53.128236 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.128202    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ca9feaf2-1d18-4ecc-a21a-e75902d4e611" (UID: "ca9feaf2-1d18-4ecc-a21a-e75902d4e611"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:36:53.128358 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.128236    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-kube-api-access-qwgmj" (OuterVolumeSpecName: "kube-api-access-qwgmj") pod "ca9feaf2-1d18-4ecc-a21a-e75902d4e611" (UID: "ca9feaf2-1d18-4ecc-a21a-e75902d4e611"). InnerVolumeSpecName "kube-api-access-qwgmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:36:53.128358 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.128335    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-dshm" (OuterVolumeSpecName: "dshm") pod "ca9feaf2-1d18-4ecc-a21a-e75902d4e611" (UID: "ca9feaf2-1d18-4ecc-a21a-e75902d4e611"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:36:53.227084 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.227048    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-model-cache\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:36:53.227084 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.227076    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-dshm\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:36:53.227084 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.227087    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwgmj\" (UniqueName: \"kubernetes.io/projected/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-kube-api-access-qwgmj\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:36:53.227311 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:53.227095    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca9feaf2-1d18-4ecc-a21a-e75902d4e611-tls-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:36:54.008836 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:54.008803    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"
Jul 24 16:36:54.030321 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:54.030286    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"]
Jul 24 16:36:54.034069 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:54.034041    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a5fa08/rate-test-model-a5fa08-kserve-59477ddc87-bxtw2"]
Jul 24 16:36:54.474914 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:54.474819    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca9feaf2-1d18-4ecc-a21a-e75902d4e611" path="/var/lib/kubelet/pods/ca9feaf2-1d18-4ecc-a21a-e75902d4e611/volumes"
Jul 24 16:36:58.043881 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.043839    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"]
Jul 24 16:36:58.044388 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.044239    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca9feaf2-1d18-4ecc-a21a-e75902d4e611" containerName="main"
Jul 24 16:36:58.044388 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.044250    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca9feaf2-1d18-4ecc-a21a-e75902d4e611" containerName="main"
Jul 24 16:36:58.044388 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.044331    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca9feaf2-1d18-4ecc-a21a-e75902d4e611" containerName="main"
Jul 24 16:36:58.047735 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.047706    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.050619 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.050565    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-ae4522-openshift-default-dockercfg-hqjn4\""
Jul 24 16:36:58.065068 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.065035    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"]
Jul 24 16:36:58.174071 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.174035    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-data\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.174071 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.174074    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-workload-socket\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.174297 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.174153    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-credential-socket\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.174297 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.174197    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-workload-certs\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.174297 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.174215    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-envoy\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.174297 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.174251    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istiod-ca-cert\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.174568 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.174319    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-token\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.174568 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.174480    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jpqj\" (UniqueName: \"kubernetes.io/projected/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-kube-api-access-9jpqj\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.174568 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.174517    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-podinfo\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.275804 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.275761    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-token\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.275987 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.275865    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jpqj\" (UniqueName: \"kubernetes.io/projected/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-kube-api-access-9jpqj\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.275987 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.275890    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-podinfo\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.275987 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.275913    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-data\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.275987 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.275941    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-workload-socket\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.276212 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.275988    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-credential-socket\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.276212 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.276014    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-workload-certs\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.276212 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.276041    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-envoy\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.276212 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.276086    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istiod-ca-cert\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.276431 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.276403    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-workload-socket\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.276489 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.276454    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-credential-socket\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.276566 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.276537    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-workload-certs\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.276728 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.276708    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-data\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.276891 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.276870    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istiod-ca-cert\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.278466 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.278446    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-envoy\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.278576 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.278560    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-podinfo\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.283444 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.283414    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-token\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.283555 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.283483    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jpqj\" (UniqueName: \"kubernetes.io/projected/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-kube-api-access-9jpqj\") pod \"e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") " pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.357761 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.357657    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:58.511186 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.511164    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"]
Jul 24 16:36:58.513359 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:36:58.513330    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5b4966_fd83_4f89_9dcf_fd7397cbe12a.slice/crio-497623b3078dbf362edd9358db6e399e6ed8eb1e157ce1f4b00d3537f3272220 WatchSource:0}: Error finding container 497623b3078dbf362edd9358db6e399e6ed8eb1e157ce1f4b00d3537f3272220: Status 404 returned error can't find the container with id 497623b3078dbf362edd9358db6e399e6ed8eb1e157ce1f4b00d3537f3272220
Jul 24 16:36:58.515883 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.515850    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:36:58.515995 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.515923    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:36:58.515995 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:58.515966    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:36:59.037619 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:59.037566    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp" event={"ID":"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a","Type":"ContainerStarted","Data":"c2964982333f7e38e3066a94584935ea9955c6d1db7005ed7bf3e1ca7946b298"}
Jul 24 16:36:59.037806 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:59.037634    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp" event={"ID":"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a","Type":"ContainerStarted","Data":"497623b3078dbf362edd9358db6e399e6ed8eb1e157ce1f4b00d3537f3272220"}
Jul 24 16:36:59.059201 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:59.059146    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp" podStartSLOduration=1.059129668 podStartE2EDuration="1.059129668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:36:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:36:59.057967265 +0000 UTC m=+2973.120416479" watchObservedRunningTime="2026-07-24 16:36:59.059129668 +0000 UTC m=+2973.121578854"
Jul 24 16:36:59.358568 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:59.358463    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:36:59.363866 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:36:59.363839    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:37:00.043744 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:00.043707    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:37:00.044719 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:00.044701    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:37:16.085810 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.085757    2553 patch_prober.go:28] interesting pod/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 16:37:16.086334 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.085846    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp" podUID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 16:37:16.577419 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.577380    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"]
Jul 24 16:37:16.581724 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.581692    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.584417 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.584390    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-d71769-openshift-default-dockercfg-9f5h9\""
Jul 24 16:37:16.593748 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.593722    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"]
Jul 24 16:37:16.650036 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.649981    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-credential-socket\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.650245 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.650051    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-token\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.650245 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.650111    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-workload-certs\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.650245 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.650139    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-podinfo\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.650408 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.650254    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-data\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.650408 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.650297    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istiod-ca-cert\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.650408 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.650367    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5599\" (UniqueName: \"kubernetes.io/projected/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-kube-api-access-s5599\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.650408 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.650400    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-workload-socket\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.650640 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.650502    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-envoy\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.751416 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.751377    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-workload-certs\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.751416 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.751422    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-podinfo\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.751711 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.751478    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-data\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.751711 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.751505    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istiod-ca-cert\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.751711 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.751536    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5599\" (UniqueName: \"kubernetes.io/projected/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-kube-api-access-s5599\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.751711 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.751561    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-workload-socket\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.751711 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.751651    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-envoy\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.751711 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.751702    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-credential-socket\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.752035 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.751747    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-token\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.752035 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.751919    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-data\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.752268 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.752240    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-credential-socket\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.752370 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.752268    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-workload-certs\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.752370 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.752330    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istiod-ca-cert\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.752491 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.752363    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-workload-socket\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.754116 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.754095    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-envoy\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.754536 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.754510    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-podinfo\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.760351 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.760320    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-token\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.760466 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.760437    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5599\" (UniqueName: \"kubernetes.io/projected/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-kube-api-access-s5599\") pod \"e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") " pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:16.897857 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:16.897829    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:17.064187 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:17.064160    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"]
Jul 24 16:37:17.066779 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:37:17.066749    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9c4914_bd06_4d74_aaef_7e5b476bbfa9.slice/crio-483793130f0c3569a9351908ff211e7b5fc230e78cbcc7d4436ddbbd12ee6bbc WatchSource:0}: Error finding container 483793130f0c3569a9351908ff211e7b5fc230e78cbcc7d4436ddbbd12ee6bbc: Status 404 returned error can't find the container with id 483793130f0c3569a9351908ff211e7b5fc230e78cbcc7d4436ddbbd12ee6bbc
Jul 24 16:37:17.068863 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:17.068826    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:37:17.068968 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:17.068904    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:37:17.068968 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:17.068954    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:37:17.135822 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:17.135790    2553 generic.go:356] "Generic (PLEG): container finished" podID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerID="c2964982333f7e38e3066a94584935ea9955c6d1db7005ed7bf3e1ca7946b298" exitCode=0
Jul 24 16:37:17.136523 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:17.135867    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp" event={"ID":"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a","Type":"ContainerDied","Data":"c2964982333f7e38e3066a94584935ea9955c6d1db7005ed7bf3e1ca7946b298"}
Jul 24 16:37:17.137387 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:17.137365    2553 scope.go:117] "RemoveContainer" containerID="c2964982333f7e38e3066a94584935ea9955c6d1db7005ed7bf3e1ca7946b298"
Jul 24 16:37:17.138747 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:17.138718    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:37:17.138901 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:17.138803    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:37:17.138901 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:17.138834    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:37:17.139916 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:17.139883    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8" event={"ID":"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9","Type":"ContainerStarted","Data":"483793130f0c3569a9351908ff211e7b5fc230e78cbcc7d4436ddbbd12ee6bbc"}
Jul 24 16:37:18.155017 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:18.154963    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp" event={"ID":"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a","Type":"ContainerStarted","Data":"c7f7959ebff5eeb1c15bff1bd4a1fca2e445305078f91df960cbba13b9736ae5"}
Jul 24 16:37:18.158319 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:18.158265    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8" event={"ID":"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9","Type":"ContainerStarted","Data":"ee393090832920538db66f6d13b27f6cd8347f0f54d1b924c5d7d56ca16c786b"}
Jul 24 16:37:18.194024 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:18.193964    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8" podStartSLOduration=2.193946397 podStartE2EDuration="2.193946397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:37:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:37:18.192443738 +0000 UTC m=+2992.254892928" watchObservedRunningTime="2026-07-24 16:37:18.193946397 +0000 UTC m=+2992.256395583"
Jul 24 16:37:18.358752 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:18.358706    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:37:18.358957 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:18.358844    2553 patch_prober.go:28] interesting pod/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 24 16:37:18.358957 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:18.358928    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp" podUID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 24 16:37:18.898835 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:18.898796    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:18.903813 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:18.903787    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:19.166003 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:19.165914    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:19.166783 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:19.166759    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:19.358448 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:19.358400    2553 patch_prober.go:28] interesting pod/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 24 16:37:19.358670 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:19.358512    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp" podUID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 24 16:37:20.358492 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:20.358443    2553 patch_prober.go:28] interesting pod/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 24 16:37:20.359052 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:20.358516    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp" podUID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 24 16:37:21.359064 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:21.359023    2553 patch_prober.go:28] interesting pod/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 24 16:37:21.359718 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:21.359686    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp" podUID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 24 16:37:22.362602 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:22.362549    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:37:22.363034 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:22.363010    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:37:22.363693 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:22.363670    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:37:32.233864 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:32.233771    2553 generic.go:356] "Generic (PLEG): container finished" podID="3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" containerID="ee393090832920538db66f6d13b27f6cd8347f0f54d1b924c5d7d56ca16c786b" exitCode=0
Jul 24 16:37:32.233864 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:32.233847    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8" event={"ID":"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9","Type":"ContainerDied","Data":"ee393090832920538db66f6d13b27f6cd8347f0f54d1b924c5d7d56ca16c786b"}
Jul 24 16:37:32.234319 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:32.234245    2553 scope.go:117] "RemoveContainer" containerID="ee393090832920538db66f6d13b27f6cd8347f0f54d1b924c5d7d56ca16c786b"
Jul 24 16:37:32.235275 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:32.235246    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:37:32.235399 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:32.235327    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:37:32.235399 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:32.235376    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:37:33.243810 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:33.243764    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8" event={"ID":"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9","Type":"ContainerStarted","Data":"17b7ba33b9e7f5a6e6c13e266bcab80473d37a8cf9f7801b36f48ca6c1416bf7"}
Jul 24 16:37:33.899096 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:33.899060    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:33.900373 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:33.900343    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 24 16:37:33.900516 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:33.900394    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8" podUID="3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 24 16:37:34.166531 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:34.166434    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:34.899061 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:34.899021    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 24 16:37:34.899490 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:34.899097    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8" podUID="3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 24 16:37:35.899172 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:35.899132    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 24 16:37:35.899652 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:35.899189    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8" podUID="3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 24 16:37:36.899084 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:36.899036    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 24 16:37:36.899301 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:36.899101    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8" podUID="3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 24 16:37:37.902284 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:37.902252    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:37:37.903142 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:37:37.903124    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:38:29.465995 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.465771    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"]
Jul 24 16:38:29.473778 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.473750    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.477495 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.477467    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-292d47-openshift-default-dockercfg-2jdk7\""
Jul 24 16:38:29.478431 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.478401    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"]
Jul 24 16:38:29.520170 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.520132    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-workload-certs\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.520331 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.520179    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-token\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.520331 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.520267    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.520406 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.520332    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n297v\" (UniqueName: \"kubernetes.io/projected/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-kube-api-access-n297v\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.520406 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.520390    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-data\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.520477 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.520416    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-podinfo\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.520477 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.520454    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-envoy\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.520552 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.520496    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-workload-socket\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.520607 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.520556    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-credential-socket\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.621722 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.621678    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-data\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.621979 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.621727    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-podinfo\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.621979 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.621767    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-envoy\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.621979 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.621808    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-workload-socket\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.621979 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.621869    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-credential-socket\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.621979 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.621936    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-workload-certs\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.621979 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.621969    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-token\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.622301 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.622017    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.622301 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.622065    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n297v\" (UniqueName: \"kubernetes.io/projected/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-kube-api-access-n297v\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.622301 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.622131    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-data\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.622451 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.622415    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-workload-certs\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.622873 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.622843    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-credential-socket\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.622986 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.622966    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.622986 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.622974    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-workload-socket\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.624331 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.624306    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-envoy\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.624512 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.624490    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-podinfo\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.633548 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.633522    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-token\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.633771 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.633748    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n297v\" (UniqueName: \"kubernetes.io/projected/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-kube-api-access-n297v\") pod \"e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") " pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.787645 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.787576    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:29.958695 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.958665    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"]
Jul 24 16:38:29.960785 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:38:29.960757    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b5e079f_3504_4b15_8ed2_e82cbc1211b0.slice/crio-9f0be46c2b823db937047f1db658957a95fe3abbd1a3395a68bbbfaf69cbf2d0 WatchSource:0}: Error finding container 9f0be46c2b823db937047f1db658957a95fe3abbd1a3395a68bbbfaf69cbf2d0: Status 404 returned error can't find the container with id 9f0be46c2b823db937047f1db658957a95fe3abbd1a3395a68bbbfaf69cbf2d0
Jul 24 16:38:29.962994 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.962957    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:38:29.963054 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.963036    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:38:29.963092 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:29.963066    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:38:30.552377 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:30.552338    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt" event={"ID":"9b5e079f-3504-4b15-8ed2-e82cbc1211b0","Type":"ContainerStarted","Data":"2a7bd42adbf7aa61432b66a19ed783dbeab347455cf141c5ccba8ab69500b016"}
Jul 24 16:38:30.552822 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:30.552396    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt" event={"ID":"9b5e079f-3504-4b15-8ed2-e82cbc1211b0","Type":"ContainerStarted","Data":"9f0be46c2b823db937047f1db658957a95fe3abbd1a3395a68bbbfaf69cbf2d0"}
Jul 24 16:38:30.574366 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:30.574309    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt" podStartSLOduration=1.574285465 podStartE2EDuration="1.574285465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:38:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:38:30.571849381 +0000 UTC m=+3064.634298595" watchObservedRunningTime="2026-07-24 16:38:30.574285465 +0000 UTC m=+3064.636734655"
Jul 24 16:38:30.788031 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:30.787995    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:31.793790 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:31.793757    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:32.564044 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:32.564012    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:32.564976 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:32.564955    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:52.690062 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:52.690028    2553 generic.go:356] "Generic (PLEG): container finished" podID="9b5e079f-3504-4b15-8ed2-e82cbc1211b0" containerID="2a7bd42adbf7aa61432b66a19ed783dbeab347455cf141c5ccba8ab69500b016" exitCode=0
Jul 24 16:38:52.690511 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:52.690101    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt" event={"ID":"9b5e079f-3504-4b15-8ed2-e82cbc1211b0","Type":"ContainerDied","Data":"2a7bd42adbf7aa61432b66a19ed783dbeab347455cf141c5ccba8ab69500b016"}
Jul 24 16:38:52.690565 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:52.690556    2553 scope.go:117] "RemoveContainer" containerID="2a7bd42adbf7aa61432b66a19ed783dbeab347455cf141c5ccba8ab69500b016"
Jul 24 16:38:52.691770 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:52.691745    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:38:52.691844 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:52.691808    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:38:52.691882 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:52.691842    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 16:38:53.697356 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:53.697318    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt" event={"ID":"9b5e079f-3504-4b15-8ed2-e82cbc1211b0","Type":"ContainerStarted","Data":"8af55001145404160c00875a0dcd28b7e5772dc57164bab92dfabb8450dae1a1"}
Jul 24 16:38:53.788227 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:53.788184    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:53.788501 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:53.788478    2553 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 24 16:38:53.788628 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:53.788570    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt" podUID="9b5e079f-3504-4b15-8ed2-e82cbc1211b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 24 16:38:54.788411 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:54.788363    2553 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 24 16:38:54.788895 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:54.788423    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt" podUID="9b5e079f-3504-4b15-8ed2-e82cbc1211b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 24 16:38:55.788913 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:55.788873    2553 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 24 16:38:55.789302 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:55.788932    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt" podUID="9b5e079f-3504-4b15-8ed2-e82cbc1211b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 24 16:38:56.787975 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:56.787936    2553 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 24 16:38:56.788157 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:56.787989    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt" podUID="9b5e079f-3504-4b15-8ed2-e82cbc1211b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 24 16:38:57.792143 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:57.792109    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:57.792634 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:57.792401    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:38:57.793201 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:38:57.793184    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:39:14.542194 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:14.542153    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"]
Jul 24 16:39:14.542829 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:14.542451    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt" podUID="9b5e079f-3504-4b15-8ed2-e82cbc1211b0" containerName="istio-proxy" containerID="cri-o://8af55001145404160c00875a0dcd28b7e5772dc57164bab92dfabb8450dae1a1" gracePeriod=30
Jul 24 16:39:19.795840 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.795804    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:39:19.838545 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.838441    2553 generic.go:356] "Generic (PLEG): container finished" podID="9b5e079f-3504-4b15-8ed2-e82cbc1211b0" containerID="8af55001145404160c00875a0dcd28b7e5772dc57164bab92dfabb8450dae1a1" exitCode=0
Jul 24 16:39:19.838545 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.838503    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"
Jul 24 16:39:19.838545 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.838527    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt" event={"ID":"9b5e079f-3504-4b15-8ed2-e82cbc1211b0","Type":"ContainerDied","Data":"8af55001145404160c00875a0dcd28b7e5772dc57164bab92dfabb8450dae1a1"}
Jul 24 16:39:19.838844 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.838619    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt" event={"ID":"9b5e079f-3504-4b15-8ed2-e82cbc1211b0","Type":"ContainerDied","Data":"9f0be46c2b823db937047f1db658957a95fe3abbd1a3395a68bbbfaf69cbf2d0"}
Jul 24 16:39:19.838844 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.838637    2553 scope.go:117] "RemoveContainer" containerID="8af55001145404160c00875a0dcd28b7e5772dc57164bab92dfabb8450dae1a1"
Jul 24 16:39:19.848084 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.848059    2553 scope.go:117] "RemoveContainer" containerID="2a7bd42adbf7aa61432b66a19ed783dbeab347455cf141c5ccba8ab69500b016"
Jul 24 16:39:19.856968 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.856948    2553 scope.go:117] "RemoveContainer" containerID="8af55001145404160c00875a0dcd28b7e5772dc57164bab92dfabb8450dae1a1"
Jul 24 16:39:19.857272 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:39:19.857248    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8af55001145404160c00875a0dcd28b7e5772dc57164bab92dfabb8450dae1a1\": container with ID starting with 8af55001145404160c00875a0dcd28b7e5772dc57164bab92dfabb8450dae1a1 not found: ID does not exist" containerID="8af55001145404160c00875a0dcd28b7e5772dc57164bab92dfabb8450dae1a1"
Jul 24 16:39:19.857346 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.857304    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8af55001145404160c00875a0dcd28b7e5772dc57164bab92dfabb8450dae1a1"} err="failed to get container status \"8af55001145404160c00875a0dcd28b7e5772dc57164bab92dfabb8450dae1a1\": rpc error: code = NotFound desc = could not find container \"8af55001145404160c00875a0dcd28b7e5772dc57164bab92dfabb8450dae1a1\": container with ID starting with 8af55001145404160c00875a0dcd28b7e5772dc57164bab92dfabb8450dae1a1 not found: ID does not exist"
Jul 24 16:39:19.857346 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.857325    2553 scope.go:117] "RemoveContainer" containerID="2a7bd42adbf7aa61432b66a19ed783dbeab347455cf141c5ccba8ab69500b016"
Jul 24 16:39:19.857615 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:39:19.857597    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a7bd42adbf7aa61432b66a19ed783dbeab347455cf141c5ccba8ab69500b016\": container with ID starting with 2a7bd42adbf7aa61432b66a19ed783dbeab347455cf141c5ccba8ab69500b016 not found: ID does not exist" containerID="2a7bd42adbf7aa61432b66a19ed783dbeab347455cf141c5ccba8ab69500b016"
Jul 24 16:39:19.857665 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.857621    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a7bd42adbf7aa61432b66a19ed783dbeab347455cf141c5ccba8ab69500b016"} err="failed to get container status \"2a7bd42adbf7aa61432b66a19ed783dbeab347455cf141c5ccba8ab69500b016\": rpc error: code = NotFound desc = could not find container \"2a7bd42adbf7aa61432b66a19ed783dbeab347455cf141c5ccba8ab69500b016\": container with ID starting with 2a7bd42adbf7aa61432b66a19ed783dbeab347455cf141c5ccba8ab69500b016 not found: ID does not exist"
Jul 24 16:39:19.928854 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.928813    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-workload-socket\") pod \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") "
Jul 24 16:39:19.929040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.928877    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-podinfo\") pod \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") "
Jul 24 16:39:19.929040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.928908    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-credential-socket\") pod \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") "
Jul 24 16:39:19.929040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.928978    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-token\") pod \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") "
Jul 24 16:39:19.929220 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.929073    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n297v\" (UniqueName: \"kubernetes.io/projected/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-kube-api-access-n297v\") pod \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") "
Jul 24 16:39:19.929220 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.929097    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-data\") pod \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") "
Jul 24 16:39:19.929220 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.929126    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b5e079f-3504-4b15-8ed2-e82cbc1211b0" (UID: "9b5e079f-3504-4b15-8ed2-e82cbc1211b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:39:19.929220 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.929155    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istiod-ca-cert\") pod \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") "
Jul 24 16:39:19.929220 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.929179    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-workload-certs\") pod \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") "
Jul 24 16:39:19.929220 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.929213    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-envoy\") pod \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\" (UID: \"9b5e079f-3504-4b15-8ed2-e82cbc1211b0\") "
Jul 24 16:39:19.929532 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.929249    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b5e079f-3504-4b15-8ed2-e82cbc1211b0" (UID: "9b5e079f-3504-4b15-8ed2-e82cbc1211b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:39:19.929532 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.929460    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b5e079f-3504-4b15-8ed2-e82cbc1211b0" (UID: "9b5e079f-3504-4b15-8ed2-e82cbc1211b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:39:19.929713 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.929559    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b5e079f-3504-4b15-8ed2-e82cbc1211b0" (UID: "9b5e079f-3504-4b15-8ed2-e82cbc1211b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:39:19.929713 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.929662    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:39:19.929713 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.929685    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:39:19.929713 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.929700    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:39:19.930535 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.930506    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b5e079f-3504-4b15-8ed2-e82cbc1211b0" (UID: "9b5e079f-3504-4b15-8ed2-e82cbc1211b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:39:19.931218 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.931190    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b5e079f-3504-4b15-8ed2-e82cbc1211b0" (UID: "9b5e079f-3504-4b15-8ed2-e82cbc1211b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:39:19.931317 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.931277    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-kube-api-access-n297v" (OuterVolumeSpecName: "kube-api-access-n297v") pod "9b5e079f-3504-4b15-8ed2-e82cbc1211b0" (UID: "9b5e079f-3504-4b15-8ed2-e82cbc1211b0"). InnerVolumeSpecName "kube-api-access-n297v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:39:19.931367 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.931355    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b5e079f-3504-4b15-8ed2-e82cbc1211b0" (UID: "9b5e079f-3504-4b15-8ed2-e82cbc1211b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:39:19.931430 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:19.931413    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b5e079f-3504-4b15-8ed2-e82cbc1211b0" (UID: "9b5e079f-3504-4b15-8ed2-e82cbc1211b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:39:20.030437 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:20.030399    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:39:20.030437 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:20.030435    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n297v\" (UniqueName: \"kubernetes.io/projected/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-kube-api-access-n297v\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:39:20.030437 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:20.030445    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:39:20.030734 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:20.030455    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:39:20.030734 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:20.030463    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:39:20.030734 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:20.030471    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b5e079f-3504-4b15-8ed2-e82cbc1211b0-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:39:20.167456 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:20.167383    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"]
Jul 24 16:39:20.168987 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:20.168954    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-292d47-openshift-default-dc76d9fcb-hstbt"]
Jul 24 16:39:20.476231 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:39:20.476142    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b5e079f-3504-4b15-8ed2-e82cbc1211b0" path="/var/lib/kubelet/pods/9b5e079f-3504-4b15-8ed2-e82cbc1211b0/volumes"
Jul 24 16:40:32.908941 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:32.908895    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"]
Jul 24 16:40:32.909539 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:32.909206    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp" podUID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerName="istio-proxy" containerID="cri-o://c7f7959ebff5eeb1c15bff1bd4a1fca2e445305078f91df960cbba13b9736ae5" gracePeriod=30
Jul 24 16:40:37.365504 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:37.365463    2553 patch_prober.go:28] interesting pod/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 16:40:37.365918 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:37.365552    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp" podUID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 16:40:38.173717 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.173649    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:40:38.220250 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220212    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-workload-socket\") pod \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") "
Jul 24 16:40:38.220440 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220261    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-workload-certs\") pod \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") "
Jul 24 16:40:38.220440 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220296    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jpqj\" (UniqueName: \"kubernetes.io/projected/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-kube-api-access-9jpqj\") pod \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") "
Jul 24 16:40:38.220440 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220358    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istiod-ca-cert\") pod \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") "
Jul 24 16:40:38.220440 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220401    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-data\") pod \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") "
Jul 24 16:40:38.220440 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220426    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-credential-socket\") pod \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") "
Jul 24 16:40:38.220753 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220470    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-podinfo\") pod \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") "
Jul 24 16:40:38.220753 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220506    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-token\") pod \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") "
Jul 24 16:40:38.220753 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220508    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" (UID: "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:40:38.220753 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220545    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-envoy\") pod \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\" (UID: \"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a\") "
Jul 24 16:40:38.220753 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220641    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" (UID: "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:40:38.221012 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220784    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" (UID: "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:40:38.221012 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220830    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" (UID: "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:40:38.221012 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220958    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:40:38.221012 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220975    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:40:38.221012 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.220989    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:40:38.221269 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.221002    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:40:38.221875 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.221847    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" (UID: "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:40:38.222731 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.222704    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-kube-api-access-9jpqj" (OuterVolumeSpecName: "kube-api-access-9jpqj") pod "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" (UID: "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a"). InnerVolumeSpecName "kube-api-access-9jpqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:40:38.222842 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.222785    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" (UID: "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:40:38.223095 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.223074    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" (UID: "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:40:38.223143 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.223074    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" (UID: "4f5b4966-fd83-4f89-9dcf-fd7397cbe12a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:40:38.248388 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.248359    2553 generic.go:356] "Generic (PLEG): container finished" podID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerID="c7f7959ebff5eeb1c15bff1bd4a1fca2e445305078f91df960cbba13b9736ae5" exitCode=0
Jul 24 16:40:38.248547 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.248411    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"
Jul 24 16:40:38.248547 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.248447    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp" event={"ID":"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a","Type":"ContainerDied","Data":"c7f7959ebff5eeb1c15bff1bd4a1fca2e445305078f91df960cbba13b9736ae5"}
Jul 24 16:40:38.248547 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.248503    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp" event={"ID":"4f5b4966-fd83-4f89-9dcf-fd7397cbe12a","Type":"ContainerDied","Data":"497623b3078dbf362edd9358db6e399e6ed8eb1e157ce1f4b00d3537f3272220"}
Jul 24 16:40:38.248547 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.248526    2553 scope.go:117] "RemoveContainer" containerID="c7f7959ebff5eeb1c15bff1bd4a1fca2e445305078f91df960cbba13b9736ae5"
Jul 24 16:40:38.264467 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.264445    2553 scope.go:117] "RemoveContainer" containerID="c2964982333f7e38e3066a94584935ea9955c6d1db7005ed7bf3e1ca7946b298"
Jul 24 16:40:38.272802 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.272778    2553 scope.go:117] "RemoveContainer" containerID="c7f7959ebff5eeb1c15bff1bd4a1fca2e445305078f91df960cbba13b9736ae5"
Jul 24 16:40:38.273112 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:40:38.273067    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7f7959ebff5eeb1c15bff1bd4a1fca2e445305078f91df960cbba13b9736ae5\": container with ID starting with c7f7959ebff5eeb1c15bff1bd4a1fca2e445305078f91df960cbba13b9736ae5 not found: ID does not exist" containerID="c7f7959ebff5eeb1c15bff1bd4a1fca2e445305078f91df960cbba13b9736ae5"
Jul 24 16:40:38.273211 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.273108    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7f7959ebff5eeb1c15bff1bd4a1fca2e445305078f91df960cbba13b9736ae5"} err="failed to get container status \"c7f7959ebff5eeb1c15bff1bd4a1fca2e445305078f91df960cbba13b9736ae5\": rpc error: code = NotFound desc = could not find container \"c7f7959ebff5eeb1c15bff1bd4a1fca2e445305078f91df960cbba13b9736ae5\": container with ID starting with c7f7959ebff5eeb1c15bff1bd4a1fca2e445305078f91df960cbba13b9736ae5 not found: ID does not exist"
Jul 24 16:40:38.273211 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.273131    2553 scope.go:117] "RemoveContainer" containerID="c2964982333f7e38e3066a94584935ea9955c6d1db7005ed7bf3e1ca7946b298"
Jul 24 16:40:38.273530 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:40:38.273456    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2964982333f7e38e3066a94584935ea9955c6d1db7005ed7bf3e1ca7946b298\": container with ID starting with c2964982333f7e38e3066a94584935ea9955c6d1db7005ed7bf3e1ca7946b298 not found: ID does not exist" containerID="c2964982333f7e38e3066a94584935ea9955c6d1db7005ed7bf3e1ca7946b298"
Jul 24 16:40:38.273530 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.273496    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2964982333f7e38e3066a94584935ea9955c6d1db7005ed7bf3e1ca7946b298"} err="failed to get container status \"c2964982333f7e38e3066a94584935ea9955c6d1db7005ed7bf3e1ca7946b298\": rpc error: code = NotFound desc = could not find container \"c2964982333f7e38e3066a94584935ea9955c6d1db7005ed7bf3e1ca7946b298\": container with ID starting with c2964982333f7e38e3066a94584935ea9955c6d1db7005ed7bf3e1ca7946b298 not found: ID does not exist"
Jul 24 16:40:38.275511 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.275491    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"]
Jul 24 16:40:38.278745 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.278723    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-ae4522-openshift-default-5b84c74b6d-6fpwp"]
Jul 24 16:40:38.321696 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.321658    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:40:38.321696 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.321685    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:40:38.321696 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.321696    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:40:38.321696 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.321705    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jpqj\" (UniqueName: \"kubernetes.io/projected/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-kube-api-access-9jpqj\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:40:38.321972 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.321715    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:40:38.474690 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:38.474603    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" path="/var/lib/kubelet/pods/4f5b4966-fd83-4f89-9dcf-fd7397cbe12a/volumes"
Jul 24 16:40:55.452258 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:55.452220    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"]
Jul 24 16:40:55.452690 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:40:55.452500    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8" podUID="3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" containerName="istio-proxy" containerID="cri-o://17b7ba33b9e7f5a6e6c13e266bcab80473d37a8cf9f7801b36f48ca6c1416bf7" gracePeriod=30
Jul 24 16:41:00.712295 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.712225    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:41:00.858404 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.858362    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-workload-socket\") pod \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") "
Jul 24 16:41:00.858404 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.858407    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-workload-certs\") pod \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") "
Jul 24 16:41:00.858685 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.858471    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-token\") pod \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") "
Jul 24 16:41:00.858685 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.858508    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-data\") pod \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") "
Jul 24 16:41:00.858685 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.858568    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-credential-socket\") pod \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") "
Jul 24 16:41:00.858685 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.858640    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-envoy\") pod \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") "
Jul 24 16:41:00.858685 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.858669    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-podinfo\") pod \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") "
Jul 24 16:41:00.858959 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.858697    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" (UID: "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:00.859019 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.858710    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5599\" (UniqueName: \"kubernetes.io/projected/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-kube-api-access-s5599\") pod \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") "
Jul 24 16:41:00.859095 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.859068    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istiod-ca-cert\") pod \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\" (UID: \"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9\") "
Jul 24 16:41:00.859460 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.858820    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" (UID: "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:00.859460 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.859452    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:00.859617 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.858962    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" (UID: "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:00.859617 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.859433    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-data" (OuterVolumeSpecName: "istio-data") pod "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" (UID: "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:00.859781 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.859762    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" (UID: "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:41:00.861082 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.861056    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-token" (OuterVolumeSpecName: "istio-token") pod "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" (UID: "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:41:00.861175 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.861069    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" (UID: "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:41:00.861275 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.861251    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" (UID: "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:00.861329 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.861272    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-kube-api-access-s5599" (OuterVolumeSpecName: "kube-api-access-s5599") pod "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" (UID: "3c9c4914-bd06-4d74-aaef-7e5b476bbfa9"). InnerVolumeSpecName "kube-api-access-s5599". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:41:00.960815 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.960773    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:00.960815 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.960808    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:00.960815 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.960817    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:00.960815 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.960825    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:00.961110 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.960834    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:00.961110 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.960842    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:00.961110 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.960850    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5599\" (UniqueName: \"kubernetes.io/projected/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-kube-api-access-s5599\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:00.961110 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:00.960858    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:01.370162 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:01.370128    2553 generic.go:356] "Generic (PLEG): container finished" podID="3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" containerID="17b7ba33b9e7f5a6e6c13e266bcab80473d37a8cf9f7801b36f48ca6c1416bf7" exitCode=0
Jul 24 16:41:01.370383 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:01.370177    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"
Jul 24 16:41:01.370383 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:01.370226    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8" event={"ID":"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9","Type":"ContainerDied","Data":"17b7ba33b9e7f5a6e6c13e266bcab80473d37a8cf9f7801b36f48ca6c1416bf7"}
Jul 24 16:41:01.370383 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:01.370288    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8" event={"ID":"3c9c4914-bd06-4d74-aaef-7e5b476bbfa9","Type":"ContainerDied","Data":"483793130f0c3569a9351908ff211e7b5fc230e78cbcc7d4436ddbbd12ee6bbc"}
Jul 24 16:41:01.370383 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:01.370318    2553 scope.go:117] "RemoveContainer" containerID="17b7ba33b9e7f5a6e6c13e266bcab80473d37a8cf9f7801b36f48ca6c1416bf7"
Jul 24 16:41:01.380212 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:01.380193    2553 scope.go:117] "RemoveContainer" containerID="ee393090832920538db66f6d13b27f6cd8347f0f54d1b924c5d7d56ca16c786b"
Jul 24 16:41:01.388695 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:01.388671    2553 scope.go:117] "RemoveContainer" containerID="17b7ba33b9e7f5a6e6c13e266bcab80473d37a8cf9f7801b36f48ca6c1416bf7"
Jul 24 16:41:01.388969 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:41:01.388949    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17b7ba33b9e7f5a6e6c13e266bcab80473d37a8cf9f7801b36f48ca6c1416bf7\": container with ID starting with 17b7ba33b9e7f5a6e6c13e266bcab80473d37a8cf9f7801b36f48ca6c1416bf7 not found: ID does not exist" containerID="17b7ba33b9e7f5a6e6c13e266bcab80473d37a8cf9f7801b36f48ca6c1416bf7"
Jul 24 16:41:01.389039 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:01.388979    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b7ba33b9e7f5a6e6c13e266bcab80473d37a8cf9f7801b36f48ca6c1416bf7"} err="failed to get container status \"17b7ba33b9e7f5a6e6c13e266bcab80473d37a8cf9f7801b36f48ca6c1416bf7\": rpc error: code = NotFound desc = could not find container \"17b7ba33b9e7f5a6e6c13e266bcab80473d37a8cf9f7801b36f48ca6c1416bf7\": container with ID starting with 17b7ba33b9e7f5a6e6c13e266bcab80473d37a8cf9f7801b36f48ca6c1416bf7 not found: ID does not exist"
Jul 24 16:41:01.389039 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:01.388997    2553 scope.go:117] "RemoveContainer" containerID="ee393090832920538db66f6d13b27f6cd8347f0f54d1b924c5d7d56ca16c786b"
Jul 24 16:41:01.389241 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:41:01.389223    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee393090832920538db66f6d13b27f6cd8347f0f54d1b924c5d7d56ca16c786b\": container with ID starting with ee393090832920538db66f6d13b27f6cd8347f0f54d1b924c5d7d56ca16c786b not found: ID does not exist" containerID="ee393090832920538db66f6d13b27f6cd8347f0f54d1b924c5d7d56ca16c786b"
Jul 24 16:41:01.389286 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:01.389246    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee393090832920538db66f6d13b27f6cd8347f0f54d1b924c5d7d56ca16c786b"} err="failed to get container status \"ee393090832920538db66f6d13b27f6cd8347f0f54d1b924c5d7d56ca16c786b\": rpc error: code = NotFound desc = could not find container \"ee393090832920538db66f6d13b27f6cd8347f0f54d1b924c5d7d56ca16c786b\": container with ID starting with ee393090832920538db66f6d13b27f6cd8347f0f54d1b924c5d7d56ca16c786b not found: ID does not exist"
Jul 24 16:41:01.393932 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:01.393906    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"]
Jul 24 16:41:01.397136 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:01.397113    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-d71769-openshift-default-7f8d68f97b-2mkk8"]
Jul 24 16:41:02.475324 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:02.475289    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" path="/var/lib/kubelet/pods/3c9c4914-bd06-4d74-aaef-7e5b476bbfa9/volumes"
Jul 24 16:41:18.118388 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:18.118269    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"]
Jul 24 16:41:18.119027 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:18.118553    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4" podUID="756274b7-921a-4fda-8618-403ddf10d71f" containerName="istio-proxy" containerID="cri-o://9cf234471200f442e911bd17eac770b3d729d542aff9d8bd78e77db6c1a0205e" gracePeriod=30
Jul 24 16:41:20.317171 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:20.317131    2553 patch_prober.go:28] interesting pod/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 16:41:20.317551 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:20.317202    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4" podUID="756274b7-921a-4fda-8618-403ddf10d71f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 16:41:23.387396 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.387324    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:41:23.475358 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.475323    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-workload-socket\") pod \"756274b7-921a-4fda-8618-403ddf10d71f\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") "
Jul 24 16:41:23.475554 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.475370    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756274b7-921a-4fda-8618-403ddf10d71f-istio-podinfo\") pod \"756274b7-921a-4fda-8618-403ddf10d71f\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") "
Jul 24 16:41:23.475554 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.475406    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8qsb\" (UniqueName: \"kubernetes.io/projected/756274b7-921a-4fda-8618-403ddf10d71f-kube-api-access-d8qsb\") pod \"756274b7-921a-4fda-8618-403ddf10d71f\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") "
Jul 24 16:41:23.475554 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.475424    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-workload-certs\") pod \"756274b7-921a-4fda-8618-403ddf10d71f\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") "
Jul 24 16:41:23.475554 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.475462    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-istio-envoy\") pod \"756274b7-921a-4fda-8618-403ddf10d71f\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") "
Jul 24 16:41:23.475554 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.475515    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756274b7-921a-4fda-8618-403ddf10d71f-istio-token\") pod \"756274b7-921a-4fda-8618-403ddf10d71f\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") "
Jul 24 16:41:23.475925 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.475602    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-credential-socket\") pod \"756274b7-921a-4fda-8618-403ddf10d71f\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") "
Jul 24 16:41:23.475925 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.475630    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-istio-data\") pod \"756274b7-921a-4fda-8618-403ddf10d71f\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") "
Jul 24 16:41:23.475925 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.475654    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "756274b7-921a-4fda-8618-403ddf10d71f" (UID: "756274b7-921a-4fda-8618-403ddf10d71f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:23.475925 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.475666    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756274b7-921a-4fda-8618-403ddf10d71f-istiod-ca-cert\") pod \"756274b7-921a-4fda-8618-403ddf10d71f\" (UID: \"756274b7-921a-4fda-8618-403ddf10d71f\") "
Jul 24 16:41:23.476147 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.475990    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "756274b7-921a-4fda-8618-403ddf10d71f" (UID: "756274b7-921a-4fda-8618-403ddf10d71f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:23.476147 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.476109    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:23.476267 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.476153    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:23.476267 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.476229    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/756274b7-921a-4fda-8618-403ddf10d71f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "756274b7-921a-4fda-8618-403ddf10d71f" (UID: "756274b7-921a-4fda-8618-403ddf10d71f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:41:23.476267 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.476219    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "756274b7-921a-4fda-8618-403ddf10d71f" (UID: "756274b7-921a-4fda-8618-403ddf10d71f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:23.476850 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.476811    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-istio-data" (OuterVolumeSpecName: "istio-data") pod "756274b7-921a-4fda-8618-403ddf10d71f" (UID: "756274b7-921a-4fda-8618-403ddf10d71f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:23.478147 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.478121    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/756274b7-921a-4fda-8618-403ddf10d71f-kube-api-access-d8qsb" (OuterVolumeSpecName: "kube-api-access-d8qsb") pod "756274b7-921a-4fda-8618-403ddf10d71f" (UID: "756274b7-921a-4fda-8618-403ddf10d71f"). InnerVolumeSpecName "kube-api-access-d8qsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:41:23.478240 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.478117    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "756274b7-921a-4fda-8618-403ddf10d71f" (UID: "756274b7-921a-4fda-8618-403ddf10d71f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:23.478240 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.478161    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/756274b7-921a-4fda-8618-403ddf10d71f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "756274b7-921a-4fda-8618-403ddf10d71f" (UID: "756274b7-921a-4fda-8618-403ddf10d71f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:41:23.478240 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.478206    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/756274b7-921a-4fda-8618-403ddf10d71f-istio-token" (OuterVolumeSpecName: "istio-token") pod "756274b7-921a-4fda-8618-403ddf10d71f" (UID: "756274b7-921a-4fda-8618-403ddf10d71f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:41:23.482668 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.482645    2553 generic.go:356] "Generic (PLEG): container finished" podID="756274b7-921a-4fda-8618-403ddf10d71f" containerID="9cf234471200f442e911bd17eac770b3d729d542aff9d8bd78e77db6c1a0205e" exitCode=0
Jul 24 16:41:23.482755 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.482703    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"
Jul 24 16:41:23.482755 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.482715    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4" event={"ID":"756274b7-921a-4fda-8618-403ddf10d71f","Type":"ContainerDied","Data":"9cf234471200f442e911bd17eac770b3d729d542aff9d8bd78e77db6c1a0205e"}
Jul 24 16:41:23.482844 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.482761    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4" event={"ID":"756274b7-921a-4fda-8618-403ddf10d71f","Type":"ContainerDied","Data":"d036438f9a96470bd4129514a8310b329239d01d592f1b28e2f996d658ecddbd"}
Jul 24 16:41:23.482844 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.482784    2553 scope.go:117] "RemoveContainer" containerID="9cf234471200f442e911bd17eac770b3d729d542aff9d8bd78e77db6c1a0205e"
Jul 24 16:41:23.499898 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.499875    2553 scope.go:117] "RemoveContainer" containerID="1f2d807778771600b4d206246df17b94d85eb725c7eb61038e1fb238df905afd"
Jul 24 16:41:23.507953 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.507930    2553 scope.go:117] "RemoveContainer" containerID="9cf234471200f442e911bd17eac770b3d729d542aff9d8bd78e77db6c1a0205e"
Jul 24 16:41:23.508256 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:41:23.508236    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cf234471200f442e911bd17eac770b3d729d542aff9d8bd78e77db6c1a0205e\": container with ID starting with 9cf234471200f442e911bd17eac770b3d729d542aff9d8bd78e77db6c1a0205e not found: ID does not exist" containerID="9cf234471200f442e911bd17eac770b3d729d542aff9d8bd78e77db6c1a0205e"
Jul 24 16:41:23.508305 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.508269    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cf234471200f442e911bd17eac770b3d729d542aff9d8bd78e77db6c1a0205e"} err="failed to get container status \"9cf234471200f442e911bd17eac770b3d729d542aff9d8bd78e77db6c1a0205e\": rpc error: code = NotFound desc = could not find container \"9cf234471200f442e911bd17eac770b3d729d542aff9d8bd78e77db6c1a0205e\": container with ID starting with 9cf234471200f442e911bd17eac770b3d729d542aff9d8bd78e77db6c1a0205e not found: ID does not exist"
Jul 24 16:41:23.508305 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.508287    2553 scope.go:117] "RemoveContainer" containerID="1f2d807778771600b4d206246df17b94d85eb725c7eb61038e1fb238df905afd"
Jul 24 16:41:23.508558 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:41:23.508536    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f2d807778771600b4d206246df17b94d85eb725c7eb61038e1fb238df905afd\": container with ID starting with 1f2d807778771600b4d206246df17b94d85eb725c7eb61038e1fb238df905afd not found: ID does not exist" containerID="1f2d807778771600b4d206246df17b94d85eb725c7eb61038e1fb238df905afd"
Jul 24 16:41:23.508666 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.508564    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2d807778771600b4d206246df17b94d85eb725c7eb61038e1fb238df905afd"} err="failed to get container status \"1f2d807778771600b4d206246df17b94d85eb725c7eb61038e1fb238df905afd\": rpc error: code = NotFound desc = could not find container \"1f2d807778771600b4d206246df17b94d85eb725c7eb61038e1fb238df905afd\": container with ID starting with 1f2d807778771600b4d206246df17b94d85eb725c7eb61038e1fb238df905afd not found: ID does not exist"
Jul 24 16:41:23.511328 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.511305    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"]
Jul 24 16:41:23.516342 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.516320    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-a5fa08-openshift-default-5c9b9f6b8d-4v8n4"]
Jul 24 16:41:23.577134 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.577094    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:23.577134 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.577131    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756274b7-921a-4fda-8618-403ddf10d71f-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:23.577412 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.577147    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756274b7-921a-4fda-8618-403ddf10d71f-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:23.577412 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.577160    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8qsb\" (UniqueName: \"kubernetes.io/projected/756274b7-921a-4fda-8618-403ddf10d71f-kube-api-access-d8qsb\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:23.577412 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.577176    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:23.577412 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.577191    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756274b7-921a-4fda-8618-403ddf10d71f-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:23.577412 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:23.577204    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756274b7-921a-4fda-8618-403ddf10d71f-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:24.474644 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:24.474610    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="756274b7-921a-4fda-8618-403ddf10d71f" path="/var/lib/kubelet/pods/756274b7-921a-4fda-8618-403ddf10d71f/volumes"
Jul 24 16:41:26.896980 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:26.896945    2553 scope.go:117] "RemoveContainer" containerID="261a937ee445af8702625afe033f9d6bdcc5944bbbe7031ed792f89b4bb2161c"
Jul 24 16:41:40.148420 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:40.148383    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"]
Jul 24 16:41:40.148875 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:40.148642    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w" podUID="44a17560-764b-43b8-a613-d1a5cbb7c11e" containerName="istio-proxy" containerID="cri-o://fb2dbf1012acd91a25cfb08e21bb49b8b49c9b117ac0078f93617cdef61d03a3" gracePeriod=30
Jul 24 16:41:40.800366 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:40.800328    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6575ffc6b9-vnggd_f359d422-9c3b-40a5-987b-b3d8c782599d/authorino/0.log"
Jul 24 16:41:45.410290 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.410259    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:41:45.584463 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.584426    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-podinfo\") pod \"44a17560-764b-43b8-a613-d1a5cbb7c11e\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") "
Jul 24 16:41:45.584715 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.584482    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhcxq\" (UniqueName: \"kubernetes.io/projected/44a17560-764b-43b8-a613-d1a5cbb7c11e-kube-api-access-qhcxq\") pod \"44a17560-764b-43b8-a613-d1a5cbb7c11e\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") "
Jul 24 16:41:45.584715 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.584514    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-token\") pod \"44a17560-764b-43b8-a613-d1a5cbb7c11e\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") "
Jul 24 16:41:45.584715 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.584548    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-data\") pod \"44a17560-764b-43b8-a613-d1a5cbb7c11e\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") "
Jul 24 16:41:45.584715 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.584578    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-credential-socket\") pod \"44a17560-764b-43b8-a613-d1a5cbb7c11e\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") "
Jul 24 16:41:45.584715 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.584635    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-workload-certs\") pod \"44a17560-764b-43b8-a613-d1a5cbb7c11e\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") "
Jul 24 16:41:45.584715 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.584693    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-workload-socket\") pod \"44a17560-764b-43b8-a613-d1a5cbb7c11e\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") "
Jul 24 16:41:45.585032 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.584724    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44a17560-764b-43b8-a613-d1a5cbb7c11e-istiod-ca-cert\") pod \"44a17560-764b-43b8-a613-d1a5cbb7c11e\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") "
Jul 24 16:41:45.585032 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.584751    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-envoy\") pod \"44a17560-764b-43b8-a613-d1a5cbb7c11e\" (UID: \"44a17560-764b-43b8-a613-d1a5cbb7c11e\") "
Jul 24 16:41:45.585135 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.585053    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "44a17560-764b-43b8-a613-d1a5cbb7c11e" (UID: "44a17560-764b-43b8-a613-d1a5cbb7c11e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:45.585277 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.585251    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "44a17560-764b-43b8-a613-d1a5cbb7c11e" (UID: "44a17560-764b-43b8-a613-d1a5cbb7c11e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:45.585383 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.585318    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "44a17560-764b-43b8-a613-d1a5cbb7c11e" (UID: "44a17560-764b-43b8-a613-d1a5cbb7c11e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:45.585438 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.585383    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44a17560-764b-43b8-a613-d1a5cbb7c11e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "44a17560-764b-43b8-a613-d1a5cbb7c11e" (UID: "44a17560-764b-43b8-a613-d1a5cbb7c11e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:41:45.585758 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.585729    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-data" (OuterVolumeSpecName: "istio-data") pod "44a17560-764b-43b8-a613-d1a5cbb7c11e" (UID: "44a17560-764b-43b8-a613-d1a5cbb7c11e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:45.587080 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.587057    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "44a17560-764b-43b8-a613-d1a5cbb7c11e" (UID: "44a17560-764b-43b8-a613-d1a5cbb7c11e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:45.587194 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.587129    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44a17560-764b-43b8-a613-d1a5cbb7c11e-kube-api-access-qhcxq" (OuterVolumeSpecName: "kube-api-access-qhcxq") pod "44a17560-764b-43b8-a613-d1a5cbb7c11e" (UID: "44a17560-764b-43b8-a613-d1a5cbb7c11e"). InnerVolumeSpecName "kube-api-access-qhcxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:41:45.587194 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.587130    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "44a17560-764b-43b8-a613-d1a5cbb7c11e" (UID: "44a17560-764b-43b8-a613-d1a5cbb7c11e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:41:45.587194 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.587169    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-token" (OuterVolumeSpecName: "istio-token") pod "44a17560-764b-43b8-a613-d1a5cbb7c11e" (UID: "44a17560-764b-43b8-a613-d1a5cbb7c11e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:41:45.591186 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.591149    2553 generic.go:356] "Generic (PLEG): container finished" podID="44a17560-764b-43b8-a613-d1a5cbb7c11e" containerID="fb2dbf1012acd91a25cfb08e21bb49b8b49c9b117ac0078f93617cdef61d03a3" exitCode=0
Jul 24 16:41:45.591285 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.591185    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w" event={"ID":"44a17560-764b-43b8-a613-d1a5cbb7c11e","Type":"ContainerDied","Data":"fb2dbf1012acd91a25cfb08e21bb49b8b49c9b117ac0078f93617cdef61d03a3"}
Jul 24 16:41:45.591285 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.591217    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"
Jul 24 16:41:45.591285 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.591258    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w" event={"ID":"44a17560-764b-43b8-a613-d1a5cbb7c11e","Type":"ContainerDied","Data":"d02766b5dcb0e88d676e5ab80abf2431e4803ad08b606e5d95b3c1ae1098603f"}
Jul 24 16:41:45.591454 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.591289    2553 scope.go:117] "RemoveContainer" containerID="fb2dbf1012acd91a25cfb08e21bb49b8b49c9b117ac0078f93617cdef61d03a3"
Jul 24 16:41:45.605980 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.605961    2553 scope.go:117] "RemoveContainer" containerID="ff9781822f8550c8b902d55fa7a47cf9a89c7ea669cb5b897b726c5965d98572"
Jul 24 16:41:45.613971 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.613952    2553 scope.go:117] "RemoveContainer" containerID="fb2dbf1012acd91a25cfb08e21bb49b8b49c9b117ac0078f93617cdef61d03a3"
Jul 24 16:41:45.614233 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:41:45.614213    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb2dbf1012acd91a25cfb08e21bb49b8b49c9b117ac0078f93617cdef61d03a3\": container with ID starting with fb2dbf1012acd91a25cfb08e21bb49b8b49c9b117ac0078f93617cdef61d03a3 not found: ID does not exist" containerID="fb2dbf1012acd91a25cfb08e21bb49b8b49c9b117ac0078f93617cdef61d03a3"
Jul 24 16:41:45.614275 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.614242    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2dbf1012acd91a25cfb08e21bb49b8b49c9b117ac0078f93617cdef61d03a3"} err="failed to get container status \"fb2dbf1012acd91a25cfb08e21bb49b8b49c9b117ac0078f93617cdef61d03a3\": rpc error: code = NotFound desc = could not find container \"fb2dbf1012acd91a25cfb08e21bb49b8b49c9b117ac0078f93617cdef61d03a3\": container with ID starting with fb2dbf1012acd91a25cfb08e21bb49b8b49c9b117ac0078f93617cdef61d03a3 not found: ID does not exist"
Jul 24 16:41:45.614275 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.614259    2553 scope.go:117] "RemoveContainer" containerID="ff9781822f8550c8b902d55fa7a47cf9a89c7ea669cb5b897b726c5965d98572"
Jul 24 16:41:45.614483 ip-10-0-136-199 kubenswrapper[2553]: E0724 16:41:45.614469    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff9781822f8550c8b902d55fa7a47cf9a89c7ea669cb5b897b726c5965d98572\": container with ID starting with ff9781822f8550c8b902d55fa7a47cf9a89c7ea669cb5b897b726c5965d98572 not found: ID does not exist" containerID="ff9781822f8550c8b902d55fa7a47cf9a89c7ea669cb5b897b726c5965d98572"
Jul 24 16:41:45.614520 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.614487    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff9781822f8550c8b902d55fa7a47cf9a89c7ea669cb5b897b726c5965d98572"} err="failed to get container status \"ff9781822f8550c8b902d55fa7a47cf9a89c7ea669cb5b897b726c5965d98572\": rpc error: code = NotFound desc = could not find container \"ff9781822f8550c8b902d55fa7a47cf9a89c7ea669cb5b897b726c5965d98572\": container with ID starting with ff9781822f8550c8b902d55fa7a47cf9a89c7ea669cb5b897b726c5965d98572 not found: ID does not exist"
Jul 24 16:41:45.618971 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.618946    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"]
Jul 24 16:41:45.623497 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.623473    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-675edf-openshift-default-796b9fdf4d-4hb6w"]
Jul 24 16:41:45.686172 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.686137    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-podinfo\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:45.686172 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.686169    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhcxq\" (UniqueName: \"kubernetes.io/projected/44a17560-764b-43b8-a613-d1a5cbb7c11e-kube-api-access-qhcxq\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:45.686172 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.686181    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-token\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:45.686404 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.686190    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-data\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:45.686404 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.686198    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-credential-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:45.686404 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.686208    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-workload-certs\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:45.686404 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.686218    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-workload-socket\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:45.686404 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.686225    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44a17560-764b-43b8-a613-d1a5cbb7c11e-istiod-ca-cert\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:45.686404 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.686234    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44a17560-764b-43b8-a613-d1a5cbb7c11e-istio-envoy\") on node \"ip-10-0-136-199.ec2.internal\" DevicePath \"\""
Jul 24 16:41:45.942052 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:45.941971    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-n47dv_1052acd7-34b5-4b6d-8fa1-f981c4436b44/manager/0.log"
Jul 24 16:41:46.055252 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:46.055208    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-t4jsz_1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94/manager/0.log"
Jul 24 16:41:46.303991 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:46.303964    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sjsnf_acd2fce5-a2e9-4a7f-8cb8-c2d85795db58/server/0.log"
Jul 24 16:41:46.419316 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:46.419284    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wxmsk_4beae04b-21db-4d9a-b539-87d182241c2b/manager/0.log"
Jul 24 16:41:46.475289 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:46.475257    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44a17560-764b-43b8-a613-d1a5cbb7c11e" path="/var/lib/kubelet/pods/44a17560-764b-43b8-a613-d1a5cbb7c11e/volumes"
Jul 24 16:41:46.651890 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:46.651810    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749946f7d7-ghg7h_29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f/copy-manifests/0.log"
Jul 24 16:41:46.664942 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:46.664914    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749946f7d7-ghg7h_29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f/manager/0.log"
Jul 24 16:41:48.774469 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:48.774430    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6575ffc6b9-vnggd_f359d422-9c3b-40a5-987b-b3d8c782599d/authorino/0.log"
Jul 24 16:41:48.886397 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:48.886365    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pvkxt_b1a17010-bfae-41b8-a10a-3915a6c02c15/manager/0.log"
Jul 24 16:41:48.997249 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:48.997219    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-k6s7r_0688651d-6d18-43ef-bfb8-f829e79de727/manager/0.log"
Jul 24 16:41:49.223345 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:49.223265    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mxszz_361e7292-814e-4f73-ba80-0e717f5fd5d0/registry-server/0.log"
Jul 24 16:41:49.338513 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:49.338478    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-h89xm_9362abb6-6fb8-4830-82d4-6d9114b45c83/manager/0.log"
Jul 24 16:41:49.568682 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:49.568648    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jcql7_09d15212-0071-4805-8415-d4327e0dc30b/manager/0.log"
Jul 24 16:41:49.927860 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:49.927758    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f_e813bdf7-8c74-4f62-b0fc-5a3c22ad2147/istio-proxy/0.log"
Jul 24 16:41:50.156084 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:50.156052    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545786b4d4-68cww_5c72a80f-277c-4c83-a169-b0670927582a/kube-auth-proxy/0.log"
Jul 24 16:41:50.384848 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:50.384814    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-df6776dd6-slckn_dd09ada3-9556-463b-8928-af7dfcbf9feb/istio-proxy/1.log"
Jul 24 16:41:50.504815 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:50.504782    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-x5df4_00a5537d-de57-401d-9d0b-6e2defb83d2b/payload-pre-processing/0.log"
Jul 24 16:41:51.070500 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:51.070466    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-b24wj_676b7bb7-40c6-4845-b016-e05bc009d299/main/0.log"
Jul 24 16:41:51.291569 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:51.291531    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-8nbq4_c067509e-a4ff-40b5-a311-5bb175cf61f4/main/0.log"
Jul 24 16:41:59.508855 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:59.508823    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gfnfh_a99759ef-4eee-46cb-ac25-cce29b9395b9/global-pull-secret-syncer/0.log"
Jul 24 16:41:59.707322 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:59.707289    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p9kvb_8148a263-1d0e-438e-ac4f-ca703f81fd72/konnectivity-agent/0.log"
Jul 24 16:41:59.754043 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:41:59.754015    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-199.ec2.internal_cf62266a6ae3b77620eda580b89764b9/haproxy/0.log"
Jul 24 16:42:04.700702 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:04.700663    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6575ffc6b9-vnggd_f359d422-9c3b-40a5-987b-b3d8c782599d/authorino/0.log"
Jul 24 16:42:04.742499 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:04.742466    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pvkxt_b1a17010-bfae-41b8-a10a-3915a6c02c15/manager/0.log"
Jul 24 16:42:04.780959 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:04.780930    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-k6s7r_0688651d-6d18-43ef-bfb8-f829e79de727/manager/0.log"
Jul 24 16:42:04.857827 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:04.857795    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mxszz_361e7292-814e-4f73-ba80-0e717f5fd5d0/registry-server/0.log"
Jul 24 16:42:05.002070 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:05.002036    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-h89xm_9362abb6-6fb8-4830-82d4-6d9114b45c83/manager/0.log"
Jul 24 16:42:05.105848 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:05.105816    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jcql7_09d15212-0071-4805-8415-d4327e0dc30b/manager/0.log"
Jul 24 16:42:07.209986 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:07.209954    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7dcq_00caebbd-8641-46d4-b1c4-97eff53e1ad3/node-exporter/0.log"
Jul 24 16:42:07.236159 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:07.236137    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7dcq_00caebbd-8641-46d4-b1c4-97eff53e1ad3/kube-rbac-proxy/0.log"
Jul 24 16:42:07.260231 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:07.260206    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7dcq_00caebbd-8641-46d4-b1c4-97eff53e1ad3/init-textfile/0.log"
Jul 24 16:42:07.522419 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:07.522391    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10/prometheus/0.log"
Jul 24 16:42:07.546519 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:07.546492    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10/config-reloader/0.log"
Jul 24 16:42:07.570114 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:07.570083    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10/thanos-sidecar/0.log"
Jul 24 16:42:07.590207 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:07.590182    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10/kube-rbac-proxy-web/0.log"
Jul 24 16:42:07.610409 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:07.610378    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10/kube-rbac-proxy/0.log"
Jul 24 16:42:07.632555 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:07.632527    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10/kube-rbac-proxy-thanos/0.log"
Jul 24 16:42:07.653626 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:07.653533    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dfaa6cc1-4fec-49ce-ae78-91e1e1cd2e10/init-config-reloader/0.log"
Jul 24 16:42:09.595126 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595086    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"]
Jul 24 16:42:09.595527 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595513    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756274b7-921a-4fda-8618-403ddf10d71f" containerName="istio-proxy"
Jul 24 16:42:09.595527 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595528    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="756274b7-921a-4fda-8618-403ddf10d71f" containerName="istio-proxy"
Jul 24 16:42:09.595648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595536    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44a17560-764b-43b8-a613-d1a5cbb7c11e" containerName="istio-proxy"
Jul 24 16:42:09.595648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595542    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="44a17560-764b-43b8-a613-d1a5cbb7c11e" containerName="istio-proxy"
Jul 24 16:42:09.595648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595566    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756274b7-921a-4fda-8618-403ddf10d71f" containerName="istio-proxy"
Jul 24 16:42:09.595648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595575    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="756274b7-921a-4fda-8618-403ddf10d71f" containerName="istio-proxy"
Jul 24 16:42:09.595648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595595    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerName="istio-proxy"
Jul 24 16:42:09.595648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595601    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerName="istio-proxy"
Jul 24 16:42:09.595648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595608    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerName="istio-proxy"
Jul 24 16:42:09.595648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595614    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerName="istio-proxy"
Jul 24 16:42:09.595648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595624    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44a17560-764b-43b8-a613-d1a5cbb7c11e" containerName="istio-proxy"
Jul 24 16:42:09.595648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595629    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="44a17560-764b-43b8-a613-d1a5cbb7c11e" containerName="istio-proxy"
Jul 24 16:42:09.595648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595635    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" containerName="istio-proxy"
Jul 24 16:42:09.595648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595640    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" containerName="istio-proxy"
Jul 24 16:42:09.595648 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595650    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" containerName="istio-proxy"
Jul 24 16:42:09.596040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595660    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" containerName="istio-proxy"
Jul 24 16:42:09.596040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595670    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b5e079f-3504-4b15-8ed2-e82cbc1211b0" containerName="istio-proxy"
Jul 24 16:42:09.596040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595675    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b5e079f-3504-4b15-8ed2-e82cbc1211b0" containerName="istio-proxy"
Jul 24 16:42:09.596040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595684    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b5e079f-3504-4b15-8ed2-e82cbc1211b0" containerName="istio-proxy"
Jul 24 16:42:09.596040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595689    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b5e079f-3504-4b15-8ed2-e82cbc1211b0" containerName="istio-proxy"
Jul 24 16:42:09.596040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595750    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" containerName="istio-proxy"
Jul 24 16:42:09.596040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595757    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="44a17560-764b-43b8-a613-d1a5cbb7c11e" containerName="istio-proxy"
Jul 24 16:42:09.596040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595763    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b5e079f-3504-4b15-8ed2-e82cbc1211b0" containerName="istio-proxy"
Jul 24 16:42:09.596040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595768    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c9c4914-bd06-4d74-aaef-7e5b476bbfa9" containerName="istio-proxy"
Jul 24 16:42:09.596040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595774    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="756274b7-921a-4fda-8618-403ddf10d71f" containerName="istio-proxy"
Jul 24 16:42:09.596040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595781    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b5e079f-3504-4b15-8ed2-e82cbc1211b0" containerName="istio-proxy"
Jul 24 16:42:09.596040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595789    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerName="istio-proxy"
Jul 24 16:42:09.596040 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.595795    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f5b4966-fd83-4f89-9dcf-fd7397cbe12a" containerName="istio-proxy"
Jul 24 16:42:09.598787 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.598769    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.601619 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.601577    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6ww8s\"/\"kube-root-ca.crt\""
Jul 24 16:42:09.601771 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.601698    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6ww8s\"/\"openshift-service-ca.crt\""
Jul 24 16:42:09.603050 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.603022    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6ww8s\"/\"default-dockercfg-t8xkf\""
Jul 24 16:42:09.607631 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.607576    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"]
Jul 24 16:42:09.710482 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.710441    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d17a20f-b77f-4634-9a97-98ad48ea0468-lib-modules\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.710482 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.710484    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7d17a20f-b77f-4634-9a97-98ad48ea0468-proc\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.710756 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.710510    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7d17a20f-b77f-4634-9a97-98ad48ea0468-podres\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.710756 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.710631    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjp8d\" (UniqueName: \"kubernetes.io/projected/7d17a20f-b77f-4634-9a97-98ad48ea0468-kube-api-access-jjp8d\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.710756 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.710661    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d17a20f-b77f-4634-9a97-98ad48ea0468-sys\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.811998 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.811966    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7d17a20f-b77f-4634-9a97-98ad48ea0468-podres\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.812190 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.812016    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjp8d\" (UniqueName: \"kubernetes.io/projected/7d17a20f-b77f-4634-9a97-98ad48ea0468-kube-api-access-jjp8d\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.812190 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.812045    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d17a20f-b77f-4634-9a97-98ad48ea0468-sys\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.812190 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.812132    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d17a20f-b77f-4634-9a97-98ad48ea0468-lib-modules\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.812190 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.812162    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7d17a20f-b77f-4634-9a97-98ad48ea0468-proc\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.812190 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.812169    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7d17a20f-b77f-4634-9a97-98ad48ea0468-podres\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.812381 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.812186    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d17a20f-b77f-4634-9a97-98ad48ea0468-sys\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.812381 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.812227    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7d17a20f-b77f-4634-9a97-98ad48ea0468-proc\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.812381 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.812332    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d17a20f-b77f-4634-9a97-98ad48ea0468-lib-modules\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.820245 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.820218    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjp8d\" (UniqueName: \"kubernetes.io/projected/7d17a20f-b77f-4634-9a97-98ad48ea0468-kube-api-access-jjp8d\") pod \"perf-node-gather-daemonset-mnftb\" (UID: \"7d17a20f-b77f-4634-9a97-98ad48ea0468\") " pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:09.910105 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:09.910011    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:10.041254 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:10.041220    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"]
Jul 24 16:42:10.044413 ip-10-0-136-199 kubenswrapper[2553]: W0724 16:42:10.044388    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7d17a20f_b77f_4634_9a97_98ad48ea0468.slice/crio-da65620e8d722b22e13fddfb83c460e18028ed6bf305ed02c5970fadb2d75705 WatchSource:0}: Error finding container da65620e8d722b22e13fddfb83c460e18028ed6bf305ed02c5970fadb2d75705: Status 404 returned error can't find the container with id da65620e8d722b22e13fddfb83c460e18028ed6bf305ed02c5970fadb2d75705
Jul 24 16:42:10.712669 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:10.712625    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb" event={"ID":"7d17a20f-b77f-4634-9a97-98ad48ea0468","Type":"ContainerStarted","Data":"71f186f9804c820f580f8d0bc55b85dfdeddd8c26543a0ae8816245bf1970ae6"}
Jul 24 16:42:10.713050 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:10.712690    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb" event={"ID":"7d17a20f-b77f-4634-9a97-98ad48ea0468","Type":"ContainerStarted","Data":"da65620e8d722b22e13fddfb83c460e18028ed6bf305ed02c5970fadb2d75705"}
Jul 24 16:42:10.713050 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:10.712711    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:10.730092 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:10.730039    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb" podStartSLOduration=1.7300222779999999 podStartE2EDuration="1.730022278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:42:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:42:10.727887008 +0000 UTC m=+3284.790336195" watchObservedRunningTime="2026-07-24 16:42:10.730022278 +0000 UTC m=+3284.792471465"
Jul 24 16:42:11.989458 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:11.989424    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d2b52_0a6e88dd-033b-464c-b91d-358f9d663a6b/dns/0.log"
Jul 24 16:42:12.016272 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:12.016230    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d2b52_0a6e88dd-033b-464c-b91d-358f9d663a6b/kube-rbac-proxy/0.log"
Jul 24 16:42:12.156910 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:12.156877    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ljfg6_34acff67-e6d0-4c76-b011-4280b5935771/dns-node-resolver/0.log"
Jul 24 16:42:12.766522 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:12.766491    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j5x8q_e1c36bc9-7991-4a81-99ab-e00758772a24/node-ca/0.log"
Jul 24 16:42:13.694983 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:13.694953    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f_e813bdf7-8c74-4f62-b0fc-5a3c22ad2147/istio-proxy/0.log"
Jul 24 16:42:13.857050 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:13.856991    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545786b4d4-68cww_5c72a80f-277c-4c83-a169-b0670927582a/kube-auth-proxy/0.log"
Jul 24 16:42:13.910861 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:13.910818    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-df6776dd6-slckn_dd09ada3-9556-463b-8928-af7dfcbf9feb/istio-proxy/0.log"
Jul 24 16:42:13.935578 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:13.935535    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-df6776dd6-slckn_dd09ada3-9556-463b-8928-af7dfcbf9feb/istio-proxy/1.log"
Jul 24 16:42:13.968509 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:13.968427    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-x5df4_00a5537d-de57-401d-9d0b-6e2defb83d2b/payload-pre-processing/0.log"
Jul 24 16:42:14.800347 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:14.800310    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8bjnx_b491a835-1499-44d8-a137-17d10e042f5c/serve-healthcheck-canary/0.log"
Jul 24 16:42:15.304647 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:15.304607    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-22qsx_437ecf30-7657-426a-80f2-ff44ed6e8767/kube-rbac-proxy/0.log"
Jul 24 16:42:15.325604 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:15.325552    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-22qsx_437ecf30-7657-426a-80f2-ff44ed6e8767/exporter/0.log"
Jul 24 16:42:15.345789 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:15.345743    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-22qsx_437ecf30-7657-426a-80f2-ff44ed6e8767/extractor/0.log"
Jul 24 16:42:16.727469 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:16.727436    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6ww8s/perf-node-gather-daemonset-mnftb"
Jul 24 16:42:17.501316 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:17.501282    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-n47dv_1052acd7-34b5-4b6d-8fa1-f981c4436b44/manager/0.log"
Jul 24 16:42:17.717704 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:17.717673    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-t4jsz_1ef4d6c7-7fe4-4cbc-b215-d7b46b223a94/manager/0.log"
Jul 24 16:42:17.993080 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:17.992994    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sjsnf_acd2fce5-a2e9-4a7f-8cb8-c2d85795db58/server/0.log"
Jul 24 16:42:18.070729 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:18.070693    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wxmsk_4beae04b-21db-4d9a-b539-87d182241c2b/manager/0.log"
Jul 24 16:42:18.207244 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:18.207208    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749946f7d7-ghg7h_29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f/manager/0.log"
Jul 24 16:42:18.225577 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:18.225547    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749946f7d7-ghg7h_29aef38e-b0c6-42d2-a21e-fb0a6aa46d9f/copy-manifests/0.log"
Jul 24 16:42:20.156921 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:20.156888    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f_e813bdf7-8c74-4f62-b0fc-5a3c22ad2147/istio-proxy/0.log"
Jul 24 16:42:20.301229 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:20.301201    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545786b4d4-68cww_5c72a80f-277c-4c83-a169-b0670927582a/kube-auth-proxy/0.log"
Jul 24 16:42:20.334824 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:20.334786    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-df6776dd6-slckn_dd09ada3-9556-463b-8928-af7dfcbf9feb/istio-proxy/0.log"
Jul 24 16:42:20.362179 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:20.362141    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-df6776dd6-slckn_dd09ada3-9556-463b-8928-af7dfcbf9feb/istio-proxy/1.log"
Jul 24 16:42:20.381054 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:20.381020    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-x5df4_00a5537d-de57-401d-9d0b-6e2defb83d2b/payload-pre-processing/0.log"
Jul 24 16:42:21.825357 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:21.825325    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7b75d5c99c7kf5f_e813bdf7-8c74-4f62-b0fc-5a3c22ad2147/istio-proxy/0.log"
Jul 24 16:42:21.984950 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:21.984921    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545786b4d4-68cww_5c72a80f-277c-4c83-a169-b0670927582a/kube-auth-proxy/0.log"
Jul 24 16:42:22.017924 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:22.017891    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-df6776dd6-slckn_dd09ada3-9556-463b-8928-af7dfcbf9feb/istio-proxy/0.log"
Jul 24 16:42:22.050842 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:22.050804    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-df6776dd6-slckn_dd09ada3-9556-463b-8928-af7dfcbf9feb/istio-proxy/1.log"
Jul 24 16:42:22.071951 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:22.071915    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-x5df4_00a5537d-de57-401d-9d0b-6e2defb83d2b/payload-pre-processing/0.log"
Jul 24 16:42:24.634012 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:24.633973    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-bl22n_0f13ce96-2b3b-40e8-8547-4a9e44b25cbd/migrator/0.log"
Jul 24 16:42:24.653686 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:24.653660    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-bl22n_0f13ce96-2b3b-40e8-8547-4a9e44b25cbd/graceful-termination/0.log"
Jul 24 16:42:25.970460 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:25.970430    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2gc58_551d05d5-ca76-42a2-b320-a6ac7bbfdc39/kube-multus/0.log"
Jul 24 16:42:26.298489 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:26.298461    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4nr7_464e984d-dae7-496c-a3b3-40bf169475c1/kube-multus-additional-cni-plugins/0.log"
Jul 24 16:42:26.322804 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:26.322772    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4nr7_464e984d-dae7-496c-a3b3-40bf169475c1/egress-router-binary-copy/0.log"
Jul 24 16:42:26.342070 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:26.342045    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4nr7_464e984d-dae7-496c-a3b3-40bf169475c1/cni-plugins/0.log"
Jul 24 16:42:26.361180 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:26.361156    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4nr7_464e984d-dae7-496c-a3b3-40bf169475c1/bond-cni-plugin/0.log"
Jul 24 16:42:26.380052 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:26.380022    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4nr7_464e984d-dae7-496c-a3b3-40bf169475c1/routeoverride-cni/0.log"
Jul 24 16:42:26.401143 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:26.401113    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4nr7_464e984d-dae7-496c-a3b3-40bf169475c1/whereabouts-cni-bincopy/0.log"
Jul 24 16:42:26.420166 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:26.420137    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4nr7_464e984d-dae7-496c-a3b3-40bf169475c1/whereabouts-cni/0.log"
Jul 24 16:42:26.595880 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:26.595800    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r6vqh_f5906871-c948-4d05-8433-4968968c6221/network-metrics-daemon/0.log"
Jul 24 16:42:26.613415 ip-10-0-136-199 kubenswrapper[2553]: I0724 16:42:26.613381    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r6vqh_f5906871-c948-4d05-8433-4968968c6221/kube-rbac-proxy/0.log"