Jul 17 16:23:52.831945 ip-10-0-130-95 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 17 16:23:52.831954 ip-10-0-130-95 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 17 16:23:52.831961 ip-10-0-130-95 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 17 16:23:52.832171 ip-10-0-130-95 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 17 16:24:02.584375 ip-10-0-130-95 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 17 16:24:02.584389 ip-10-0-130-95 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 9ae584d098bb481fb5f0c1e776e48f3c --
Jul 17 16:25:51.032667 ip-10-0-130-95 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 16:25:51.433991 ip-10-0-130-95 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 16:25:51.433991 ip-10-0-130-95 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 16:25:51.433991 ip-10-0-130-95 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 16:25:51.433991 ip-10-0-130-95 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 16:25:51.433991 ip-10-0-130-95 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 16:25:51.433991 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.387417    2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 16:25:51.433991 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395633    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 16:25:51.433991 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395647    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 16:25:51.433991 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395651    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 16:25:51.433991 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395654    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 16:25:51.433991 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395657    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 16:25:51.433991 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395660    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 16:25:51.433991 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395662    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 16:25:51.433991 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395666    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395669    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395671    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395674    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395676    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395679    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395682    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395684    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395687    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395690    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395693    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395695    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395698    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395700    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395703    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395705    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395708    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395711    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395714    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395717    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395721    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 16:25:51.435525 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395723    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395726    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395729    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395731    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395741    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395744    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395746    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395749    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395751    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395754    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395757    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395760    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395762    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395765    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395767    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395770    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395773    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395775    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395778    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395781    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 16:25:51.436536 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395783    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395786    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395789    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395792    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395796    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395800    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395804    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395807    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395810    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395813    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395815    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395818    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395821    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395823    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395826    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395828    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395831    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395833    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395836    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 16:25:51.437554 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395839    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395841    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395844    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395848    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395854    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395857    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395860    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395862    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395865    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395868    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395871    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395874    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395879    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395882    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395884    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395887    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395891    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395894    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395896    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 16:25:51.438587 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395899    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395902    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395904    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395907    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395909    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395912    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395914    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395917    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395920    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395922    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395925    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395928    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.395931    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396679    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396688    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396692    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396695    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396698    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396701    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396704    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 16:25:51.439603 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396707    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396710    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396712    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396716    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396719    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396723    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396726    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396728    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396731    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396733    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396736    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396739    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396742    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396744    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396747    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396749    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396752    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396755    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396757    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396760    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 16:25:51.440631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396763    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396765    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396768    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396770    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396773    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396776    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396778    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396781    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396784    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396787    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396789    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396792    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396794    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396797    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396799    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396802    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396804    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396807    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396810    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396812    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 16:25:51.441686 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396815    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396817    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396820    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396823    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396826    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396828    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396831    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396833    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396836    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396838    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396843    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396847    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396850    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396853    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396856    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396858    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396861    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396863    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396866    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 16:25:51.442701 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396869    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396872    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396874    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396877    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396880    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396882    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396885    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396888    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396890    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396892    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396895    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396897    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396900    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396904    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396907    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396911    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396914    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396918    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396921    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 16:25:51.443729 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396923    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396926    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396931    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396934    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396938    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396940    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396943    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396945    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396948    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396951    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396953    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396956    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396959    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.396961    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397314    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397335    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397338    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397341    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397344    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397346    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 16:25:51.444763 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397349    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397352    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397354    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397357    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397360    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397362    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397365    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397368    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397371    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397374    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397377    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397379    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397382    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397385    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397389    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397392    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397396    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397399    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397401    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 16:25:51.445792 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397405    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397408    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397411    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397414    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397416    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397419    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397422    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397425    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397428    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397430    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397433    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397435    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397438    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397441    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397443    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397446    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397448    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397450    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397453    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397455    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 16:25:51.446807 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397458    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397460    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397463    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397465    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397468    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397471    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397473    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397477    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397479    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397483    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397486    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397488    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397490    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397493    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397496    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397498    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397501    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397504    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397510    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 16:25:51.447841 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397513    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397516    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397519    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397521    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397524    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397526    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397529    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397531    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397534    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397536    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397538    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397541    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397544    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397546    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397548    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397551    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397553    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397556    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397558    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397561    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 16:25:51.448849 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397565    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397569    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397574    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397577    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397579    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397582    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397584    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397587    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397590    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397592    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397595    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397597    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397600    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397602    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.397605    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397677    2566 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397684    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397690    2566 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397695    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397699    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 16:25:51.449884 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397702    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397706    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397710    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397713    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397716    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397719    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397722    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397726    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397728    2566 flags.go:64] FLAG: --cgroup-root=""
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397731    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397734    2566 flags.go:64] FLAG: --client-ca-file=""
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397738    2566 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397743    2566 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397747    2566 flags.go:64] FLAG: --cluster-domain=""
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397751    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397754    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397757    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397760    2566 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397764    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397767    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397770    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397773    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397776    2566 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397779    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 16:25:51.450914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397783    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397786    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397789    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397792    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397795    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397798    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397801    2566 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397804    2566 flags.go:64] FLAG: --enable-server="true"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397807    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397812    2566 flags.go:64] FLAG: --event-burst="100"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397815    2566 flags.go:64] FLAG: --event-qps="50"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397817    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397820    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397823    2566 flags.go:64] FLAG: --eviction-hard=""
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397826    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397829    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397832    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397835    2566 flags.go:64] FLAG: --eviction-soft=""
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397838    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397840    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397845    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397848    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397852    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397855    2566 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397858    2566 flags.go:64] FLAG: --feature-gates=""
Jul 17 16:25:51.451975 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397861    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397864    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397867    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397870    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397873    2566 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397876    2566 flags.go:64] FLAG: --help="false"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397879    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-130-95.ec2.internal"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397883    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397886    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397888    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397892    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397895    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397899    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397901    2566 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397904    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397907    2566 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397910    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397913    2566 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397915    2566 flags.go:64] FLAG: --kube-reserved=""
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397918    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397921    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397924    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397926    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397929    2566 flags.go:64] FLAG: --lock-file=""
Jul 17 16:25:51.453058 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397932    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397934    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397937    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397944    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397948    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397952    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397955    2566 flags.go:64] FLAG: --logging-format="text"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397957    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397961    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397964    2566 flags.go:64] FLAG: --manifest-url=""
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397966    2566 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397970    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397973    2566 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397977    2566 flags.go:64] FLAG: --max-pods="110"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397980    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397983    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397986    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397989    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397992    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397995    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.397998    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398005    2566 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398008    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398011    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 16:25:51.454115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398014    2566 flags.go:64] FLAG: --pod-cidr=""
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398017    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398022    2566 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398025    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398027    2566 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398030    2566 flags.go:64] FLAG: --port="10250"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398033    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398036    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-051a36e08f8bc13b0"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398039    2566 flags.go:64] FLAG: --qos-reserved=""
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398042    2566 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398045    2566 flags.go:64] FLAG: --register-node="true"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398048    2566 flags.go:64] FLAG: --register-with-taints=""
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398053    2566 flags.go:64] FLAG: --registry-burst="10"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398058    2566 flags.go:64] FLAG: --registry-qps="5"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398061    2566 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398063    2566 flags.go:64] FLAG: --reserved-memory=""
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398067    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398070    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398073    2566 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398076    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398078    2566 flags.go:64] FLAG: --runonce="false"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398081    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398084    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398087    2566 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398090    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 16:25:51.459244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398093    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398096    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398098    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398101    2566 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398104    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398107    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398110    2566 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398113    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398116    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398119    2566 flags.go:64] FLAG: --system-cgroups=""
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398121    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398126    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398129    2566 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398131    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398135    2566 flags.go:64] FLAG: --tls-min-version=""
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398138    2566 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398141    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398143    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398146    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398150    2566 flags.go:64] FLAG: --v="2"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398155    2566 flags.go:64] FLAG: --version="false"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398159    2566 flags.go:64] FLAG: --vmodule=""
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398163    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398166    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398275    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 16:25:51.460738 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398279    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398281    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398284    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398287    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398289    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398292    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398295    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398298    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398300    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398303    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398306    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398308    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398311    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398314    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398330    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398333    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398335    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398338    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398341    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398344    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 16:25:51.570013 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398346    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398349    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398351    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398354    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398356    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398359    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398363    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398367    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398369    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398373    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398375    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398378    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398380    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398383    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398385    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398388    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398390    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398393    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398397    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 16:25:51.571026 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398400    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398403    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398406    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398409    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398412    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398414    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398417    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398419    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398423    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398426    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398429    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398431    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398434    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398436    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398439    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398441    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398444    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398447    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398449    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398453    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 16:25:51.572058 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398457    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398460    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398463    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398466    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398469    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398471    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398474    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398476    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398479    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398481    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398483    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398486    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398488    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398491    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398493    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398496    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398499    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398501    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398503    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398506    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 16:25:51.573064 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398509    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398511    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398514    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398516    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398519    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398521    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398524    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398526    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398529    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398531    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398534    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398540    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398545    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398548    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398551    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398554    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398557    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398560    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 16:25:51.574100 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.398563    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 16:25:51.575127 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.398568    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 16:25:51.575127 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.404897    2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 16:25:51.575127 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.404914    2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 16:25:51.575127 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.405543    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 16:25:51.575127 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.405551    2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 16:25:51.575127 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405607    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 16:25:51.575127 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405613    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 16:25:51.575127 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405618    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 16:25:51.575127 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405622    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 16:25:51.575127 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405625    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 16:25:51.575127 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405629    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 16:25:51.575127 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405632    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 16:25:51.575127 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405634    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 16:25:51.575127 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405637    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405640    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405642    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405645    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405647    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405652    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405655    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405658    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405661    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405664    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405667    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405670    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405673    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405676    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405678    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405681    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405684    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405687    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405689    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 16:25:51.576133 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405692    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405695    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405698    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405701    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405704    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405706    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405709    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405711    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405714    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405717    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405719    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405722    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405724    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405727    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405729    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405732    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405734    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405737    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405739    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405742    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 16:25:51.577146 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405744    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405747    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405749    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405752    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405754    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405757    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405759    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405762    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405764    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405767    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405769    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405772    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405774    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405779    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405784    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405787    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405790    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405792    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405796    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405799    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 16:25:51.578209 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405803    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405805    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405809    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405811    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405814    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405817    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405820    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405822    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405825    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405827    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405830    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405832    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405835    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405838    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405840    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405843    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405845    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405848    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405854    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405856    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 16:25:51.579246 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405859    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405861    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405864    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405866    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405869    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405873    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405877    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405880    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405883    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405885    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405888    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.405890    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.405895    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406008    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406012    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 16:25:51.580258 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406015    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406018    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406021    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406023    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406026    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406029    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406031    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406034    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406036    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406039    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406042    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406044    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406047    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406049    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406051    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406054    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406056    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406059    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406061    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 16:25:51.581254 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406064    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406066    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406069    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406071    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406079    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406081    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406084    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406087    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406091    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406094    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406097    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406100    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406103    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406106    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406108    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406111    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406113    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406116    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406118    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 16:25:51.582285 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406121    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406123    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406126    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406129    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406131    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406133    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406136    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406138    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406141    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406143    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406145    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406149    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406152    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406155    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406158    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406161    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406163    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406168    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406171    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 16:25:51.583327 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406174    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406176    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406179    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406182    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406185    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406187    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406190    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406192    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406195    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406197    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406200    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406203    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406206    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406209    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406212    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406215    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406217    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406220    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406222    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406225    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 16:25:51.584378 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406227    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406230    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406232    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406235    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406237    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406240    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406242    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406245    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406247    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406249    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406254    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406257    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406259    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406262    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406264    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406267    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406270    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406273    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406275    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 16:25:51.585408 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:51.406278    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 16:25:51.586441 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.406282    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 16:25:51.586441 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.406401    2566 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 16:25:51.586441 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.408257    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 16:25:51.586441 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.409495    2566 server.go:1019] "Starting client certificate rotation"
Jul 17 16:25:51.586441 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.409594    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 16:25:51.586441 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.409623    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 16:25:51.586441 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.411449    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 16:25:51.586441 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:51.414643    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 16:25:52.834689 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.757880    2566 log.go:25] "Validated CRI v1 runtime API"
Jul 17 16:25:52.834689 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.760477    2566 log.go:25] "Validated CRI v1 image API"
Jul 17 16:25:52.834689 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.762704    2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 16:25:52.834689 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.763203    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 16:25:52.834689 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.763286    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xbwlf"
Jul 17 16:25:52.834689 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.764982    2566 fs.go:135] Filesystem UUIDs: map[2ee4047b-de5e-4e41-bb42-34c7183d4a5e:/dev/nvme0n1p4 572d2d40-e6b5-40df-9d80-8d6b103e32ea:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 17 16:25:52.834689 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.765000    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 16:25:52.791520 ip-10-0-130-95 systemd[1]: Started Kubernetes Kubelet.
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.770841    2566 manager.go:216] Machine: {Timestamp:2026-07-17 16:25:52.769603759 +0000 UTC m=+1.628732311 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108188 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec210c3126c800d1c7f43a96d3fc8a13 SystemUUID:ec210c31-26c8-00d1-c7f4-3a96d3fc8a13 BootID:9ae584d0-98bb-481f-b5f0-c1e776e48f3c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:21:1e:47:be:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:21:1e:47:be:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:34:ac:d5:bc:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.770953    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.771043    2566 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.773493    2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.773520    2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.774147    2566 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.774157    2566 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.774165    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.775222    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.776304    2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.779037    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.779149    2566 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.779176    2566 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.779192    2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.779207    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.779216    2566 kubelet.go:398] "Adding apiserver pod source"
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.779227    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 16:25:52.837014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.779610    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.779631    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.782238    2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.784643    2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.784683    2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.785709    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.785728    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.785738    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.785746    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.785759    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.785770    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.785784    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.785792    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.785803    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.785818    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.785844    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.785854    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.786541    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.786551    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.790543    2566 server.go:1268] "Started kubelet"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.790636    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.790865    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.791182    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.792486    2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.793573    2566 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.793682    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.796537    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:52.796964    2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.799203    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.799227    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:52.799322    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-95.ec2.internal\" not found"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.799981    2566 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.799999    2566 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.800064    2566 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.800073    2566 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.800080    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.800426    2566 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-95.ec2.internal" not found
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.800741    2566 factory.go:153] Registering CRI-O factory
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.800759    2566 factory.go:223] Registration of the crio container factory successfully
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.800816    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.800826    2566 factory.go:55] Registering systemd factory
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.800835    2566 factory.go:223] Registration of the systemd container factory successfully
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.800855    2566 factory.go:103] Registering Raw factory
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.800872    2566 manager.go:1196] Started watching for new ooms in manager
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.801709    2566 manager.go:349] Starting recovery of all containers
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.801762    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:52.804648    2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-95.ec2.internal\" not found" node="ip-10-0-130-95.ec2.internal"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.814228    2566 manager.go:354] Recovery completed
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.815917    2566 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-95.ec2.internal" not found
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.818381    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.820999    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 16:25:52.837968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.821028    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 16:25:52.840312 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.821039    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-95.ec2.internal" event="NodeHasSufficientPID"
Jul 17 16:25:52.840312 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.821567    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 16:25:52.840312 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.821578    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 16:25:52.840312 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.821583    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 16:25:52.840312 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.821597    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 16:25:52.840312 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.822535    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 16:25:52.840312 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.822559    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 16:25:52.840312 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.822571    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-95.ec2.internal" event="NodeHasSufficientPID"
Jul 17 16:25:52.840312 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.822797    2566 policy_none.go:49] "None policy: Start"
Jul 17 16:25:52.840312 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.822811    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 16:25:52.840312 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.822821    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 16:25:52.840312 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.823804    2566 policy_none.go:47] "Start"
Jul 17 16:25:52.876368 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.876345    2566 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-95.ec2.internal" not found
Jul 17 16:25:52.900114 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:52.900090    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-95.ec2.internal\" not found"
Jul 17 16:25:52.923373 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.923150    2566 manager.go:337] "Starting Device Plugin manager"
Jul 17 16:25:52.923484 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:52.923405    2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 16:25:52.923484 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.923422    2566 server.go:87] "Starting device plugin registration server"
Jul 17 16:25:52.923765 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.923736    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 16:25:52.923839 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.923757    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 16:25:52.923949 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.923928    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 16:25:52.924020 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.924006    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 16:25:52.924089 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:52.924022    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 16:25:52.924580 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:52.924557    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 16:25:52.924673 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:52.924616    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-95.ec2.internal\" not found"
Jul 17 16:25:53.023766 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.023724    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 16:25:53.024838 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.023858    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 16:25:53.024906 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.024890    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 16:25:53.024946 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.024927    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 16:25:53.024946 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.024944    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-95.ec2.internal" event="NodeHasSufficientPID"
Jul 17 16:25:53.025008 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.024978    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.025094 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.025078    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 16:25:53.025168 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.025150    2566 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 16:25:53.025223 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.025187    2566 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 16:25:53.025274 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:53.025231    2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 16:25:53.027863 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.027845    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 16:25:53.037598 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.037584    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.126604 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.126568    2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-95.ec2.internal"]
Jul 17 16:25:53.128710 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.128689    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.129623 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.129608    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.153080 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.153061    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.157722 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.157708    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.166187 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.166167    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 16:25:53.271311 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.271282    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 16:25:53.301031 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.300952    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/683d05c214521e083e68e452ded0f18c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal\" (UID: \"683d05c214521e083e68e452ded0f18c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.301031 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.301014    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/683d05c214521e083e68e452ded0f18c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal\" (UID: \"683d05c214521e083e68e452ded0f18c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.301184 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.301043    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aed273ced1ec685d701d62f08b5ef72e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-95.ec2.internal\" (UID: \"aed273ced1ec685d701d62f08b5ef72e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.401987 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.401961    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/683d05c214521e083e68e452ded0f18c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal\" (UID: \"683d05c214521e083e68e452ded0f18c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.402112 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.401992    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/683d05c214521e083e68e452ded0f18c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal\" (UID: \"683d05c214521e083e68e452ded0f18c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.402112 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.402043    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/683d05c214521e083e68e452ded0f18c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal\" (UID: \"683d05c214521e083e68e452ded0f18c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.402112 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.402065    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aed273ced1ec685d701d62f08b5ef72e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-95.ec2.internal\" (UID: \"aed273ced1ec685d701d62f08b5ef72e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.402112 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.402108    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aed273ced1ec685d701d62f08b5ef72e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-95.ec2.internal\" (UID: \"aed273ced1ec685d701d62f08b5ef72e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.402254 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.402145    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/683d05c214521e083e68e452ded0f18c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal\" (UID: \"683d05c214521e083e68e452ded0f18c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.409649 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.409630    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 16:25:53.409822 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.409802    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 16:25:53.409889 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.409807    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 16:25:53.409889 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.409834    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 16:25:53.473313 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.473282    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.575629 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.575546    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal"
Jul 17 16:25:53.771292 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.771239    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 16:20:52 +0000 UTC" deadline="2027-12-19 10:08:34.394699829 +0000 UTC"
Jul 17 16:25:53.771292 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.771288    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12473h42m40.623415001s"
Jul 17 16:25:53.779427 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.779400    2566 apiserver.go:52] "Watching apiserver"
Jul 17 16:25:53.789128 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.789107    2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 16:25:53.790221 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.790200    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-jncft","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal","openshift-multus/multus-hd7bv","openshift-network-operator/iptables-alerter-f5hvw","openshift-ovn-kubernetes/ovnkube-node-ndt95","kube-system/global-pull-secret-syncer-2h942","kube-system/kube-apiserver-proxy-ip-10-0-130-95.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx","openshift-cluster-node-tuning-operator/tuned-t8qp9","openshift-dns/node-resolver-2fdh7","openshift-multus/multus-additional-cni-plugins-5npd9","openshift-multus/network-metrics-daemon-9t2v9","openshift-network-diagnostics/network-check-target-w5lv4","kube-system/konnectivity-agent-hwgtx"]
Jul 17 16:25:53.791695 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.791680    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jncft"
Jul 17 16:25:53.793215 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.793195    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.794010 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.793993    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 16:25:53.794205 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.794185    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 16:25:53.794383 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.794364    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f5hvw"
Jul 17 16:25:53.794537 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.794495    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mn58z\""
Jul 17 16:25:53.794537 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.794522    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 16:25:53.795574 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.795554    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 16:25:53.795642 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.795616    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 16:25:53.795838 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.795822    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.795892 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.795843    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 16:25:53.796159 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.796054    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tg4hr\""
Jul 17 16:25:53.797035 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.796964    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 16:25:53.797137 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.797053    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 16:25:53.797137 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.797101    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 16:25:53.797542 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.797521    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 16:25:53.798129 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.797810    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wxfgw\""
Jul 17 16:25:53.798129 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.797848    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:53.798129 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.797935    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 16:25:53.798129 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:53.797942    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:25:53.798547 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.798520    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 16:25:53.798648 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.798548    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gjqr8\""
Jul 17 16:25:53.798747 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.798722    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 16:25:53.798814 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.798551    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 16:25:53.798953 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.798714    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 16:25:53.799343 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.799323    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 16:25:53.799449 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.799432    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 16:25:53.799738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.799700    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.801786 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.801766    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.801864 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.801841    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 16:25:53.802057 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.801943    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 16:25:53.802158 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.802072    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 16:25:53.802277 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.802262    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x4qfp\""
Jul 17 16:25:53.803091 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.803076    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2fdh7"
Jul 17 16:25:53.803733 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.803715    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-run-netns\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.803833 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.803768    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-log-socket\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.803833 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.803787    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10889aca-4e86-4a47-ad90-b0a8d871df3a-env-overrides\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.803833 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.803803    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10889aca-4e86-4a47-ad90-b0a8d871df3a-ovn-node-metrics-cert\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.804003 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.803856    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/115dede8-584f-4994-8c9e-062234350fa6-etc-tuned\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.804003 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.803873    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-device-dir\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.804003 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.803889    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/085fe0bb-1721-4665-af0f-1ac3b8ad2e97-serviceca\") pod \"node-ca-jncft\" (UID: \"085fe0bb-1721-4665-af0f-1ac3b8ad2e97\") " pod="openshift-image-registry/node-ca-jncft"
Jul 17 16:25:53.804003 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.803908    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-node-log\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.804003 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.803938    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-cni-bin\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.804003 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.803954    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-cni-netd\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.804003 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.803969    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a98da8bd-6084-493e-bc85-56ec89e8c692-dbus\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:53.804003 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.803992    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-var-lib-kubelet\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.804389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804027    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-host\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.804389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804034    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b4l6l\""
Jul 17 16:25:53.804389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804045    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91c19b45-097e-4c76-8363-89061eb21e48-cni-binary-copy\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.804389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804060    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-multus-socket-dir-parent\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.804389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804062    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 16:25:53.804389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804120    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-multus-conf-dir\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.804389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804150    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-systemd-units\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.804389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804169    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-sysconfig\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.804389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804219    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 16:25:53.804389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804236    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-registration-dir\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.804389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804272    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-run-k8s-cni-cncf-io\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.804389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804301    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/91c19b45-097e-4c76-8363-89061eb21e48-multus-daemon-config\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.804389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804345    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5r4j\" (UniqueName: \"kubernetes.io/projected/e4d83935-2d3a-48fa-b197-cd104240978c-kube-api-access-h5r4j\") pod \"iptables-alerter-f5hvw\" (UID: \"e4d83935-2d3a-48fa-b197-cd104240978c\") " pod="openshift-network-operator/iptables-alerter-f5hvw"
Jul 17 16:25:53.804389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804372    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10889aca-4e86-4a47-ad90-b0a8d871df3a-ovnkube-config\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804407    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/115dede8-584f-4994-8c9e-062234350fa6-tmp\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804436    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-run-netns\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804475    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10889aca-4e86-4a47-ad90-b0a8d871df3a-ovnkube-script-lib\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804502    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-run\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804527    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-socket-dir\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804553    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdxhw\" (UniqueName: \"kubernetes.io/projected/097872c8-a0da-4b8d-a02d-2370e35515d7-kube-api-access-wdxhw\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804596    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-os-release\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804605    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804616    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-hostroot\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804634    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-slash\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804651    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804668    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-var-lib-kubelet\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804685    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-var-lib-openvswitch\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804700    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a98da8bd-6084-493e-bc85-56ec89e8c692-kubelet-config\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804721    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-sysctl-conf\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804736    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-sys\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.805038 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804752    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-var-lib-cni-bin\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804766    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804789    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-kubernetes\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804822    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvz9c\" (UniqueName: \"kubernetes.io/projected/115dede8-584f-4994-8c9e-062234350fa6-kube-api-access-tvz9c\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804868    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-kubelet\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804902    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-systemd\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804936    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.804981    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6k6h\" (UniqueName: \"kubernetes.io/projected/085fe0bb-1721-4665-af0f-1ac3b8ad2e97-kube-api-access-v6k6h\") pod \"node-ca-jncft\" (UID: \"085fe0bb-1721-4665-af0f-1ac3b8ad2e97\") " pod="openshift-image-registry/node-ca-jncft"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805033    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-run-multus-certs\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805069    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4d83935-2d3a-48fa-b197-cd104240978c-host-slash\") pod \"iptables-alerter-f5hvw\" (UID: \"e4d83935-2d3a-48fa-b197-cd104240978c\") " pod="openshift-network-operator/iptables-alerter-f5hvw"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805086    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-modprobe-d\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805100    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805122    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-system-cni-dir\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805149    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805165    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-cnibin\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805168    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mxr8t\""
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805206    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-var-lib-cni-multus\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805228    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.805762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805242    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/085fe0bb-1721-4665-af0f-1ac3b8ad2e97-host\") pod \"node-ca-jncft\" (UID: \"085fe0bb-1721-4665-af0f-1ac3b8ad2e97\") " pod="openshift-image-registry/node-ca-jncft"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805266    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfhk2\" (UniqueName: \"kubernetes.io/projected/91c19b45-097e-4c76-8363-89061eb21e48-kube-api-access-hfhk2\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805305    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4d83935-2d3a-48fa-b197-cd104240978c-iptables-alerter-script\") pod \"iptables-alerter-f5hvw\" (UID: \"e4d83935-2d3a-48fa-b197-cd104240978c\") " pod="openshift-network-operator/iptables-alerter-f5hvw"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805340    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-run-openvswitch\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805390    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-sys-fs\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805418    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-etc-openvswitch\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805445    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805464    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-lib-modules\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805481    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-multus-cni-dir\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805496    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-run-systemd\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805511    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-run-ovn\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805546    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5h65\" (UniqueName: \"kubernetes.io/projected/10889aca-4e86-4a47-ad90-b0a8d871df3a-kube-api-access-j5h65\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805563    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-sysctl-d\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.805582    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-etc-kubernetes\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.806030    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:25:53.806386 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:53.806096    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:25:53.807003 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.806617    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 16:25:53.807003 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.806647    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nrrzb\""
Jul 17 16:25:53.807003 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.806850    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 16:25:53.807748 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.807730    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:25:53.807854 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:53.807788    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:25:53.808833 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.808811    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hwgtx"
Jul 17 16:25:53.809339 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.809320    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 16:25:53.810941 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.810919    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 16:25:53.810941 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.810919    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 16:25:53.811132 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.810926    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pfmv4\""
Jul 17 16:25:53.841902 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.841878    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ffvcw"
Jul 17 16:25:53.850748 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.850730    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ffvcw"
Jul 17 16:25:53.901049 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.901026    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 16:25:53.905895 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.905876    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10889aca-4e86-4a47-ad90-b0a8d871df3a-ovn-node-metrics-cert\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.905959 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.905905    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/115dede8-584f-4994-8c9e-062234350fa6-etc-tuned\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.905959 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.905922    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-device-dir\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.905959 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.905937    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/085fe0bb-1721-4665-af0f-1ac3b8ad2e97-serviceca\") pod \"node-ca-jncft\" (UID: \"085fe0bb-1721-4665-af0f-1ac3b8ad2e97\") " pod="openshift-image-registry/node-ca-jncft"
Jul 17 16:25:53.905959 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.905956    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs\") pod \"network-metrics-daemon-9t2v9\" (UID: \"b33cb135-e718-4b22-a0c6-c5076d54547f\") " pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:25:53.906130 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.905978    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-node-log\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.906130 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906001    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-cni-bin\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.906130 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906028    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-device-dir\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.906130 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906047    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-cni-netd\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.906130 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906088    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a98da8bd-6084-493e-bc85-56ec89e8c692-dbus\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:53.906130 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906083    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-cni-bin\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.906130 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906105    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-cni-netd\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.906130 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906118    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-var-lib-kubelet\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906143    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-host\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906166    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91c19b45-097e-4c76-8363-89061eb21e48-cni-binary-copy\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906052    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-node-log\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906194    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-multus-socket-dir-parent\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906225    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-multus-conf-dir\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906241    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-host\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906222    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906250    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-var-lib-kubelet\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906258    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2d369cf-18b8-4166-8c42-1aa7751e1b40-cni-binary-copy\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906292    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-systemd-units\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906333    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a98da8bd-6084-493e-bc85-56ec89e8c692-dbus\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906362    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-systemd-units\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906375    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-multus-conf-dir\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906392    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-sysconfig\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906366    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-multus-socket-dir-parent\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906436    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-sysconfig\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906422    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-registration-dir\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.906522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906450    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/085fe0bb-1721-4665-af0f-1ac3b8ad2e97-serviceca\") pod \"node-ca-jncft\" (UID: \"085fe0bb-1721-4665-af0f-1ac3b8ad2e97\") " pod="openshift-image-registry/node-ca-jncft"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906471    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-registration-dir\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906473    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-run-k8s-cni-cncf-io\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906509    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-run-k8s-cni-cncf-io\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906514    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/91c19b45-097e-4c76-8363-89061eb21e48-multus-daemon-config\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906535    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5r4j\" (UniqueName: \"kubernetes.io/projected/e4d83935-2d3a-48fa-b197-cd104240978c-kube-api-access-h5r4j\") pod \"iptables-alerter-f5hvw\" (UID: \"e4d83935-2d3a-48fa-b197-cd104240978c\") " pod="openshift-network-operator/iptables-alerter-f5hvw"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906561    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2d369cf-18b8-4166-8c42-1aa7751e1b40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906589    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10889aca-4e86-4a47-ad90-b0a8d871df3a-ovnkube-config\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906612    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/115dede8-584f-4994-8c9e-062234350fa6-tmp\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906637    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-run-netns\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906663    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2d369cf-18b8-4166-8c42-1aa7751e1b40-system-cni-dir\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906722    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-run-netns\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906954    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91c19b45-097e-4c76-8363-89061eb21e48-cni-binary-copy\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.906995    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/91c19b45-097e-4c76-8363-89061eb21e48-multus-daemon-config\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907006    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2d369cf-18b8-4166-8c42-1aa7751e1b40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907048    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2a459d8a-1925-4d20-a34e-8f3a06eccd45-konnectivity-ca\") pod \"konnectivity-agent-hwgtx\" (UID: \"2a459d8a-1925-4d20-a34e-8f3a06eccd45\") " pod="kube-system/konnectivity-agent-hwgtx"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907073    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10889aca-4e86-4a47-ad90-b0a8d871df3a-ovnkube-script-lib\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.907321 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907091    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-run\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907117    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-socket-dir\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907143    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxhw\" (UniqueName: \"kubernetes.io/projected/097872c8-a0da-4b8d-a02d-2370e35515d7-kube-api-access-wdxhw\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907162    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-os-release\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907177    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-hostroot\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907175    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10889aca-4e86-4a47-ad90-b0a8d871df3a-ovnkube-config\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907193    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq4xh\" (UniqueName: \"kubernetes.io/projected/b2d369cf-18b8-4166-8c42-1aa7751e1b40-kube-api-access-gq4xh\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907213    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-slash\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907244    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907272    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-var-lib-kubelet\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907284    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-run\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907297    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47d0c172-df3f-43c6-a05e-d482e3d05f5a-hosts-file\") pod \"node-resolver-2fdh7\" (UID: \"47d0c172-df3f-43c6-a05e-d482e3d05f5a\") " pod="openshift-dns/node-resolver-2fdh7"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907356    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-var-lib-openvswitch\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907363    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-slash\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907489    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a98da8bd-6084-493e-bc85-56ec89e8c692-kubelet-config\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907523    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-sysctl-conf\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907551    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-os-release\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.908212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907561    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-sys\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907590    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-var-lib-cni-bin\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907624    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2d369cf-18b8-4166-8c42-1aa7751e1b40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907655    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907654    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10889aca-4e86-4a47-ad90-b0a8d871df3a-ovnkube-script-lib\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907674    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-sysctl-conf\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907689    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907715    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-var-lib-kubelet\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907740    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-var-lib-cni-bin\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907748    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-sys\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907779    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-hostroot\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907788    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907795    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-kubernetes\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907843    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a98da8bd-6084-493e-bc85-56ec89e8c692-kubelet-config\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907849    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-kubernetes\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907867    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-socket-dir\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907878    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvz9c\" (UniqueName: \"kubernetes.io/projected/115dede8-584f-4994-8c9e-062234350fa6-kube-api-access-tvz9c\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.909074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907906    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47d0c172-df3f-43c6-a05e-d482e3d05f5a-tmp-dir\") pod \"node-resolver-2fdh7\" (UID: \"47d0c172-df3f-43c6-a05e-d482e3d05f5a\") " pod="openshift-dns/node-resolver-2fdh7"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907912    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-var-lib-openvswitch\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.907961    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-kubelet\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908083    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-kubelet\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908453    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-systemd\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908519    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908546    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6k6h\" (UniqueName: \"kubernetes.io/projected/085fe0bb-1721-4665-af0f-1ac3b8ad2e97-kube-api-access-v6k6h\") pod \"node-ca-jncft\" (UID: \"085fe0bb-1721-4665-af0f-1ac3b8ad2e97\") " pod="openshift-image-registry/node-ca-jncft"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908579    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-systemd\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908672    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908726    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-run-multus-certs\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908753    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4d83935-2d3a-48fa-b197-cd104240978c-host-slash\") pod \"iptables-alerter-f5hvw\" (UID: \"e4d83935-2d3a-48fa-b197-cd104240978c\") " pod="openshift-network-operator/iptables-alerter-f5hvw"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908780    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8gsx\" (UniqueName: \"kubernetes.io/projected/47d0c172-df3f-43c6-a05e-d482e3d05f5a-kube-api-access-q8gsx\") pod \"node-resolver-2fdh7\" (UID: \"47d0c172-df3f-43c6-a05e-d482e3d05f5a\") " pod="openshift-dns/node-resolver-2fdh7"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908785    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-run-multus-certs\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908809    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-modprobe-d\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908848    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4d83935-2d3a-48fa-b197-cd104240978c-host-slash\") pod \"iptables-alerter-f5hvw\" (UID: \"e4d83935-2d3a-48fa-b197-cd104240978c\") " pod="openshift-network-operator/iptables-alerter-f5hvw"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908853    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-system-cni-dir\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908881    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-cnibin\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908923    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-modprobe-d\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.909918 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908944    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-cnibin\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908931    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-system-cni-dir\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.908995    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-var-lib-cni-multus\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909022    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909046    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/085fe0bb-1721-4665-af0f-1ac3b8ad2e97-host\") pod \"node-ca-jncft\" (UID: \"085fe0bb-1721-4665-af0f-1ac3b8ad2e97\") " pod="openshift-image-registry/node-ca-jncft"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909048    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-host-var-lib-cni-multus\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909071    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfhk2\" (UniqueName: \"kubernetes.io/projected/91c19b45-097e-4c76-8363-89061eb21e48-kube-api-access-hfhk2\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909096    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4d83935-2d3a-48fa-b197-cd104240978c-iptables-alerter-script\") pod \"iptables-alerter-f5hvw\" (UID: \"e4d83935-2d3a-48fa-b197-cd104240978c\") " pod="openshift-network-operator/iptables-alerter-f5hvw"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909111    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909145    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/085fe0bb-1721-4665-af0f-1ac3b8ad2e97-host\") pod \"node-ca-jncft\" (UID: \"085fe0bb-1721-4665-af0f-1ac3b8ad2e97\") " pod="openshift-image-registry/node-ca-jncft"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909196    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-run-openvswitch\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909230    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-sys-fs\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909257    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2d369cf-18b8-4166-8c42-1aa7751e1b40-cnibin\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909299    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2d369cf-18b8-4166-8c42-1aa7751e1b40-os-release\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909335    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/097872c8-a0da-4b8d-a02d-2370e35515d7-sys-fs\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909354    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2a459d8a-1925-4d20-a34e-8f3a06eccd45-agent-certs\") pod \"konnectivity-agent-hwgtx\" (UID: \"2a459d8a-1925-4d20-a34e-8f3a06eccd45\") " pod="kube-system/konnectivity-agent-hwgtx"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909394    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-etc-openvswitch\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.910585 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909424    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909444    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-run-openvswitch\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909449    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-lib-modules\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909482    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-multus-cni-dir\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909529    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfvmt\" (UniqueName: \"kubernetes.io/projected/b33cb135-e718-4b22-a0c6-c5076d54547f-kube-api-access-qfvmt\") pod \"network-metrics-daemon-9t2v9\" (UID: \"b33cb135-e718-4b22-a0c6-c5076d54547f\") " pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909551    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-etc-openvswitch\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909556    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-run-systemd\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:53.909610    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909619    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-run-ovn\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909629    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-multus-cni-dir\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909652    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5h65\" (UniqueName: \"kubernetes.io/projected/10889aca-4e86-4a47-ad90-b0a8d871df3a-kube-api-access-j5h65\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909670    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-run-systemd\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909531    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-lib-modules\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:53.909689    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret podName:a98da8bd-6084-493e-bc85-56ec89e8c692 nodeName:}" failed. No retries permitted until 2026-07-17 16:25:54.409666768 +0000 UTC m=+3.268795341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret") pod "global-pull-secret-syncer-2h942" (UID: "a98da8bd-6084-493e-bc85-56ec89e8c692") : object "kube-system"/"original-pull-secret" not registered
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909711    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-sysctl-d\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909727    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-run-ovn\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909737    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-etc-kubernetes\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.911120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909767    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86cvp\" (UniqueName: \"kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp\") pod \"network-check-target-w5lv4\" (UID: \"0a6a4056-a373-47ae-b122-121a00fb2f5d\") " pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:25:53.911647 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909798    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-run-netns\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.911647 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909814    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/115dede8-584f-4994-8c9e-062234350fa6-etc-sysctl-d\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.911647 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909823    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-log-socket\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.911647 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909849    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10889aca-4e86-4a47-ad90-b0a8d871df3a-env-overrides\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.911647 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909916    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-log-socket\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.911647 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909957    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91c19b45-097e-4c76-8363-89061eb21e48-etc-kubernetes\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.911647 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.909999    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10889aca-4e86-4a47-ad90-b0a8d871df3a-host-run-netns\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.911647 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.910244    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10889aca-4e86-4a47-ad90-b0a8d871df3a-env-overrides\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.911647 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.910265    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4d83935-2d3a-48fa-b197-cd104240978c-iptables-alerter-script\") pod \"iptables-alerter-f5hvw\" (UID: \"e4d83935-2d3a-48fa-b197-cd104240978c\") " pod="openshift-network-operator/iptables-alerter-f5hvw"
Jul 17 16:25:53.911647 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.910342    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/115dede8-584f-4994-8c9e-062234350fa6-tmp\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.911647 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.910407    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/115dede8-584f-4994-8c9e-062234350fa6-etc-tuned\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.911647 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.910472    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10889aca-4e86-4a47-ad90-b0a8d871df3a-ovn-node-metrics-cert\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:53.919698 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.919643    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5r4j\" (UniqueName: \"kubernetes.io/projected/e4d83935-2d3a-48fa-b197-cd104240978c-kube-api-access-h5r4j\") pod \"iptables-alerter-f5hvw\" (UID: \"e4d83935-2d3a-48fa-b197-cd104240978c\") " pod="openshift-network-operator/iptables-alerter-f5hvw"
Jul 17 16:25:53.921304 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.921265    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6k6h\" (UniqueName: \"kubernetes.io/projected/085fe0bb-1721-4665-af0f-1ac3b8ad2e97-kube-api-access-v6k6h\") pod \"node-ca-jncft\" (UID: \"085fe0bb-1721-4665-af0f-1ac3b8ad2e97\") " pod="openshift-image-registry/node-ca-jncft"
Jul 17 16:25:53.921684 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.921664    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvz9c\" (UniqueName: \"kubernetes.io/projected/115dede8-584f-4994-8c9e-062234350fa6-kube-api-access-tvz9c\") pod \"tuned-t8qp9\" (UID: \"115dede8-584f-4994-8c9e-062234350fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:53.921796 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.921701    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdxhw\" (UniqueName: \"kubernetes.io/projected/097872c8-a0da-4b8d-a02d-2370e35515d7-kube-api-access-wdxhw\") pod \"aws-ebs-csi-driver-node-phwdx\" (UID: \"097872c8-a0da-4b8d-a02d-2370e35515d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:53.921796 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.921703    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfhk2\" (UniqueName: \"kubernetes.io/projected/91c19b45-097e-4c76-8363-89061eb21e48-kube-api-access-hfhk2\") pod \"multus-hd7bv\" (UID: \"91c19b45-097e-4c76-8363-89061eb21e48\") " pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:53.921877 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:53.921842    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5h65\" (UniqueName: \"kubernetes.io/projected/10889aca-4e86-4a47-ad90-b0a8d871df3a-kube-api-access-j5h65\") pod \"ovnkube-node-ndt95\" (UID: \"10889aca-4e86-4a47-ad90-b0a8d871df3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:54.010939 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.010908    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8gsx\" (UniqueName: \"kubernetes.io/projected/47d0c172-df3f-43c6-a05e-d482e3d05f5a-kube-api-access-q8gsx\") pod \"node-resolver-2fdh7\" (UID: \"47d0c172-df3f-43c6-a05e-d482e3d05f5a\") " pod="openshift-dns/node-resolver-2fdh7"
Jul 17 16:25:54.010939 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.010945    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2d369cf-18b8-4166-8c42-1aa7751e1b40-cnibin\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.010961    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2d369cf-18b8-4166-8c42-1aa7751e1b40-os-release\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.010976    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2a459d8a-1925-4d20-a34e-8f3a06eccd45-agent-certs\") pod \"konnectivity-agent-hwgtx\" (UID: \"2a459d8a-1925-4d20-a34e-8f3a06eccd45\") " pod="kube-system/konnectivity-agent-hwgtx"
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011010    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfvmt\" (UniqueName: \"kubernetes.io/projected/b33cb135-e718-4b22-a0c6-c5076d54547f-kube-api-access-qfvmt\") pod \"network-metrics-daemon-9t2v9\" (UID: \"b33cb135-e718-4b22-a0c6-c5076d54547f\") " pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011031    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86cvp\" (UniqueName: \"kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp\") pod \"network-check-target-w5lv4\" (UID: \"0a6a4056-a373-47ae-b122-121a00fb2f5d\") " pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011051    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs\") pod \"network-metrics-daemon-9t2v9\" (UID: \"b33cb135-e718-4b22-a0c6-c5076d54547f\") " pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011047    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2d369cf-18b8-4166-8c42-1aa7751e1b40-os-release\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011083    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2d369cf-18b8-4166-8c42-1aa7751e1b40-cni-binary-copy\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011117    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2d369cf-18b8-4166-8c42-1aa7751e1b40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011144    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2d369cf-18b8-4166-8c42-1aa7751e1b40-system-cni-dir\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011044    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2d369cf-18b8-4166-8c42-1aa7751e1b40-cnibin\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011172    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2d369cf-18b8-4166-8c42-1aa7751e1b40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.011181    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011199    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2a459d8a-1925-4d20-a34e-8f3a06eccd45-konnectivity-ca\") pod \"konnectivity-agent-hwgtx\" (UID: \"2a459d8a-1925-4d20-a34e-8f3a06eccd45\") " pod="kube-system/konnectivity-agent-hwgtx"
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011232    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq4xh\" (UniqueName: \"kubernetes.io/projected/b2d369cf-18b8-4166-8c42-1aa7751e1b40-kube-api-access-gq4xh\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.011265    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs podName:b33cb135-e718-4b22-a0c6-c5076d54547f nodeName:}" failed. No retries permitted until 2026-07-17 16:25:54.511244257 +0000 UTC m=+3.370372805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs") pod "network-metrics-daemon-9t2v9" (UID: "b33cb135-e718-4b22-a0c6-c5076d54547f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:25:54.011290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011266    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2d369cf-18b8-4166-8c42-1aa7751e1b40-system-cni-dir\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.012213 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011300    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47d0c172-df3f-43c6-a05e-d482e3d05f5a-hosts-file\") pod \"node-resolver-2fdh7\" (UID: \"47d0c172-df3f-43c6-a05e-d482e3d05f5a\") " pod="openshift-dns/node-resolver-2fdh7"
Jul 17 16:25:54.012213 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011360    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2d369cf-18b8-4166-8c42-1aa7751e1b40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.012213 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011390    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47d0c172-df3f-43c6-a05e-d482e3d05f5a-tmp-dir\") pod \"node-resolver-2fdh7\" (UID: \"47d0c172-df3f-43c6-a05e-d482e3d05f5a\") " pod="openshift-dns/node-resolver-2fdh7"
Jul 17 16:25:54.012213 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011517    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2d369cf-18b8-4166-8c42-1aa7751e1b40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.012213 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011653    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2d369cf-18b8-4166-8c42-1aa7751e1b40-cni-binary-copy\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.012213 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011810    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47d0c172-df3f-43c6-a05e-d482e3d05f5a-tmp-dir\") pod \"node-resolver-2fdh7\" (UID: \"47d0c172-df3f-43c6-a05e-d482e3d05f5a\") " pod="openshift-dns/node-resolver-2fdh7"
Jul 17 16:25:54.012213 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011844    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47d0c172-df3f-43c6-a05e-d482e3d05f5a-hosts-file\") pod \"node-resolver-2fdh7\" (UID: \"47d0c172-df3f-43c6-a05e-d482e3d05f5a\") " pod="openshift-dns/node-resolver-2fdh7"
Jul 17 16:25:54.012213 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.011972    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2d369cf-18b8-4166-8c42-1aa7751e1b40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.012213 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.012131    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2a459d8a-1925-4d20-a34e-8f3a06eccd45-konnectivity-ca\") pod \"konnectivity-agent-hwgtx\" (UID: \"2a459d8a-1925-4d20-a34e-8f3a06eccd45\") " pod="kube-system/konnectivity-agent-hwgtx"
Jul 17 16:25:54.012522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.012300    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2d369cf-18b8-4166-8c42-1aa7751e1b40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.013695 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.013674    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2a459d8a-1925-4d20-a34e-8f3a06eccd45-agent-certs\") pod \"konnectivity-agent-hwgtx\" (UID: \"2a459d8a-1925-4d20-a34e-8f3a06eccd45\") " pod="kube-system/konnectivity-agent-hwgtx"
Jul 17 16:25:54.018667 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.018642    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 16:25:54.018786 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.018673    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 16:25:54.018786 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.018689    2566 projected.go:196] Error preparing data for projected volume kube-api-access-86cvp for pod openshift-network-diagnostics/network-check-target-w5lv4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:25:54.018786 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.018765    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp podName:0a6a4056-a373-47ae-b122-121a00fb2f5d nodeName:}" failed. No retries permitted until 2026-07-17 16:25:54.518746732 +0000 UTC m=+3.377875274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-86cvp" (UniqueName: "kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp") pod "network-check-target-w5lv4" (UID: "0a6a4056-a373-47ae-b122-121a00fb2f5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:25:54.021501 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.021453    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfvmt\" (UniqueName: \"kubernetes.io/projected/b33cb135-e718-4b22-a0c6-c5076d54547f-kube-api-access-qfvmt\") pod \"network-metrics-daemon-9t2v9\" (UID: \"b33cb135-e718-4b22-a0c6-c5076d54547f\") " pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:25:54.021606 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.021594    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8gsx\" (UniqueName: \"kubernetes.io/projected/47d0c172-df3f-43c6-a05e-d482e3d05f5a-kube-api-access-q8gsx\") pod \"node-resolver-2fdh7\" (UID: \"47d0c172-df3f-43c6-a05e-d482e3d05f5a\") " pod="openshift-dns/node-resolver-2fdh7"
Jul 17 16:25:54.022184 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.022167    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq4xh\" (UniqueName: \"kubernetes.io/projected/b2d369cf-18b8-4166-8c42-1aa7751e1b40-kube-api-access-gq4xh\") pod \"multus-additional-cni-plugins-5npd9\" (UID: \"b2d369cf-18b8-4166-8c42-1aa7751e1b40\") " pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.072112 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:54.072081    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod683d05c214521e083e68e452ded0f18c.slice/crio-76d1d12854c1ecdf8245e4a13e6110b195c18850d85d4b5b6e2ac40650d7e595 WatchSource:0}: Error finding container 76d1d12854c1ecdf8245e4a13e6110b195c18850d85d4b5b6e2ac40650d7e595: Status 404 returned error can't find the container with id 76d1d12854c1ecdf8245e4a13e6110b195c18850d85d4b5b6e2ac40650d7e595
Jul 17 16:25:54.078846 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.078807    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 16:25:54.084391 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:54.084370    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaed273ced1ec685d701d62f08b5ef72e.slice/crio-1892de7d7c6a49d5a0ce2b2bf82dfebba22a545e5b2ce72b0f0b0a56451eb774 WatchSource:0}: Error finding container 1892de7d7c6a49d5a0ce2b2bf82dfebba22a545e5b2ce72b0f0b0a56451eb774: Status 404 returned error can't find the container with id 1892de7d7c6a49d5a0ce2b2bf82dfebba22a545e5b2ce72b0f0b0a56451eb774
Jul 17 16:25:54.112783 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.112758    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jncft"
Jul 17 16:25:54.120795 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:54.120769    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod085fe0bb_1721_4665_af0f_1ac3b8ad2e97.slice/crio-7e7239cc9b55d8f09e66563de726605e7008d48841e7dc7a6ba2064671649e85 WatchSource:0}: Error finding container 7e7239cc9b55d8f09e66563de726605e7008d48841e7dc7a6ba2064671649e85: Status 404 returned error can't find the container with id 7e7239cc9b55d8f09e66563de726605e7008d48841e7dc7a6ba2064671649e85
Jul 17 16:25:54.131581 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.131563    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hd7bv"
Jul 17 16:25:54.138486 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.138467    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f5hvw"
Jul 17 16:25:54.141576 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:54.141553    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c19b45_097e_4c76_8363_89061eb21e48.slice/crio-6b76b3cd531c5030555ea5fd179238511185f17c8eb2ee12abb0516e75b491ef WatchSource:0}: Error finding container 6b76b3cd531c5030555ea5fd179238511185f17c8eb2ee12abb0516e75b491ef: Status 404 returned error can't find the container with id 6b76b3cd531c5030555ea5fd179238511185f17c8eb2ee12abb0516e75b491ef
Jul 17 16:25:54.146590 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:54.146571    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d83935_2d3a_48fa_b197_cd104240978c.slice/crio-63afe08938bde293115d29cae4e43d940a72f10d9d802621fd602990e50a58ed WatchSource:0}: Error finding container 63afe08938bde293115d29cae4e43d940a72f10d9d802621fd602990e50a58ed: Status 404 returned error can't find the container with id 63afe08938bde293115d29cae4e43d940a72f10d9d802621fd602990e50a58ed
Jul 17 16:25:54.165124 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.165106    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:25:54.174082 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:54.174056    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10889aca_4e86_4a47_ad90_b0a8d871df3a.slice/crio-e95360b567890e751c506d5e3ecefca07bf23a648baa82275a699eb5d6b48c17 WatchSource:0}: Error finding container e95360b567890e751c506d5e3ecefca07bf23a648baa82275a699eb5d6b48c17: Status 404 returned error can't find the container with id e95360b567890e751c506d5e3ecefca07bf23a648baa82275a699eb5d6b48c17
Jul 17 16:25:54.185716 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.185701    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx"
Jul 17 16:25:54.194189 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:54.194168    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod097872c8_a0da_4b8d_a02d_2370e35515d7.slice/crio-e8512937ad4341b9355ab4f80782ef67c29e73ecf5b7ff16f86906ddc236c94e WatchSource:0}: Error finding container e8512937ad4341b9355ab4f80782ef67c29e73ecf5b7ff16f86906ddc236c94e: Status 404 returned error can't find the container with id e8512937ad4341b9355ab4f80782ef67c29e73ecf5b7ff16f86906ddc236c94e
Jul 17 16:25:54.199424 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.199407    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t8qp9"
Jul 17 16:25:54.208172 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:54.208152    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod115dede8_584f_4994_8c9e_062234350fa6.slice/crio-c171c1eb4f09c9ae9d5791925508017cfbeddfa424e52d4b2becebeeb18df3e4 WatchSource:0}: Error finding container c171c1eb4f09c9ae9d5791925508017cfbeddfa424e52d4b2becebeeb18df3e4: Status 404 returned error can't find the container with id c171c1eb4f09c9ae9d5791925508017cfbeddfa424e52d4b2becebeeb18df3e4
Jul 17 16:25:54.210907 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.210888    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2fdh7"
Jul 17 16:25:54.219359 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:54.219335    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d0c172_df3f_43c6_a05e_d482e3d05f5a.slice/crio-3d2090bac443937191afbdc3dd5816baa2177f9c7ed02c75f479f81697cfb738 WatchSource:0}: Error finding container 3d2090bac443937191afbdc3dd5816baa2177f9c7ed02c75f479f81697cfb738: Status 404 returned error can't find the container with id 3d2090bac443937191afbdc3dd5816baa2177f9c7ed02c75f479f81697cfb738
Jul 17 16:25:54.230483 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.230465    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5npd9"
Jul 17 16:25:54.235574 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.235556    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hwgtx"
Jul 17 16:25:54.238695 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:54.238677    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d369cf_18b8_4166_8c42_1aa7751e1b40.slice/crio-2236aacf78a21b68155fe718fe93485a1891aafccf2e477f8825f75108f5c41d WatchSource:0}: Error finding container 2236aacf78a21b68155fe718fe93485a1891aafccf2e477f8825f75108f5c41d: Status 404 returned error can't find the container with id 2236aacf78a21b68155fe718fe93485a1891aafccf2e477f8825f75108f5c41d
Jul 17 16:25:54.244044 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:25:54.244025    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a459d8a_1925_4d20_a34e_8f3a06eccd45.slice/crio-a2c8457d888810f634940ecfa29361c426a8a2ee0447ee51241c1a0dc83fbb58 WatchSource:0}: Error finding container a2c8457d888810f634940ecfa29361c426a8a2ee0447ee51241c1a0dc83fbb58: Status 404 returned error can't find the container with id a2c8457d888810f634940ecfa29361c426a8a2ee0447ee51241c1a0dc83fbb58
Jul 17 16:25:54.245715 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.245686    2566 kuberuntime_manager.go:1459] "Unhandled Error" err="container konnectivity-agent start failed in pod konnectivity-agent-hwgtx_kube-system(2a459d8a-1925-4d20-a34e-8f3a06eccd45): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 17 16:25:54.245801 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.245723    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ErrImagePull: \"pull QPS exceeded\"" pod="kube-system/konnectivity-agent-hwgtx" podUID="2a459d8a-1925-4d20-a34e-8f3a06eccd45"
Jul 17 16:25:54.326174 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.326147    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 16:25:54.413656 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.413561    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:54.413813 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.413685    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 16:25:54.413813 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.413754    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret podName:a98da8bd-6084-493e-bc85-56ec89e8c692 nodeName:}" failed. No retries permitted until 2026-07-17 16:25:55.413734244 +0000 UTC m=+4.272862782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret") pod "global-pull-secret-syncer-2h942" (UID: "a98da8bd-6084-493e-bc85-56ec89e8c692") : object "kube-system"/"original-pull-secret" not registered
Jul 17 16:25:54.514260 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.514228    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs\") pod \"network-metrics-daemon-9t2v9\" (UID: \"b33cb135-e718-4b22-a0c6-c5076d54547f\") " pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:25:54.514449 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.514367    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:25:54.514449 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.514433    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs podName:b33cb135-e718-4b22-a0c6-c5076d54547f nodeName:}" failed. No retries permitted until 2026-07-17 16:25:55.514413675 +0000 UTC m=+4.373542217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs") pod "network-metrics-daemon-9t2v9" (UID: "b33cb135-e718-4b22-a0c6-c5076d54547f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:25:54.615292 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.615262    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86cvp\" (UniqueName: \"kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp\") pod \"network-check-target-w5lv4\" (UID: \"0a6a4056-a373-47ae-b122-121a00fb2f5d\") " pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:25:54.615469 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.615436    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 16:25:54.615469 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.615452    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 16:25:54.615469 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.615461    2566 projected.go:196] Error preparing data for projected volume kube-api-access-86cvp for pod openshift-network-diagnostics/network-check-target-w5lv4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:25:54.615589 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:54.615525    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp podName:0a6a4056-a373-47ae-b122-121a00fb2f5d nodeName:}" failed. No retries permitted until 2026-07-17 16:25:55.615507224 +0000 UTC m=+4.474635776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-86cvp" (UniqueName: "kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp") pod "network-check-target-w5lv4" (UID: "0a6a4056-a373-47ae-b122-121a00fb2f5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:25:54.800549 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.800464    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 16:25:54.852888 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.852763    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 16:20:54 +0000 UTC" deadline="2028-04-25 22:55:39.507347312 +0000 UTC"
Jul 17 16:25:54.852888 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.852830    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15558h29m44.654522001s"
Jul 17 16:25:54.875706 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:54.875359    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 16:25:55.026746 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.025939    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:55.026746 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:55.026080    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:25:55.026746 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.026562    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:25:55.026746 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:55.026689    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:25:55.047092 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.047032    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hwgtx" event={"ID":"2a459d8a-1925-4d20-a34e-8f3a06eccd45","Type":"ContainerStarted","Data":"a2c8457d888810f634940ecfa29361c426a8a2ee0447ee51241c1a0dc83fbb58"}
Jul 17 16:25:55.060168 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:55.060130    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e6cee53a67cbe2094b527990bd1d0d668c31dc268b25bb101309f07fab93715\\\": ErrImagePull: pull QPS exceeded\"" pod="kube-system/konnectivity-agent-hwgtx" podUID="2a459d8a-1925-4d20-a34e-8f3a06eccd45"
Jul 17 16:25:55.071866 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.071833    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5npd9" event={"ID":"b2d369cf-18b8-4166-8c42-1aa7751e1b40","Type":"ContainerStarted","Data":"2236aacf78a21b68155fe718fe93485a1891aafccf2e477f8825f75108f5c41d"}
Jul 17 16:25:55.081493 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.081463    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2fdh7" event={"ID":"47d0c172-df3f-43c6-a05e-d482e3d05f5a","Type":"ContainerStarted","Data":"3d2090bac443937191afbdc3dd5816baa2177f9c7ed02c75f479f81697cfb738"}
Jul 17 16:25:55.090638 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.090609    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95" event={"ID":"10889aca-4e86-4a47-ad90-b0a8d871df3a","Type":"ContainerStarted","Data":"e95360b567890e751c506d5e3ecefca07bf23a648baa82275a699eb5d6b48c17"}
Jul 17 16:25:55.097543 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.097490    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hd7bv" event={"ID":"91c19b45-097e-4c76-8363-89061eb21e48","Type":"ContainerStarted","Data":"6b76b3cd531c5030555ea5fd179238511185f17c8eb2ee12abb0516e75b491ef"}
Jul 17 16:25:55.101060 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.101031    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-95.ec2.internal" event={"ID":"aed273ced1ec685d701d62f08b5ef72e","Type":"ContainerStarted","Data":"1892de7d7c6a49d5a0ce2b2bf82dfebba22a545e5b2ce72b0f0b0a56451eb774"}
Jul 17 16:25:55.108189 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.108160    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t8qp9" event={"ID":"115dede8-584f-4994-8c9e-062234350fa6","Type":"ContainerStarted","Data":"c171c1eb4f09c9ae9d5791925508017cfbeddfa424e52d4b2becebeeb18df3e4"}
Jul 17 16:25:55.117257 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.117230    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx" event={"ID":"097872c8-a0da-4b8d-a02d-2370e35515d7","Type":"ContainerStarted","Data":"e8512937ad4341b9355ab4f80782ef67c29e73ecf5b7ff16f86906ddc236c94e"}
Jul 17 16:25:55.127798 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.127771    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f5hvw" event={"ID":"e4d83935-2d3a-48fa-b197-cd104240978c","Type":"ContainerStarted","Data":"63afe08938bde293115d29cae4e43d940a72f10d9d802621fd602990e50a58ed"}
Jul 17 16:25:55.134034 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.133982    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jncft" event={"ID":"085fe0bb-1721-4665-af0f-1ac3b8ad2e97","Type":"ContainerStarted","Data":"7e7239cc9b55d8f09e66563de726605e7008d48841e7dc7a6ba2064671649e85"}
Jul 17 16:25:55.142763 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.142736    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal" event={"ID":"683d05c214521e083e68e452ded0f18c","Type":"ContainerStarted","Data":"76d1d12854c1ecdf8245e4a13e6110b195c18850d85d4b5b6e2ac40650d7e595"}
Jul 17 16:25:55.425888 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.425126    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:55.425888 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:55.425379    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 16:25:55.425888 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:55.425451    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret podName:a98da8bd-6084-493e-bc85-56ec89e8c692 nodeName:}" failed. No retries permitted until 2026-07-17 16:25:57.425431436 +0000 UTC m=+6.284560000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret") pod "global-pull-secret-syncer-2h942" (UID: "a98da8bd-6084-493e-bc85-56ec89e8c692") : object "kube-system"/"original-pull-secret" not registered
Jul 17 16:25:55.525931 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.525896    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs\") pod \"network-metrics-daemon-9t2v9\" (UID: \"b33cb135-e718-4b22-a0c6-c5076d54547f\") " pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:25:55.526131 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:55.526073    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:25:55.526204 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:55.526173    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs podName:b33cb135-e718-4b22-a0c6-c5076d54547f nodeName:}" failed. No retries permitted until 2026-07-17 16:25:57.526149364 +0000 UTC m=+6.385277916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs") pod "network-metrics-daemon-9t2v9" (UID: "b33cb135-e718-4b22-a0c6-c5076d54547f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:25:55.626760 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.626718    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86cvp\" (UniqueName: \"kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp\") pod \"network-check-target-w5lv4\" (UID: \"0a6a4056-a373-47ae-b122-121a00fb2f5d\") " pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:25:55.626947 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:55.626917    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 16:25:55.626947 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:55.626938    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 16:25:55.627067 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:55.626951    2566 projected.go:196] Error preparing data for projected volume kube-api-access-86cvp for pod openshift-network-diagnostics/network-check-target-w5lv4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:25:55.627067 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:55.627014    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp podName:0a6a4056-a373-47ae-b122-121a00fb2f5d nodeName:}" failed. No retries permitted until 2026-07-17 16:25:57.626994997 +0000 UTC m=+6.486123539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-86cvp" (UniqueName: "kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp") pod "network-check-target-w5lv4" (UID: "0a6a4056-a373-47ae-b122-121a00fb2f5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:25:55.854065 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.853942    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 16:20:54 +0000 UTC" deadline="2028-02-18 19:35:06.137760585 +0000 UTC"
Jul 17 16:25:55.854065 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:55.854006    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13947h9m10.283758682s"
Jul 17 16:25:56.026073 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:56.025408    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:25:56.026073 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:56.025547    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:25:57.026205 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:57.025670    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:25:57.026205 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:57.025825    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:25:57.027158 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:57.026969    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:57.027158 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:57.027077    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:25:57.446751 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:57.446023    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:57.446751 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:57.446208    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 16:25:57.446751 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:57.446280    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret podName:a98da8bd-6084-493e-bc85-56ec89e8c692 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:01.446259537 +0000 UTC m=+10.305388096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret") pod "global-pull-secret-syncer-2h942" (UID: "a98da8bd-6084-493e-bc85-56ec89e8c692") : object "kube-system"/"original-pull-secret" not registered
Jul 17 16:25:57.546769 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:57.546727    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs\") pod \"network-metrics-daemon-9t2v9\" (UID: \"b33cb135-e718-4b22-a0c6-c5076d54547f\") " pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:25:57.547009 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:57.546907    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:25:57.547009 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:57.546975    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs podName:b33cb135-e718-4b22-a0c6-c5076d54547f nodeName:}" failed. No retries permitted until 2026-07-17 16:26:01.546955989 +0000 UTC m=+10.406084549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs") pod "network-metrics-daemon-9t2v9" (UID: "b33cb135-e718-4b22-a0c6-c5076d54547f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:25:57.648407 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:57.647698    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86cvp\" (UniqueName: \"kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp\") pod \"network-check-target-w5lv4\" (UID: \"0a6a4056-a373-47ae-b122-121a00fb2f5d\") " pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:25:57.648407 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:57.647908    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 16:25:57.648407 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:57.647929    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 16:25:57.648407 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:57.647942    2566 projected.go:196] Error preparing data for projected volume kube-api-access-86cvp for pod openshift-network-diagnostics/network-check-target-w5lv4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:25:57.648407 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:57.648006    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp podName:0a6a4056-a373-47ae-b122-121a00fb2f5d nodeName:}" failed. No retries permitted until 2026-07-17 16:26:01.647986872 +0000 UTC m=+10.507115428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-86cvp" (UniqueName: "kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp") pod "network-check-target-w5lv4" (UID: "0a6a4056-a373-47ae-b122-121a00fb2f5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:25:58.026502 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:58.026424    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:25:58.026989 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:58.026547    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:25:59.028836 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:59.027919    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:25:59.028836 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:59.028041    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:25:59.028836 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:25:59.028403    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:25:59.028836 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:25:59.028506    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:00.025787 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:00.025755    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:00.025976 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:00.025871    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:26:01.026075 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:01.026039    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:01.026574 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:01.026039    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:01.026574 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:01.026187    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:01.026574 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:01.026281    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:01.478805 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:01.478645    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:01.478968 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:01.478808    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:01.478968 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:01.478877    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret podName:a98da8bd-6084-493e-bc85-56ec89e8c692 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:09.47885796 +0000 UTC m=+18.337986509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret") pod "global-pull-secret-syncer-2h942" (UID: "a98da8bd-6084-493e-bc85-56ec89e8c692") : object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:01.580277 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:01.580036    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs\") pod \"network-metrics-daemon-9t2v9\" (UID: \"b33cb135-e718-4b22-a0c6-c5076d54547f\") " pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:01.580277 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:01.580186    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:01.580277 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:01.580261    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs podName:b33cb135-e718-4b22-a0c6-c5076d54547f nodeName:}" failed. No retries permitted until 2026-07-17 16:26:09.580239021 +0000 UTC m=+18.439367561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs") pod "network-metrics-daemon-9t2v9" (UID: "b33cb135-e718-4b22-a0c6-c5076d54547f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:01.681000 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:01.680963    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86cvp\" (UniqueName: \"kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp\") pod \"network-check-target-w5lv4\" (UID: \"0a6a4056-a373-47ae-b122-121a00fb2f5d\") " pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:01.681175 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:01.681149    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 16:26:01.681238 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:01.681192    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 16:26:01.681238 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:01.681207    2566 projected.go:196] Error preparing data for projected volume kube-api-access-86cvp for pod openshift-network-diagnostics/network-check-target-w5lv4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:01.681357 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:01.681277    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp podName:0a6a4056-a373-47ae-b122-121a00fb2f5d nodeName:}" failed. No retries permitted until 2026-07-17 16:26:09.681256228 +0000 UTC m=+18.540384772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-86cvp" (UniqueName: "kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp") pod "network-check-target-w5lv4" (UID: "0a6a4056-a373-47ae-b122-121a00fb2f5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:02.025825 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:02.025787    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:02.025968 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:02.025920    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:26:03.027225 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:03.027185    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:03.027690 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:03.027374    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:03.028018 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:03.027821    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:03.028018 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:03.027965    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:04.025706 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:04.025671    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:04.025884 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:04.025804    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:26:05.026091 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:05.026058    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:05.026553 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:05.026149    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:05.026553 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:05.026262    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:05.026553 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:05.026409    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:06.025981 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:06.025941    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:06.026169 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:06.026066    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:26:07.026070 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:07.026033    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:07.026249 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:07.026172    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:07.026249 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:07.026223    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:07.026640 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:07.026370    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:08.025517 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:08.025484    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:08.025699 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:08.025612    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:26:09.025558 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:09.025522    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:09.025558 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:09.025550    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:09.025961 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:09.025820    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:09.025961 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:09.025943    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:09.536148 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:09.536110    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:09.536366 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:09.536281    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:09.536443 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:09.536374    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret podName:a98da8bd-6084-493e-bc85-56ec89e8c692 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:25.536351686 +0000 UTC m=+34.395480243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret") pod "global-pull-secret-syncer-2h942" (UID: "a98da8bd-6084-493e-bc85-56ec89e8c692") : object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:09.636801 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:09.636764    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs\") pod \"network-metrics-daemon-9t2v9\" (UID: \"b33cb135-e718-4b22-a0c6-c5076d54547f\") " pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:09.636990 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:09.636938    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:09.637052 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:09.637009    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs podName:b33cb135-e718-4b22-a0c6-c5076d54547f nodeName:}" failed. No retries permitted until 2026-07-17 16:26:25.636990512 +0000 UTC m=+34.496119052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs") pod "network-metrics-daemon-9t2v9" (UID: "b33cb135-e718-4b22-a0c6-c5076d54547f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:09.737594 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:09.737558    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86cvp\" (UniqueName: \"kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp\") pod \"network-check-target-w5lv4\" (UID: \"0a6a4056-a373-47ae-b122-121a00fb2f5d\") " pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:09.737789 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:09.737727    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 16:26:09.737789 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:09.737753    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 16:26:09.737789 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:09.737765    2566 projected.go:196] Error preparing data for projected volume kube-api-access-86cvp for pod openshift-network-diagnostics/network-check-target-w5lv4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:09.737941 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:09.737817    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp podName:0a6a4056-a373-47ae-b122-121a00fb2f5d nodeName:}" failed. No retries permitted until 2026-07-17 16:26:25.737802133 +0000 UTC m=+34.596930690 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-86cvp" (UniqueName: "kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp") pod "network-check-target-w5lv4" (UID: "0a6a4056-a373-47ae-b122-121a00fb2f5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:10.026369 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:10.026287    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:10.026754 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:10.026406    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:26:11.026472 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:11.026440    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:11.026929 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:11.026556    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:11.026929 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:11.026617    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:11.026929 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:11.026733    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:12.025541 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:12.025508    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:12.025703 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:12.025614    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:26:13.026611 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:13.026576    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:13.027020 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:13.026680    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:13.027020 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:13.026770    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:13.027020 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:13.026879    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:14.027162 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.026430    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:14.027162 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:14.026877    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:26:14.197597 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.197569    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jncft" event={"ID":"085fe0bb-1721-4665-af0f-1ac3b8ad2e97","Type":"ContainerStarted","Data":"04bbe20672d5436cf574aef9c48afe3ded0c9d0414af40b01f59fb806c9ba8bf"}
Jul 17 16:26:14.200146 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.200126    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5npd9" event={"ID":"b2d369cf-18b8-4166-8c42-1aa7751e1b40","Type":"ContainerStarted","Data":"6e4367ddb24d2925234d3c9db4129654abf3a2e66d489ccdee81ae01e79ea1d3"}
Jul 17 16:26:14.201467 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.201438    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2fdh7" event={"ID":"47d0c172-df3f-43c6-a05e-d482e3d05f5a","Type":"ContainerStarted","Data":"f11cd2e4f5dda99ae71e047887e6861adb5dc5f9bc858f51c3956a5d59e6fa7f"}
Jul 17 16:26:14.203174 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.203156    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95" event={"ID":"10889aca-4e86-4a47-ad90-b0a8d871df3a","Type":"ContainerStarted","Data":"73593101577fa8b2648ad1a9294f64eb688ccd871c42a73114c62a94be5f9330"}
Jul 17 16:26:14.203249 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.203208    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95" event={"ID":"10889aca-4e86-4a47-ad90-b0a8d871df3a","Type":"ContainerStarted","Data":"71bf62e946ec345fe29d4e790fb550ae3a67e449e2b898826792319b392fe9d2"}
Jul 17 16:26:14.204367 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.204345    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hd7bv" event={"ID":"91c19b45-097e-4c76-8363-89061eb21e48","Type":"ContainerStarted","Data":"8c63c4202365d5c89b5055ea2757691807345484ae9085f86b016df748558631"}
Jul 17 16:26:14.205481 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.205456    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-95.ec2.internal" event={"ID":"aed273ced1ec685d701d62f08b5ef72e","Type":"ContainerStarted","Data":"0a0385600f7baa580a19964dafa38c9c8d8bd69dcbad436e1d4576e4e04b2d1d"}
Jul 17 16:26:14.206673 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.206653    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t8qp9" event={"ID":"115dede8-584f-4994-8c9e-062234350fa6","Type":"ContainerStarted","Data":"7d8a97bc3b2b9727e72cfff187cf556318b938102ba67ff6d7cbe9631053bf47"}
Jul 17 16:26:14.207905 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.207888    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx" event={"ID":"097872c8-a0da-4b8d-a02d-2370e35515d7","Type":"ContainerStarted","Data":"02b496c133c97eadb0297e186381902f26a41ff544113207e2b0aa7ced9a0e30"}
Jul 17 16:26:14.214067 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.214028    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jncft" podStartSLOduration=1.7225372380000001 podStartE2EDuration="21.214004076s" totalImagesPullingTime="19.491466838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:14.213762784 +0000 UTC m=+23.072891342" watchObservedRunningTime="2026-07-17 16:26:14.214004076 +0000 UTC m=+23.073132613"
Jul 17 16:26:14.270804 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.268639    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-95.ec2.internal" podStartSLOduration=21.268621989 podStartE2EDuration="21.268621989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:14.232578984 +0000 UTC m=+23.091707533" watchObservedRunningTime="2026-07-17 16:26:14.268621989 +0000 UTC m=+23.127750549"
Jul 17 16:26:14.326717 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.326654    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t8qp9" podStartSLOduration=1.921055307 podStartE2EDuration="21.326634533s" totalImagesPullingTime="19.405579226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:14.269697786 +0000 UTC m=+23.128826338" watchObservedRunningTime="2026-07-17 16:26:14.326634533 +0000 UTC m=+23.185763095"
Jul 17 16:26:14.350633 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.350591    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hd7bv" podStartSLOduration=1.859837298 podStartE2EDuration="21.350578943s" totalImagesPullingTime="19.490741645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:14.350223551 +0000 UTC m=+23.209352111" watchObservedRunningTime="2026-07-17 16:26:14.350578943 +0000 UTC m=+23.209707524"
Jul 17 16:26:14.366692 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:14.366650    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2fdh7" podStartSLOduration=1.9731218959999999 podStartE2EDuration="21.366633938s" totalImagesPullingTime="19.393512042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:14.366064207 +0000 UTC m=+23.225192762" watchObservedRunningTime="2026-07-17 16:26:14.366633938 +0000 UTC m=+23.225762502"
Jul 17 16:26:15.025522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.025449    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:15.025522 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.025489    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:15.025948 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:15.025905    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:15.026022 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:15.026001    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:15.211671 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.211593    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hwgtx" event={"ID":"2a459d8a-1925-4d20-a34e-8f3a06eccd45","Type":"ContainerStarted","Data":"d832bd80dd966d4b65ade97aafdb5a1aacfbfe513f5799a61012db315ae4fe48"}
Jul 17 16:26:15.214886 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.214861    2566 generic.go:356] "Generic (PLEG): container finished" podID="b2d369cf-18b8-4166-8c42-1aa7751e1b40" containerID="6e4367ddb24d2925234d3c9db4129654abf3a2e66d489ccdee81ae01e79ea1d3" exitCode=0
Jul 17 16:26:15.215014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.214943    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5npd9" event={"ID":"b2d369cf-18b8-4166-8c42-1aa7751e1b40","Type":"ContainerDied","Data":"6e4367ddb24d2925234d3c9db4129654abf3a2e66d489ccdee81ae01e79ea1d3"}
Jul 17 16:26:15.218160 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.218137    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95" event={"ID":"10889aca-4e86-4a47-ad90-b0a8d871df3a","Type":"ContainerStarted","Data":"b3278a5c1ebaea344a02d7eeb1815ac36e191be2e72e334019016807183634c8"}
Jul 17 16:26:15.218251 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.218214    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95" event={"ID":"10889aca-4e86-4a47-ad90-b0a8d871df3a","Type":"ContainerStarted","Data":"93ce96b6243e61334e09de472e347d48361dc7c7b6eb54d711ac2c74997878c9"}
Jul 17 16:26:15.218372 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.218267    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95" event={"ID":"10889aca-4e86-4a47-ad90-b0a8d871df3a","Type":"ContainerStarted","Data":"e43af83d4de572af7161c085d7caa0ddc0b74e39e964dc34a0d930f5c21ef51d"}
Jul 17 16:26:15.218372 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.218313    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95" event={"ID":"10889aca-4e86-4a47-ad90-b0a8d871df3a","Type":"ContainerStarted","Data":"ff9d55147627e50a1265d474e37dab5d27d868468455a78b1fb9cf239ff54790"}
Jul 17 16:26:15.219534 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.219508    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f5hvw" event={"ID":"e4d83935-2d3a-48fa-b197-cd104240978c","Type":"ContainerStarted","Data":"d9be96dbab01ce1bc507e1dafc8ec1f33ae7892c259e48f803db2f72c068f8cf"}
Jul 17 16:26:15.221214 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.221194    2566 generic.go:356] "Generic (PLEG): container finished" podID="683d05c214521e083e68e452ded0f18c" containerID="7e1648c96d6e59171c0e9fbec5c3ceea7af413fd813c1c952c02b2c29275ee24" exitCode=0
Jul 17 16:26:15.221308 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.221284    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal" event={"ID":"683d05c214521e083e68e452ded0f18c","Type":"ContainerDied","Data":"7e1648c96d6e59171c0e9fbec5c3ceea7af413fd813c1c952c02b2c29275ee24"}
Jul 17 16:26:15.232411 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.232377    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hwgtx" podStartSLOduration=1.552455289 podStartE2EDuration="22.23236439s" totalImagesPullingTime="20.679909101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-17 16:26:15.232070843 +0000 UTC m=+24.091199403" watchObservedRunningTime="2026-07-17 16:26:15.23236439 +0000 UTC m=+24.091492949"
Jul 17 16:26:15.300766 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.300726    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f5hvw" podStartSLOduration=2.857557007 podStartE2EDuration="22.300710694s" totalImagesPullingTime="19.443153687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:15.300672325 +0000 UTC m=+24.159800883" watchObservedRunningTime="2026-07-17 16:26:15.300710694 +0000 UTC m=+24.159839253"
Jul 17 16:26:15.893560 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.893541    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 16:26:15.935023 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.934941    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T16:26:15.893557897Z","UUID":"70b4d152-9638-4543-afe5-8d1d5f4d4151","Handler":null,"Name":"","Endpoint":""}
Jul 17 16:26:15.936485 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.936464    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 16:26:15.936581 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:15.936504    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 16:26:16.026382 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:16.026348    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:16.026528 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:16.026442    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:26:16.224899 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:16.224828    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx" event={"ID":"097872c8-a0da-4b8d-a02d-2370e35515d7","Type":"ContainerStarted","Data":"cd60f1cbdccb025391c04cf85fda79a92e02c97998c5459561fdd6ae7b933be9"}
Jul 17 16:26:16.226446 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:16.226423    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal" event={"ID":"683d05c214521e083e68e452ded0f18c","Type":"ContainerStarted","Data":"94eb3d86bb5adecf7641668faba3494e286cfd23a03a6464bb06dad15b0f92a8"}
Jul 17 16:26:17.025782 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:17.025756    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:17.026061 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:17.025891    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:17.026061 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:17.025945    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:17.026179 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:17.026060    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:17.231233 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:17.231193    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx" event={"ID":"097872c8-a0da-4b8d-a02d-2370e35515d7","Type":"ContainerStarted","Data":"193b77eef9ed5c8d61a925108ef25f39a89ea73590014ee49078a0eafaa84d73"}
Jul 17 16:26:18.025406 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:18.025380    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:18.025619 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:18.025482    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:26:18.236056 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:18.236016    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95" event={"ID":"10889aca-4e86-4a47-ad90-b0a8d871df3a","Type":"ContainerStarted","Data":"881675b728c844542c355e5bac3842cfdf92cf6066f73772202ec2fa52e4c267"}
Jul 17 16:26:18.267473 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:18.267431    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-95.ec2.internal" podStartSLOduration=25.26741704 podStartE2EDuration="25.26741704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:16.244969067 +0000 UTC m=+25.104097792" watchObservedRunningTime="2026-07-17 16:26:18.26741704 +0000 UTC m=+27.126545598"
Jul 17 16:26:18.267742 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:18.267722    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-phwdx" podStartSLOduration=3.011681639 podStartE2EDuration="25.267718128s" totalImagesPullingTime="22.256036489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:18.26748191 +0000 UTC m=+27.126610468" watchObservedRunningTime="2026-07-17 16:26:18.267718128 +0000 UTC m=+27.126846687"
Jul 17 16:26:19.025871 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:19.025834    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:19.026029 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:19.025939    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:19.026029 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:19.026001    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:19.026137 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:19.026115    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:19.236582 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:19.236551    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hwgtx"
Jul 17 16:26:19.237175 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:19.237144    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hwgtx"
Jul 17 16:26:20.026057 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:20.025865    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:20.026235 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:20.026160    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:26:20.243224 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:20.243188    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95" event={"ID":"10889aca-4e86-4a47-ad90-b0a8d871df3a","Type":"ContainerStarted","Data":"06581d2f8e97e029fb642d352eed5e845215d1aee528c615784aa66281b73e28"}
Jul 17 16:26:20.243760 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:20.243571    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hwgtx"
Jul 17 16:26:20.243760 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:20.243621    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:26:20.243923 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:20.243907    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hwgtx"
Jul 17 16:26:20.273506 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:20.273465    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95" podStartSLOduration=7.58122856 podStartE2EDuration="27.27345335s" totalImagesPullingTime="19.69222479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:20.273199377 +0000 UTC m=+29.132327935" watchObservedRunningTime="2026-07-17 16:26:20.27345335 +0000 UTC m=+29.132581908"
Jul 17 16:26:21.026457 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:21.026419    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:21.026650 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:21.026558    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:21.026650 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:21.026591    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:21.026769 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:21.026731    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:21.246117 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:21.246086    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:26:21.246680 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:21.246177    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:26:21.262827 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:21.262688    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:26:21.262966 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:21.262840    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:26:21.674327 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:21.674288    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2h942"]
Jul 17 16:26:21.674504 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:21.674486    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:21.674628 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:21.674599    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:21.676906 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:21.676866    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9t2v9"]
Jul 17 16:26:21.677048 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:21.676986    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:21.677142 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:21.677081    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:21.677624 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:21.677603    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w5lv4"]
Jul 17 16:26:21.677707 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:21.677687    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:21.677882 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:21.677773    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:26:23.026095 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:23.026059    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:23.026095 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:23.026090    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:23.026696 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:23.026151    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:23.026696 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:23.026263    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:23.250685 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:23.250654    2566 generic.go:356] "Generic (PLEG): container finished" podID="b2d369cf-18b8-4166-8c42-1aa7751e1b40" containerID="55b3ea6333f797e246c1d43c0740e87488a51a38c133c7d4b049c3d0dad7504e" exitCode=0
Jul 17 16:26:23.250821 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:23.250736    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5npd9" event={"ID":"b2d369cf-18b8-4166-8c42-1aa7751e1b40","Type":"ContainerDied","Data":"55b3ea6333f797e246c1d43c0740e87488a51a38c133c7d4b049c3d0dad7504e"}
Jul 17 16:26:24.026547 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:24.026334    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:24.026992 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:24.026617    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:26:25.025715 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:25.025686    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:25.025895 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:25.025787    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:25.025895 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:25.025885    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:25.026015 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:25.025994    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:25.256375 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:25.256342    2566 generic.go:356] "Generic (PLEG): container finished" podID="b2d369cf-18b8-4166-8c42-1aa7751e1b40" containerID="38eb5644694a0c1b5128dee5fa238d311997b3f51c5dceca07a95f8a18c0d157" exitCode=0
Jul 17 16:26:25.256697 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:25.256416    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5npd9" event={"ID":"b2d369cf-18b8-4166-8c42-1aa7751e1b40","Type":"ContainerDied","Data":"38eb5644694a0c1b5128dee5fa238d311997b3f51c5dceca07a95f8a18c0d157"}
Jul 17 16:26:25.549821 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:25.549789    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:25.549964 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:25.549925    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:25.549998 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:25.549978    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret podName:a98da8bd-6084-493e-bc85-56ec89e8c692 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:57.549960149 +0000 UTC m=+66.409088688 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret") pod "global-pull-secret-syncer-2h942" (UID: "a98da8bd-6084-493e-bc85-56ec89e8c692") : object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:25.650883 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:25.650854    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs\") pod \"network-metrics-daemon-9t2v9\" (UID: \"b33cb135-e718-4b22-a0c6-c5076d54547f\") " pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:25.651024 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:25.650994    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:25.651058 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:25.651051    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs podName:b33cb135-e718-4b22-a0c6-c5076d54547f nodeName:}" failed. No retries permitted until 2026-07-17 16:26:57.651032399 +0000 UTC m=+66.510160944 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs") pod "network-metrics-daemon-9t2v9" (UID: "b33cb135-e718-4b22-a0c6-c5076d54547f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:25.751659 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:25.751634    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86cvp\" (UniqueName: \"kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp\") pod \"network-check-target-w5lv4\" (UID: \"0a6a4056-a373-47ae-b122-121a00fb2f5d\") " pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:25.751794 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:25.751754    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 16:26:25.751794 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:25.751771    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 16:26:25.751794 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:25.751780    2566 projected.go:196] Error preparing data for projected volume kube-api-access-86cvp for pod openshift-network-diagnostics/network-check-target-w5lv4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:25.751883 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:25.751828    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp podName:0a6a4056-a373-47ae-b122-121a00fb2f5d nodeName:}" failed. No retries permitted until 2026-07-17 16:26:57.751810986 +0000 UTC m=+66.610939526 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-86cvp" (UniqueName: "kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp") pod "network-check-target-w5lv4" (UID: "0a6a4056-a373-47ae-b122-121a00fb2f5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:26.025980 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:26.025909    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:26.026117 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:26.026017    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5lv4" podUID="0a6a4056-a373-47ae-b122-121a00fb2f5d"
Jul 17 16:26:27.026006 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.025974    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:27.026452 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.025973    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:27.026452 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:27.026104    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t2v9" podUID="b33cb135-e718-4b22-a0c6-c5076d54547f"
Jul 17 16:26:27.026452 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:27.026146    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h942" podUID="a98da8bd-6084-493e-bc85-56ec89e8c692"
Jul 17 16:26:27.262736 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.262707    2566 generic.go:356] "Generic (PLEG): container finished" podID="b2d369cf-18b8-4166-8c42-1aa7751e1b40" containerID="ba82ff0458c444fa90e647600b4552528e5f906328dcd866c9de098f1810d01d" exitCode=0
Jul 17 16:26:27.262863 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.262768    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5npd9" event={"ID":"b2d369cf-18b8-4166-8c42-1aa7751e1b40","Type":"ContainerDied","Data":"ba82ff0458c444fa90e647600b4552528e5f906328dcd866c9de098f1810d01d"}
Jul 17 16:26:27.458517 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.458495    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-95.ec2.internal" event="NodeReady"
Jul 17 16:26:27.458669 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.458596    2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 16:26:27.493086 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.493058    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c5cd6cfdc-g486j"]
Jul 17 16:26:27.507708 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.507690    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"]
Jul 17 16:26:27.507815 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.507798    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.509894 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.509871    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 17 16:26:27.510000 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.509968    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ktnr2\""
Jul 17 16:26:27.510000 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.509986    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 17 16:26:27.510223 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.510208    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 17 16:26:27.518176 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.517955    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 17 16:26:27.529098 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.529037    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5gsh8"]
Jul 17 16:26:27.529195 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.529169    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:27.531237 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.531217    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 17 16:26:27.531354 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.531221    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-sft2p\""
Jul 17 16:26:27.531491 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.531473    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 16:26:27.531583 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.531532    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 16:26:27.531881 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.531863    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 17 16:26:27.535941 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.535916    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76"]
Jul 17 16:26:27.536533 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.536503    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.539117 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.539094    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 17 16:26:27.539419 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.539395    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nqmtm\""
Jul 17 16:26:27.539565 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.539550    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 16:26:27.539641 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.539575    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 16:26:27.539641 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.539620    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 17 16:26:27.545499 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.545480    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 17 16:26:27.546240 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.546222    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-btp2x"]
Jul 17 16:26:27.546552 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.546414    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76"
Jul 17 16:26:27.548749 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.548728    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 17 16:26:27.548857 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.548805    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 17 16:26:27.548960 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.548944    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 17 16:26:27.549048 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.549033    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sddkx\""
Jul 17 16:26:27.549115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.549093    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 17 16:26:27.554478 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.554457    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c5cd6cfdc-g486j"]
Jul 17 16:26:27.554552 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.554496    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m"]
Jul 17 16:26:27.554586 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.554559    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-btp2x"
Jul 17 16:26:27.557066 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.557031    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 17 16:26:27.557265 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.557128    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 17 16:26:27.557378 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.557287    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-n5knj\""
Jul 17 16:26:27.564328 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.564298    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-k8z54"]
Jul 17 16:26:27.564421 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.564401    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m"
Jul 17 16:26:27.566358 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.566338    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 17 16:26:27.566452 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.566383    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 17 16:26:27.566716 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.566698    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fc6kf\""
Jul 17 16:26:27.567179 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.567154    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 17 16:26:27.567266 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.567158    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 17 16:26:27.574796 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.574777    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"]
Jul 17 16:26:27.574890 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.574873    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:27.576688 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.576671    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sqqmj\""
Jul 17 16:26:27.576817 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.576803    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 17 16:26:27.576869 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.576842    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 17 16:26:27.576939 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.576921    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 17 16:26:27.577226 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.577210    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 17 16:26:27.581477 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.581461    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 17 16:26:27.584837 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.584822    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-btp2x"]
Jul 17 16:26:27.584896 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.584847    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76"]
Jul 17 16:26:27.584896 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.584861    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"]
Jul 17 16:26:27.584896 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.584877    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5gsh8"]
Jul 17 16:26:27.584896 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.584893    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zwg7q"]
Jul 17 16:26:27.585016 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.584925    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"
Jul 17 16:26:27.586809 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.586793    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 17 16:26:27.586875 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.586862    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 17 16:26:27.587149 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.587119    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 17 16:26:27.587618 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.587519    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x4qjt\""
Jul 17 16:26:27.595242 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.595220    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-c44fh"]
Jul 17 16:26:27.595340 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.595300    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zwg7q"
Jul 17 16:26:27.597851 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.597827    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 16:26:27.597949 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.597854    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j87cv\""
Jul 17 16:26:27.597949 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.597895    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 16:26:27.597949 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.597839    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 16:26:27.603411 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.603394    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m"]
Jul 17 16:26:27.603486 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.603420    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-k8z54"]
Jul 17 16:26:27.603486 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.603434    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7559574b98-mjpbg"]
Jul 17 16:26:27.603547 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.603487    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c44fh"
Jul 17 16:26:27.605865 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.605850    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 16:26:27.605944 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.605877    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5mgr9\""
Jul 17 16:26:27.605944 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.605895    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 16:26:27.613663 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.613647    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zwg7q"]
Jul 17 16:26:27.613741 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.613672    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-c44fh"]
Jul 17 16:26:27.613741 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.613686    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"]
Jul 17 16:26:27.613741 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.613702    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7559574b98-mjpbg"]
Jul 17 16:26:27.613741 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.613727    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n4r4v"]
Jul 17 16:26:27.613995 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.613758    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:27.615978 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.615960    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 17 16:26:27.616072 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.615983    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 17 16:26:27.616072 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.615987    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 16:26:27.616072 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.615966    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 16:26:27.616072 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.616047    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 17 16:26:27.616497 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.616480    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6fpdv\""
Jul 17 16:26:27.616579 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.616488    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 17 16:26:27.624003 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.623986    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4r4v"]
Jul 17 16:26:27.624080 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.624065    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:27.625894 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.625879    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 16:26:27.625990 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.625896    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 16:26:27.626043 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.626013    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4x2wh\""
Jul 17 16:26:27.663570 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663544    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-49v4r\" (UID: \"fbee38e7-0cc3-4da0-a247-67012aac1b75\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"
Jul 17 16:26:27.663671 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663587    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-installation-pull-secrets\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.663671 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663613    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-snapshots\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.663671 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663640    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.663671 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663664    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kk9x\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-kube-api-access-4kk9x\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.663867 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663689    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhqlh\" (UniqueName: \"kubernetes.io/projected/1b03ece1-dd5e-421c-9f0d-d2c2dde17654-kube-api-access-lhqlh\") pod \"volume-data-source-validator-78cf4c6f6-btp2x\" (UID: \"1b03ece1-dd5e-421c-9f0d-d2c2dde17654\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-btp2x"
Jul 17 16:26:27.663867 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663715    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-service-ca-bundle\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.663867 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663796    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-bound-sa-token\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.663867 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663828    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4r4q\" (UniqueName: \"kubernetes.io/projected/ebfb68ae-7cd7-4682-9ed8-69a9f64ed712-kube-api-access-z4r4q\") pod \"kube-storage-version-migrator-operator-7658d9b749-zc24m\" (UID: \"ebfb68ae-7cd7-4682-9ed8-69a9f64ed712\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m"
Jul 17 16:26:27.663867 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663847    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvwg6\" (UniqueName: \"kubernetes.io/projected/fbee38e7-0cc3-4da0-a247-67012aac1b75-kube-api-access-wvwg6\") pod \"cluster-samples-operator-79b7c55f87-49v4r\" (UID: \"fbee38e7-0cc3-4da0-a247-67012aac1b75\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"
Jul 17 16:26:27.664024 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663890    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6qhs\" (UniqueName: \"kubernetes.io/projected/394cfdf6-9ca2-44ee-9728-118b029b5a30-kube-api-access-v6qhs\") pod \"console-operator-565b7b569d-k8z54\" (UID: \"394cfdf6-9ca2-44ee-9728-118b029b5a30\") " pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:27.664024 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663923    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/394cfdf6-9ca2-44ee-9728-118b029b5a30-trusted-ca\") pod \"console-operator-565b7b569d-k8z54\" (UID: \"394cfdf6-9ca2-44ee-9728-118b029b5a30\") " pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:27.664024 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663945    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-serving-cert\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.664024 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663962    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:27.664024 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.663980    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d6033c0-0006-4d58-b074-b731e58f602f-config\") pod \"service-ca-operator-5bcbc94c78-4jn76\" (UID: \"7d6033c0-0006-4d58-b074-b731e58f602f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76"
Jul 17 16:26:27.664024 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664007    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mck5f\" (UniqueName: \"kubernetes.io/projected/5d24761b-ec84-4596-8784-16fb8394b3ac-kube-api-access-mck5f\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:27.664192 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664039    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d6033c0-0006-4d58-b074-b731e58f602f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4jn76\" (UID: \"7d6033c0-0006-4d58-b074-b731e58f602f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76"
Jul 17 16:26:27.664192 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664063    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27xrx\" (UniqueName: \"kubernetes.io/projected/a553f30c-cb45-4cc1-a83b-55aaf03da15d-kube-api-access-27xrx\") pod \"ingress-canary-zwg7q\" (UID: \"a553f30c-cb45-4cc1-a83b-55aaf03da15d\") " pod="openshift-ingress-canary/ingress-canary-zwg7q"
Jul 17 16:26:27.664192 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664086    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.664192 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664103    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-image-registry-private-configuration\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.664192 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664118    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-certificates\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.664192 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664155    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-tmp\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.664192 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664175    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebfb68ae-7cd7-4682-9ed8-69a9f64ed712-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zc24m\" (UID: \"ebfb68ae-7cd7-4682-9ed8-69a9f64ed712\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m"
Jul 17 16:26:27.664427 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664200    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsfmk\" (UniqueName: \"kubernetes.io/projected/93cfc7a5-aa46-4cbf-bf13-ca123193764b-kube-api-access-fsfmk\") pod \"network-check-source-7bc5b6bf85-c44fh\" (UID: \"93cfc7a5-aa46-4cbf-bf13-ca123193764b\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c44fh"
Jul 17 16:26:27.664427 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664222    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-trusted-ca\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.664427 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664246    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6j2r\" (UniqueName: \"kubernetes.io/projected/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-kube-api-access-r6j2r\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.664427 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664264    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a553f30c-cb45-4cc1-a83b-55aaf03da15d-cert\") pod \"ingress-canary-zwg7q\" (UID: \"a553f30c-cb45-4cc1-a83b-55aaf03da15d\") " pod="openshift-ingress-canary/ingress-canary-zwg7q"
Jul 17 16:26:27.664427 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664285    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebfb68ae-7cd7-4682-9ed8-69a9f64ed712-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zc24m\" (UID: \"ebfb68ae-7cd7-4682-9ed8-69a9f64ed712\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m"
Jul 17 16:26:27.664427 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664301    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/394cfdf6-9ca2-44ee-9728-118b029b5a30-serving-cert\") pod \"console-operator-565b7b569d-k8z54\" (UID: \"394cfdf6-9ca2-44ee-9728-118b029b5a30\") " pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:27.664427 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664338    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/394cfdf6-9ca2-44ee-9728-118b029b5a30-config\") pod \"console-operator-565b7b569d-k8z54\" (UID: \"394cfdf6-9ca2-44ee-9728-118b029b5a30\") " pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:27.664427 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664400    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-ca-trust-extracted\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.664427 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664415    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5d24761b-ec84-4596-8784-16fb8394b3ac-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:27.664701 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.664432    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hjvr\" (UniqueName: \"kubernetes.io/projected/7d6033c0-0006-4d58-b074-b731e58f602f-kube-api-access-8hjvr\") pod \"service-ca-operator-5bcbc94c78-4jn76\" (UID: \"7d6033c0-0006-4d58-b074-b731e58f602f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76"
Jul 17 16:26:27.742330 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.742293    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwgtx_2a459d8a-1925-4d20-a34e-8f3a06eccd45/konnectivity-agent/0.log" limit=1024
Jul 17 16:26:27.765342 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765306    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hjvr\" (UniqueName: \"kubernetes.io/projected/7d6033c0-0006-4d58-b074-b731e58f602f-kube-api-access-8hjvr\") pod \"service-ca-operator-5bcbc94c78-4jn76\" (UID: \"7d6033c0-0006-4d58-b074-b731e58f602f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76"
Jul 17 16:26:27.765465 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765352    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:27.765465 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765371    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-49v4r\" (UID: \"fbee38e7-0cc3-4da0-a247-67012aac1b75\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"
Jul 17 16:26:27.765465 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765396    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-installation-pull-secrets\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.765465 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765420    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-snapshots\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.765465 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765438    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.765465 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765461    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kk9x\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-kube-api-access-4kk9x\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.765768 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:27.765491    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 16:26:27.765768 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:27.765567    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls podName:fbee38e7-0cc3-4da0-a247-67012aac1b75 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:28.265548618 +0000 UTC m=+37.124677171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-49v4r" (UID: "fbee38e7-0cc3-4da0-a247-67012aac1b75") : secret "samples-operator-tls" not found
Jul 17 16:26:27.765768 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:27.765576    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 16:26:27.765768 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765484    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5fmw\" (UniqueName: \"kubernetes.io/projected/5e9b8ff7-d39a-4284-a2df-48e0e0052267-kube-api-access-v5fmw\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:27.765768 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765631    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhqlh\" (UniqueName: \"kubernetes.io/projected/1b03ece1-dd5e-421c-9f0d-d2c2dde17654-kube-api-access-lhqlh\") pod \"volume-data-source-validator-78cf4c6f6-btp2x\" (UID: \"1b03ece1-dd5e-421c-9f0d-d2c2dde17654\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-btp2x"
Jul 17 16:26:27.765768 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765659    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-service-ca-bundle\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.765768 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765688    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-bound-sa-token\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.765768 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765713    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4r4q\" (UniqueName: \"kubernetes.io/projected/ebfb68ae-7cd7-4682-9ed8-69a9f64ed712-kube-api-access-z4r4q\") pod \"kube-storage-version-migrator-operator-7658d9b749-zc24m\" (UID: \"ebfb68ae-7cd7-4682-9ed8-69a9f64ed712\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m"
Jul 17 16:26:27.766152 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765779    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvwg6\" (UniqueName: \"kubernetes.io/projected/fbee38e7-0cc3-4da0-a247-67012aac1b75-kube-api-access-wvwg6\") pod \"cluster-samples-operator-79b7c55f87-49v4r\" (UID: \"fbee38e7-0cc3-4da0-a247-67012aac1b75\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"
Jul 17 16:26:27.766152 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765936    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6qhs\" (UniqueName: \"kubernetes.io/projected/394cfdf6-9ca2-44ee-9728-118b029b5a30-kube-api-access-v6qhs\") pod \"console-operator-565b7b569d-k8z54\" (UID: \"394cfdf6-9ca2-44ee-9728-118b029b5a30\") " pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:27.766152 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.765980    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-default-certificate\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:27.766152 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766016    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-stats-auth\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:27.766152 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766055    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e9b8ff7-d39a-4284-a2df-48e0e0052267-tmp-dir\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:27.766152 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766074    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znpmd\" (UniqueName: \"kubernetes.io/projected/306ced93-2032-4527-8bad-8bba168bbcf5-kube-api-access-znpmd\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:27.766152 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766097    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/394cfdf6-9ca2-44ee-9728-118b029b5a30-trusted-ca\") pod \"console-operator-565b7b569d-k8z54\" (UID: \"394cfdf6-9ca2-44ee-9728-118b029b5a30\") " pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:27.766152 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766121    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-serving-cert\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.766152 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766124    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-snapshots\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.766152 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766149    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:27.766658 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766178    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d6033c0-0006-4d58-b074-b731e58f602f-config\") pod \"service-ca-operator-5bcbc94c78-4jn76\" (UID: \"7d6033c0-0006-4d58-b074-b731e58f602f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76"
Jul 17 16:26:27.766658 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766201    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e9b8ff7-d39a-4284-a2df-48e0e0052267-config-volume\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:27.766658 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766230    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mck5f\" (UniqueName: \"kubernetes.io/projected/5d24761b-ec84-4596-8784-16fb8394b3ac-kube-api-access-mck5f\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:27.766658 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766256    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d6033c0-0006-4d58-b074-b731e58f602f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4jn76\" (UID: \"7d6033c0-0006-4d58-b074-b731e58f602f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76"
Jul 17 16:26:27.766658 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766257    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-service-ca-bundle\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.766658 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766280    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27xrx\" (UniqueName: \"kubernetes.io/projected/a553f30c-cb45-4cc1-a83b-55aaf03da15d-kube-api-access-27xrx\") pod \"ingress-canary-zwg7q\" (UID: \"a553f30c-cb45-4cc1-a83b-55aaf03da15d\") " pod="openshift-ingress-canary/ingress-canary-zwg7q"
Jul 17 16:26:27.766658 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766451    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:27.766658 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766622    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.766658 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766657    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-image-registry-private-configuration\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.767081 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766686    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-certificates\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.767081 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766716    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-tmp\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.767081 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766751    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebfb68ae-7cd7-4682-9ed8-69a9f64ed712-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zc24m\" (UID: \"ebfb68ae-7cd7-4682-9ed8-69a9f64ed712\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m"
Jul 17 16:26:27.767081 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766774    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d6033c0-0006-4d58-b074-b731e58f602f-config\") pod \"service-ca-operator-5bcbc94c78-4jn76\" (UID: \"7d6033c0-0006-4d58-b074-b731e58f602f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76"
Jul 17 16:26:27.767081 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766785    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsfmk\" (UniqueName: \"kubernetes.io/projected/93cfc7a5-aa46-4cbf-bf13-ca123193764b-kube-api-access-fsfmk\") pod \"network-check-source-7bc5b6bf85-c44fh\" (UID: \"93cfc7a5-aa46-4cbf-bf13-ca123193764b\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c44fh"
Jul 17 16:26:27.767081 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766812    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:27.767081 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766841    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-trusted-ca\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.767081 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766950    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6j2r\" (UniqueName: \"kubernetes.io/projected/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-kube-api-access-r6j2r\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.767081 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.766983    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a553f30c-cb45-4cc1-a83b-55aaf03da15d-cert\") pod \"ingress-canary-zwg7q\" (UID: \"a553f30c-cb45-4cc1-a83b-55aaf03da15d\") " pod="openshift-ingress-canary/ingress-canary-zwg7q"
Jul 17 16:26:27.767081 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.767010    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebfb68ae-7cd7-4682-9ed8-69a9f64ed712-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zc24m\" (UID: \"ebfb68ae-7cd7-4682-9ed8-69a9f64ed712\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m"
Jul 17 16:26:27.767081 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.767040    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/394cfdf6-9ca2-44ee-9728-118b029b5a30-serving-cert\") pod \"console-operator-565b7b569d-k8z54\" (UID: \"394cfdf6-9ca2-44ee-9728-118b029b5a30\") " pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:27.767081 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.767061    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/394cfdf6-9ca2-44ee-9728-118b029b5a30-trusted-ca\") pod \"console-operator-565b7b569d-k8z54\" (UID: \"394cfdf6-9ca2-44ee-9728-118b029b5a30\") " pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:27.767081 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.767071    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/394cfdf6-9ca2-44ee-9728-118b029b5a30-config\") pod \"console-operator-565b7b569d-k8z54\" (UID: \"394cfdf6-9ca2-44ee-9728-118b029b5a30\") " pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:27.767698 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.767114    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-ca-trust-extracted\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.767698 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.767141    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5d24761b-ec84-4596-8784-16fb8394b3ac-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:27.767698 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.767238    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-certificates\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.767698 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.767370    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.767698 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.767629    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-ca-trust-extracted\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.767952 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.767823    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5d24761b-ec84-4596-8784-16fb8394b3ac-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:27.767952 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.767900    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/394cfdf6-9ca2-44ee-9728-118b029b5a30-config\") pod \"console-operator-565b7b569d-k8z54\" (UID: \"394cfdf6-9ca2-44ee-9728-118b029b5a30\") " pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:27.768084 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:27.765591    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5cd6cfdc-g486j: secret "image-registry-tls" not found
Jul 17 16:26:27.768230 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:27.768216    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls podName:f50a8f6f-4e12-4a44-9d68-e6de2ff77028 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:28.268195175 +0000 UTC m=+37.127323721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls") pod "image-registry-6c5cd6cfdc-g486j" (UID: "f50a8f6f-4e12-4a44-9d68-e6de2ff77028") : secret "image-registry-tls" not found
Jul 17 16:26:27.768349 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.768291    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebfb68ae-7cd7-4682-9ed8-69a9f64ed712-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zc24m\" (UID: \"ebfb68ae-7cd7-4682-9ed8-69a9f64ed712\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m"
Jul 17 16:26:27.768464 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:27.766268    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 16:26:27.768599 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.768573    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-trusted-ca\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.768707 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:27.768581    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls podName:5d24761b-ec84-4596-8784-16fb8394b3ac nodeName:}" failed. No retries permitted until 2026-07-17 16:26:28.268563549 +0000 UTC m=+37.127692102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-mzfjl" (UID: "5d24761b-ec84-4596-8784-16fb8394b3ac") : secret "cluster-monitoring-operator-tls" not found
Jul 17 16:26:27.771296 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.771240    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebfb68ae-7cd7-4682-9ed8-69a9f64ed712-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zc24m\" (UID: \"ebfb68ae-7cd7-4682-9ed8-69a9f64ed712\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m"
Jul 17 16:26:27.771429 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.771359    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-serving-cert\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.771429 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.771388    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/394cfdf6-9ca2-44ee-9728-118b029b5a30-serving-cert\") pod \"console-operator-565b7b569d-k8z54\" (UID: \"394cfdf6-9ca2-44ee-9728-118b029b5a30\") " pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:27.771554 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.771458    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-installation-pull-secrets\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.771554 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.771458    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-image-registry-private-configuration\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.771866 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.771844    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d6033c0-0006-4d58-b074-b731e58f602f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4jn76\" (UID: \"7d6033c0-0006-4d58-b074-b731e58f602f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76"
Jul 17 16:26:27.773340 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.773306    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a553f30c-cb45-4cc1-a83b-55aaf03da15d-cert\") pod \"ingress-canary-zwg7q\" (UID: \"a553f30c-cb45-4cc1-a83b-55aaf03da15d\") " pod="openshift-ingress-canary/ingress-canary-zwg7q"
Jul 17 16:26:27.775838 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.775712    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-tmp\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.778508 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.778483    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhqlh\" (UniqueName: \"kubernetes.io/projected/1b03ece1-dd5e-421c-9f0d-d2c2dde17654-kube-api-access-lhqlh\") pod \"volume-data-source-validator-78cf4c6f6-btp2x\" (UID: \"1b03ece1-dd5e-421c-9f0d-d2c2dde17654\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-btp2x"
Jul 17 16:26:27.782638 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.780477    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6qhs\" (UniqueName: \"kubernetes.io/projected/394cfdf6-9ca2-44ee-9728-118b029b5a30-kube-api-access-v6qhs\") pod \"console-operator-565b7b569d-k8z54\" (UID: \"394cfdf6-9ca2-44ee-9728-118b029b5a30\") " pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:27.782638 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.781900    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-bound-sa-token\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.782638 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.782034    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvwg6\" (UniqueName: \"kubernetes.io/projected/fbee38e7-0cc3-4da0-a247-67012aac1b75-kube-api-access-wvwg6\") pod \"cluster-samples-operator-79b7c55f87-49v4r\" (UID: \"fbee38e7-0cc3-4da0-a247-67012aac1b75\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"
Jul 17 16:26:27.782638 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.782521    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsfmk\" (UniqueName: \"kubernetes.io/projected/93cfc7a5-aa46-4cbf-bf13-ca123193764b-kube-api-access-fsfmk\") pod \"network-check-source-7bc5b6bf85-c44fh\" (UID: \"93cfc7a5-aa46-4cbf-bf13-ca123193764b\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c44fh"
Jul 17 16:26:27.782881 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.782715    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4r4q\" (UniqueName: \"kubernetes.io/projected/ebfb68ae-7cd7-4682-9ed8-69a9f64ed712-kube-api-access-z4r4q\") pod \"kube-storage-version-migrator-operator-7658d9b749-zc24m\" (UID: \"ebfb68ae-7cd7-4682-9ed8-69a9f64ed712\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m"
Jul 17 16:26:27.783954 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.783919    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mck5f\" (UniqueName: \"kubernetes.io/projected/5d24761b-ec84-4596-8784-16fb8394b3ac-kube-api-access-mck5f\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:27.784424 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.784392    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hjvr\" (UniqueName: \"kubernetes.io/projected/7d6033c0-0006-4d58-b074-b731e58f602f-kube-api-access-8hjvr\") pod \"service-ca-operator-5bcbc94c78-4jn76\" (UID: \"7d6033c0-0006-4d58-b074-b731e58f602f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76"
Jul 17 16:26:27.784584 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.784531    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kk9x\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-kube-api-access-4kk9x\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:27.784814 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.784769    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6j2r\" (UniqueName: \"kubernetes.io/projected/82c7f60e-1ba3-4fe2-8661-6c6ebc698b05-kube-api-access-r6j2r\") pod \"insights-operator-555d9d7885-5gsh8\" (UID: \"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05\") " pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.785004 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.784973    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27xrx\" (UniqueName: \"kubernetes.io/projected/a553f30c-cb45-4cc1-a83b-55aaf03da15d-kube-api-access-27xrx\") pod \"ingress-canary-zwg7q\" (UID: \"a553f30c-cb45-4cc1-a83b-55aaf03da15d\") " pod="openshift-ingress-canary/ingress-canary-zwg7q"
Jul 17 16:26:27.841699 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.841669    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwgtx_2a459d8a-1925-4d20-a34e-8f3a06eccd45/konnectivity-agent/0.log" limit=1024
Jul 17 16:26:27.847387 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.847367    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-5gsh8"
Jul 17 16:26:27.855479 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.855464    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76"
Jul 17 16:26:27.863618 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.863593    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-btp2x"
Jul 17 16:26:27.867708 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.867677    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:27.867804 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.867752    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:27.867804 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:27.867791    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 16:26:27.867915 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.867803    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5fmw\" (UniqueName: \"kubernetes.io/projected/5e9b8ff7-d39a-4284-a2df-48e0e0052267-kube-api-access-v5fmw\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:27.867915 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:27.867839    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls podName:5e9b8ff7-d39a-4284-a2df-48e0e0052267 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:28.367822461 +0000 UTC m=+37.226951008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls") pod "dns-default-n4r4v" (UID: "5e9b8ff7-d39a-4284-a2df-48e0e0052267") : secret "dns-default-metrics-tls" not found
Jul 17 16:26:27.868022 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.867962    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-default-certificate\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:27.868022 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.867996    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-stats-auth\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:27.868022 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:27.868015    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle podName:306ced93-2032-4527-8bad-8bba168bbcf5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:28.367996674 +0000 UTC m=+37.227125223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle") pod "router-default-7559574b98-mjpbg" (UID: "306ced93-2032-4527-8bad-8bba168bbcf5") : configmap references non-existent config key: service-ca.crt
Jul 17 16:26:27.868179 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.868065    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e9b8ff7-d39a-4284-a2df-48e0e0052267-tmp-dir\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:27.868179 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.868095    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znpmd\" (UniqueName: \"kubernetes.io/projected/306ced93-2032-4527-8bad-8bba168bbcf5-kube-api-access-znpmd\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:27.868179 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.868137    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e9b8ff7-d39a-4284-a2df-48e0e0052267-config-volume\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:27.868179 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.868171    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:27.868400 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:27.868282    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 16:26:27.868400 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:27.868350    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs podName:306ced93-2032-4527-8bad-8bba168bbcf5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:28.36833591 +0000 UTC m=+37.227464447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs") pod "router-default-7559574b98-mjpbg" (UID: "306ced93-2032-4527-8bad-8bba168bbcf5") : secret "router-metrics-certs-default" not found
Jul 17 16:26:27.868645 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.868621    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e9b8ff7-d39a-4284-a2df-48e0e0052267-tmp-dir\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:27.868934 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.868916    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e9b8ff7-d39a-4284-a2df-48e0e0052267-config-volume\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:27.870556 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.870537    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-stats-auth\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:27.870718 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.870698    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-default-certificate\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:27.874475 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.874447    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m"
Jul 17 16:26:27.878657 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.878628    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5fmw\" (UniqueName: \"kubernetes.io/projected/5e9b8ff7-d39a-4284-a2df-48e0e0052267-kube-api-access-v5fmw\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:27.879173 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.879155    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znpmd\" (UniqueName: \"kubernetes.io/projected/306ced93-2032-4527-8bad-8bba168bbcf5-kube-api-access-znpmd\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:27.882857 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.882836    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:27.903441 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.902905    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zwg7q"
Jul 17 16:26:27.911429 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:27.911406    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c44fh"
Jul 17 16:26:28.025974 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.025937    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:28.038449 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.036476    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-54g7g\""
Jul 17 16:26:28.096411 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.096078    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5gsh8"]
Jul 17 16:26:28.123426 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:26:28.111429    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d6033c0_0006_4d58_b074_b731e58f602f.slice/crio-4c719940ee1c2d441e77ae4e606eedea48584bec2969376cb4d6b50f69739801 WatchSource:0}: Error finding container 4c719940ee1c2d441e77ae4e606eedea48584bec2969376cb4d6b50f69739801: Status 404 returned error can't find the container with id 4c719940ee1c2d441e77ae4e606eedea48584bec2969376cb4d6b50f69739801
Jul 17 16:26:28.123426 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.111455    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76"]
Jul 17 16:26:28.144096 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.137934    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-btp2x"]
Jul 17 16:26:28.165249 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.165195    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m"]
Jul 17 16:26:28.170084 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:26:28.169965    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebfb68ae_7cd7_4682_9ed8_69a9f64ed712.slice/crio-89acee85538ccecbc696884eaec84f66cadf9222a51ef4bcc6de9b0a60733ebb WatchSource:0}: Error finding container 89acee85538ccecbc696884eaec84f66cadf9222a51ef4bcc6de9b0a60733ebb: Status 404 returned error can't find the container with id 89acee85538ccecbc696884eaec84f66cadf9222a51ef4bcc6de9b0a60733ebb
Jul 17 16:26:28.193572 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.193292    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-k8z54"]
Jul 17 16:26:28.199947 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:26:28.199896    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod394cfdf6_9ca2_44ee_9728_118b029b5a30.slice/crio-68be1d64c35c189388f6ad48aa6a6339b3aa0ab63b90d693ec635240916aea23 WatchSource:0}: Error finding container 68be1d64c35c189388f6ad48aa6a6339b3aa0ab63b90d693ec635240916aea23: Status 404 returned error can't find the container with id 68be1d64c35c189388f6ad48aa6a6339b3aa0ab63b90d693ec635240916aea23
Jul 17 16:26:28.223931 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.223906    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-c44fh"]
Jul 17 16:26:28.226688 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:26:28.226668    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93cfc7a5_aa46_4cbf_bf13_ca123193764b.slice/crio-5a18dd95a2ad7b2be800df0889668835793c2bf67d0753b9b652005c13485f26 WatchSource:0}: Error finding container 5a18dd95a2ad7b2be800df0889668835793c2bf67d0753b9b652005c13485f26: Status 404 returned error can't find the container with id 5a18dd95a2ad7b2be800df0889668835793c2bf67d0753b9b652005c13485f26
Jul 17 16:26:28.232016 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.231968    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zwg7q"]
Jul 17 16:26:28.234750 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:26:28.234712    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda553f30c_cb45_4cc1_a83b_55aaf03da15d.slice/crio-3fb15f2b59f4da22b61ca37e10d6fe86101ac8f0b02095a340a2c9cf17541e90 WatchSource:0}: Error finding container 3fb15f2b59f4da22b61ca37e10d6fe86101ac8f0b02095a340a2c9cf17541e90: Status 404 returned error can't find the container with id 3fb15f2b59f4da22b61ca37e10d6fe86101ac8f0b02095a340a2c9cf17541e90
Jul 17 16:26:28.266385 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.266346    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-k8z54" event={"ID":"394cfdf6-9ca2-44ee-9728-118b029b5a30","Type":"ContainerStarted","Data":"68be1d64c35c189388f6ad48aa6a6339b3aa0ab63b90d693ec635240916aea23"}
Jul 17 16:26:28.267538 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.267506    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76" event={"ID":"7d6033c0-0006-4d58-b074-b731e58f602f","Type":"ContainerStarted","Data":"4c719940ee1c2d441e77ae4e606eedea48584bec2969376cb4d6b50f69739801"}
Jul 17 16:26:28.268732 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.268706    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c44fh" event={"ID":"93cfc7a5-aa46-4cbf-bf13-ca123193764b","Type":"ContainerStarted","Data":"5a18dd95a2ad7b2be800df0889668835793c2bf67d0753b9b652005c13485f26"}
Jul 17 16:26:28.270516 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.270455    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m" event={"ID":"ebfb68ae-7cd7-4682-9ed8-69a9f64ed712","Type":"ContainerStarted","Data":"89acee85538ccecbc696884eaec84f66cadf9222a51ef4bcc6de9b0a60733ebb"}
Jul 17 16:26:28.272915 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.272889    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5gsh8" event={"ID":"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05","Type":"ContainerStarted","Data":"51193efeafadee23e603953d57bece9f06498ecd6c6687075be4147214d7bb19"}
Jul 17 16:26:28.274073 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.274049    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zwg7q" event={"ID":"a553f30c-cb45-4cc1-a83b-55aaf03da15d","Type":"ContainerStarted","Data":"3fb15f2b59f4da22b61ca37e10d6fe86101ac8f0b02095a340a2c9cf17541e90"}
Jul 17 16:26:28.275154 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.275134    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-btp2x" event={"ID":"1b03ece1-dd5e-421c-9f0d-d2c2dde17654","Type":"ContainerStarted","Data":"5d41bcd86878150e71a78021079fb122f3530b73eafc98a4aaa2d2e24cae9e99"}
Jul 17 16:26:28.278758 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.278736    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-49v4r\" (UID: \"fbee38e7-0cc3-4da0-a247-67012aac1b75\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"
Jul 17 16:26:28.278851 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.278769    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:28.278851 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.278826    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:28.278962 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:28.278891    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 16:26:28.278962 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:28.278932    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 16:26:28.278962 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:28.278944    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 16:26:28.278962 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:28.278956    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls podName:fbee38e7-0cc3-4da0-a247-67012aac1b75 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:29.278935544 +0000 UTC m=+38.138064088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-49v4r" (UID: "fbee38e7-0cc3-4da0-a247-67012aac1b75") : secret "samples-operator-tls" not found
Jul 17 16:26:28.279125 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:28.278958    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5cd6cfdc-g486j: secret "image-registry-tls" not found
Jul 17 16:26:28.279125 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:28.278979    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls podName:5d24761b-ec84-4596-8784-16fb8394b3ac nodeName:}" failed. No retries permitted until 2026-07-17 16:26:29.278964998 +0000 UTC m=+38.138093560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-mzfjl" (UID: "5d24761b-ec84-4596-8784-16fb8394b3ac") : secret "cluster-monitoring-operator-tls" not found
Jul 17 16:26:28.279125 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:28.278999    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls podName:f50a8f6f-4e12-4a44-9d68-e6de2ff77028 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:29.278988693 +0000 UTC m=+38.138117234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls") pod "image-registry-6c5cd6cfdc-g486j" (UID: "f50a8f6f-4e12-4a44-9d68-e6de2ff77028") : secret "image-registry-tls" not found
Jul 17 16:26:28.380182 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.380109    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:28.380369 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.380283    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:28.380369 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:28.380307    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle podName:306ced93-2032-4527-8bad-8bba168bbcf5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:29.380283316 +0000 UTC m=+38.239411859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle") pod "router-default-7559574b98-mjpbg" (UID: "306ced93-2032-4527-8bad-8bba168bbcf5") : configmap references non-existent config key: service-ca.crt
Jul 17 16:26:28.380662 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:28.380386    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 16:26:28.380662 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:28.380383    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:28.380662 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:28.380436    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs podName:306ced93-2032-4527-8bad-8bba168bbcf5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:29.380419141 +0000 UTC m=+38.239547698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs") pod "router-default-7559574b98-mjpbg" (UID: "306ced93-2032-4527-8bad-8bba168bbcf5") : secret "router-metrics-certs-default" not found
Jul 17 16:26:28.380662 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:28.380456    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 16:26:28.380662 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:28.380500    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls podName:5e9b8ff7-d39a-4284-a2df-48e0e0052267 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:29.380488324 +0000 UTC m=+38.239616865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls") pod "dns-default-n4r4v" (UID: "5e9b8ff7-d39a-4284-a2df-48e0e0052267") : secret "dns-default-metrics-tls" not found
Jul 17 16:26:29.026507 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:29.025796    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:29.026507 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:29.026501    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:29.029922 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:29.029696    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 16:26:29.030741 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:29.030376    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 16:26:29.030741 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:29.030589    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h7wh7\""
Jul 17 16:26:29.290655 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:29.290614    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:29.291090 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:29.290731    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:29.291090 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:29.290857    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-49v4r\" (UID: \"fbee38e7-0cc3-4da0-a247-67012aac1b75\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"
Jul 17 16:26:29.291090 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:29.290979    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 16:26:29.291090 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:29.291036    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls podName:fbee38e7-0cc3-4da0-a247-67012aac1b75 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:31.291017753 +0000 UTC m=+40.150146308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-49v4r" (UID: "fbee38e7-0cc3-4da0-a247-67012aac1b75") : secret "samples-operator-tls" not found
Jul 17 16:26:29.291553 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:29.291533    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 16:26:29.291553 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:29.291554    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5cd6cfdc-g486j: secret "image-registry-tls" not found
Jul 17 16:26:29.291691 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:29.291598    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls podName:f50a8f6f-4e12-4a44-9d68-e6de2ff77028 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:31.291583773 +0000 UTC m=+40.150712327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls") pod "image-registry-6c5cd6cfdc-g486j" (UID: "f50a8f6f-4e12-4a44-9d68-e6de2ff77028") : secret "image-registry-tls" not found
Jul 17 16:26:29.291691 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:29.291657    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 16:26:29.291691 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:29.291692    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls podName:5d24761b-ec84-4596-8784-16fb8394b3ac nodeName:}" failed. No retries permitted until 2026-07-17 16:26:31.291681624 +0000 UTC m=+40.150810164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-mzfjl" (UID: "5d24761b-ec84-4596-8784-16fb8394b3ac") : secret "cluster-monitoring-operator-tls" not found
Jul 17 16:26:29.393351 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:29.391817    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:29.393351 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:29.392259    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:29.393351 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:29.392370    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:29.393351 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:29.392595    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle podName:306ced93-2032-4527-8bad-8bba168bbcf5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:31.39257442 +0000 UTC m=+40.251702960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle") pod "router-default-7559574b98-mjpbg" (UID: "306ced93-2032-4527-8bad-8bba168bbcf5") : configmap references non-existent config key: service-ca.crt
Jul 17 16:26:29.393351 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:29.393110    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 16:26:29.393351 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:29.393261    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 16:26:29.393819 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:29.393790    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls podName:5e9b8ff7-d39a-4284-a2df-48e0e0052267 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:31.393303547 +0000 UTC m=+40.252432104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls") pod "dns-default-n4r4v" (UID: "5e9b8ff7-d39a-4284-a2df-48e0e0052267") : secret "dns-default-metrics-tls" not found
Jul 17 16:26:29.394051 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:29.393988    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs podName:306ced93-2032-4527-8bad-8bba168bbcf5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:31.393973269 +0000 UTC m=+40.253101808 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs") pod "router-default-7559574b98-mjpbg" (UID: "306ced93-2032-4527-8bad-8bba168bbcf5") : secret "router-metrics-certs-default" not found
Jul 17 16:26:31.291715 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:31.291680    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-btp2x" event={"ID":"1b03ece1-dd5e-421c-9f0d-d2c2dde17654","Type":"ContainerStarted","Data":"0afd8f54e4fe0900a538e32c1ac2dfc346f0c9a5a675c5432ec6708556be6837"}
Jul 17 16:26:31.311240 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:31.311146    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-btp2x" podStartSLOduration=4.239533845 podStartE2EDuration="6.31112868s" totalImagesPullingTime="2.071594835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:31.310907531 +0000 UTC m=+40.170036088" watchObservedRunningTime="2026-07-17 16:26:31.31112868 +0000 UTC m=+40.170257240"
Jul 17 16:26:31.312393 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:31.312361    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:31.312526 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:31.312449    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:31.312639 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:31.312620    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-49v4r\" (UID: \"fbee38e7-0cc3-4da0-a247-67012aac1b75\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"
Jul 17 16:26:31.312793 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:31.312690    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 16:26:31.312793 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:31.312720    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5cd6cfdc-g486j: secret "image-registry-tls" not found
Jul 17 16:26:31.312793 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:31.312769    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 16:26:31.312793 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:31.312779    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 16:26:31.313064 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:31.312782    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls podName:f50a8f6f-4e12-4a44-9d68-e6de2ff77028 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:35.312762711 +0000 UTC m=+44.171891273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls") pod "image-registry-6c5cd6cfdc-g486j" (UID: "f50a8f6f-4e12-4a44-9d68-e6de2ff77028") : secret "image-registry-tls" not found
Jul 17 16:26:31.313064 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:31.312830    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls podName:fbee38e7-0cc3-4da0-a247-67012aac1b75 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:35.312814729 +0000 UTC m=+44.171943271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-49v4r" (UID: "fbee38e7-0cc3-4da0-a247-67012aac1b75") : secret "samples-operator-tls" not found
Jul 17 16:26:31.313064 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:31.312845    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls podName:5d24761b-ec84-4596-8784-16fb8394b3ac nodeName:}" failed. No retries permitted until 2026-07-17 16:26:35.312836333 +0000 UTC m=+44.171964873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-mzfjl" (UID: "5d24761b-ec84-4596-8784-16fb8394b3ac") : secret "cluster-monitoring-operator-tls" not found
Jul 17 16:26:31.413654 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:31.413442    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:31.413654 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:31.413539    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:31.416919 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:31.415296    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 16:26:31.416919 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:31.415404    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls podName:5e9b8ff7-d39a-4284-a2df-48e0e0052267 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:35.415382091 +0000 UTC m=+44.274510647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls") pod "dns-default-n4r4v" (UID: "5e9b8ff7-d39a-4284-a2df-48e0e0052267") : secret "dns-default-metrics-tls" not found
Jul 17 16:26:31.416919 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:31.415754    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:31.416919 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:31.415868    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle podName:306ced93-2032-4527-8bad-8bba168bbcf5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:35.415851382 +0000 UTC m=+44.274979938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle") pod "router-default-7559574b98-mjpbg" (UID: "306ced93-2032-4527-8bad-8bba168bbcf5") : configmap references non-existent config key: service-ca.crt
Jul 17 16:26:31.416919 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:31.415927    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 16:26:31.416919 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:31.416093    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs podName:306ced93-2032-4527-8bad-8bba168bbcf5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:35.416054239 +0000 UTC m=+44.275182810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs") pod "router-default-7559574b98-mjpbg" (UID: "306ced93-2032-4527-8bad-8bba168bbcf5") : secret "router-metrics-certs-default" not found
Jul 17 16:26:33.889708 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:33.889670    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"]
Jul 17 16:26:33.907235 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:33.907207    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"]
Jul 17 16:26:33.907388 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:33.907297    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"
Jul 17 16:26:33.909649 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:33.909628    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 17 16:26:33.909762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:33.909632    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vv6qh\""
Jul 17 16:26:33.909762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:33.909677    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 17 16:26:34.040206 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:34.040169    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5hbc5\" (UID: \"b3eb41d7-86a9-45d5-a13b-81ce258f9fde\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"
Jul 17 16:26:34.040429 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:34.040245    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5hbc5\" (UID: \"b3eb41d7-86a9-45d5-a13b-81ce258f9fde\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"
Jul 17 16:26:34.141833 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:34.141749    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5hbc5\" (UID: \"b3eb41d7-86a9-45d5-a13b-81ce258f9fde\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"
Jul 17 16:26:34.141990 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:34.141844    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5hbc5\" (UID: \"b3eb41d7-86a9-45d5-a13b-81ce258f9fde\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"
Jul 17 16:26:34.141990 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:34.141910    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 16:26:34.142100 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:34.142001    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert podName:b3eb41d7-86a9-45d5-a13b-81ce258f9fde nodeName:}" failed. No retries permitted until 2026-07-17 16:26:34.641981256 +0000 UTC m=+43.501109794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5hbc5" (UID: "b3eb41d7-86a9-45d5-a13b-81ce258f9fde") : secret "networking-console-plugin-cert" not found
Jul 17 16:26:34.142663 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:34.142639    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5hbc5\" (UID: \"b3eb41d7-86a9-45d5-a13b-81ce258f9fde\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"
Jul 17 16:26:34.646137 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:34.646096    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5hbc5\" (UID: \"b3eb41d7-86a9-45d5-a13b-81ce258f9fde\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"
Jul 17 16:26:34.646294 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:34.646275    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 16:26:34.646374 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:34.646363    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert podName:b3eb41d7-86a9-45d5-a13b-81ce258f9fde nodeName:}" failed. No retries permitted until 2026-07-17 16:26:35.646345366 +0000 UTC m=+44.505473926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5hbc5" (UID: "b3eb41d7-86a9-45d5-a13b-81ce258f9fde") : secret "networking-console-plugin-cert" not found
Jul 17 16:26:35.354210 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:35.354171    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-49v4r\" (UID: \"fbee38e7-0cc3-4da0-a247-67012aac1b75\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"
Jul 17 16:26:35.354690 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:35.354225    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:35.354690 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:35.354364    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 16:26:35.354690 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:35.354380    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5cd6cfdc-g486j: secret "image-registry-tls" not found
Jul 17 16:26:35.354690 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:35.354423    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:35.354690 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:35.354437    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls podName:f50a8f6f-4e12-4a44-9d68-e6de2ff77028 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:43.354417387 +0000 UTC m=+52.213545932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls") pod "image-registry-6c5cd6cfdc-g486j" (UID: "f50a8f6f-4e12-4a44-9d68-e6de2ff77028") : secret "image-registry-tls" not found
Jul 17 16:26:35.354690 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:35.354364    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 16:26:35.354690 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:35.354570    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 16:26:35.354690 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:35.354592    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls podName:fbee38e7-0cc3-4da0-a247-67012aac1b75 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:43.354571022 +0000 UTC m=+52.213699585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-49v4r" (UID: "fbee38e7-0cc3-4da0-a247-67012aac1b75") : secret "samples-operator-tls" not found
Jul 17 16:26:35.354690 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:35.354611    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls podName:5d24761b-ec84-4596-8784-16fb8394b3ac nodeName:}" failed. No retries permitted until 2026-07-17 16:26:43.354600106 +0000 UTC m=+52.213728643 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-mzfjl" (UID: "5d24761b-ec84-4596-8784-16fb8394b3ac") : secret "cluster-monitoring-operator-tls" not found
Jul 17 16:26:35.455825 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:35.455773    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:35.455979 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:35.455840    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:35.455979 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:35.455924    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:35.455979 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:35.455940    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 16:26:35.455979 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:35.455961    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 16:26:35.456173 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:35.456018    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs podName:306ced93-2032-4527-8bad-8bba168bbcf5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:43.45599521 +0000 UTC m=+52.315123754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs") pod "router-default-7559574b98-mjpbg" (UID: "306ced93-2032-4527-8bad-8bba168bbcf5") : secret "router-metrics-certs-default" not found
Jul 17 16:26:35.456173 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:35.456082    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls podName:5e9b8ff7-d39a-4284-a2df-48e0e0052267 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:43.45606486 +0000 UTC m=+52.315193403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls") pod "dns-default-n4r4v" (UID: "5e9b8ff7-d39a-4284-a2df-48e0e0052267") : secret "dns-default-metrics-tls" not found
Jul 17 16:26:35.456173 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:35.456125    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle podName:306ced93-2032-4527-8bad-8bba168bbcf5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:43.456102133 +0000 UTC m=+52.315230673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle") pod "router-default-7559574b98-mjpbg" (UID: "306ced93-2032-4527-8bad-8bba168bbcf5") : configmap references non-existent config key: service-ca.crt
Jul 17 16:26:35.658709 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:35.658624    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5hbc5\" (UID: \"b3eb41d7-86a9-45d5-a13b-81ce258f9fde\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"
Jul 17 16:26:35.658850 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:35.658761    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 16:26:35.658850 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:35.658838    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert podName:b3eb41d7-86a9-45d5-a13b-81ce258f9fde nodeName:}" failed. No retries permitted until 2026-07-17 16:26:37.658818311 +0000 UTC m=+46.517946869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5hbc5" (UID: "b3eb41d7-86a9-45d5-a13b-81ce258f9fde") : secret "networking-console-plugin-cert" not found
Jul 17 16:26:37.674631 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:37.674593    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5hbc5\" (UID: \"b3eb41d7-86a9-45d5-a13b-81ce258f9fde\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"
Jul 17 16:26:37.675108 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:37.674756    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 16:26:37.675108 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:37.674820    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert podName:b3eb41d7-86a9-45d5-a13b-81ce258f9fde nodeName:}" failed. No retries permitted until 2026-07-17 16:26:41.674805701 +0000 UTC m=+50.533934238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5hbc5" (UID: "b3eb41d7-86a9-45d5-a13b-81ce258f9fde") : secret "networking-console-plugin-cert" not found
Jul 17 16:26:38.314547 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:38.313702    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5gsh8" event={"ID":"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05","Type":"ContainerStarted","Data":"44f2b92a6f83172ddee846d7f67fd9e3ddd66f88b3f13f9c85802269095084a4"}
Jul 17 16:26:38.317071 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:38.316952    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zwg7q" event={"ID":"a553f30c-cb45-4cc1-a83b-55aaf03da15d","Type":"ContainerStarted","Data":"26087b1b3e42537fe5596cabf5eeefc7f426bc587f8b87c934caf092cfebe998"}
Jul 17 16:26:38.319299 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:38.319260    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/0.log"
Jul 17 16:26:38.319418 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:38.319300    2566 generic.go:356] "Generic (PLEG): container finished" podID="394cfdf6-9ca2-44ee-9728-118b029b5a30" containerID="c05e6f18f9881693383c3621f8f33c7868a3e23105573aecce50ca1e3a3f3a88" exitCode=255
Jul 17 16:26:38.319595 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:38.319550    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-k8z54" event={"ID":"394cfdf6-9ca2-44ee-9728-118b029b5a30","Type":"ContainerDied","Data":"c05e6f18f9881693383c3621f8f33c7868a3e23105573aecce50ca1e3a3f3a88"}
Jul 17 16:26:38.319880 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:38.319861    2566 scope.go:117] "RemoveContainer" containerID="c05e6f18f9881693383c3621f8f33c7868a3e23105573aecce50ca1e3a3f3a88"
Jul 17 16:26:38.321495 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:38.321468    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76" event={"ID":"7d6033c0-0006-4d58-b074-b731e58f602f","Type":"ContainerStarted","Data":"2e8518f4a7070083adf0703f0d9544692b935fe83948a5a29a1bda3ba66f3106"}
Jul 17 16:26:38.324934 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:38.324902    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c44fh" event={"ID":"93cfc7a5-aa46-4cbf-bf13-ca123193764b","Type":"ContainerStarted","Data":"16cd6e85075e0bd1c4822ddf13306f75465b7eb953a091864db4a7de29d0686e"}
Jul 17 16:26:38.327669 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:38.327240    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m" event={"ID":"ebfb68ae-7cd7-4682-9ed8-69a9f64ed712","Type":"ContainerStarted","Data":"978024da1614a3da4c6b087db207c13eba62f3d3143bf6757185404c734a4500"}
Jul 17 16:26:38.332896 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:38.332688    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-5gsh8" podStartSLOduration=3.632793901 podStartE2EDuration="13.332670897s" totalImagesPullingTime="9.699876996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:38.329605438 +0000 UTC m=+47.188733998" watchObservedRunningTime="2026-07-17 16:26:38.332670897 +0000 UTC m=+47.191799458"
Jul 17 16:26:38.353426 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:38.353380    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c44fh" podStartSLOduration=3.743984126 podStartE2EDuration="13.353364164s" totalImagesPullingTime="9.609380038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:38.352556159 +0000 UTC m=+47.211684730" watchObservedRunningTime="2026-07-17 16:26:38.353364164 +0000 UTC m=+47.212492702"
Jul 17 16:26:38.391433 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:38.391383    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76" podStartSLOduration=3.694536421 podStartE2EDuration="13.39136376s" totalImagesPullingTime="9.696827339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:38.372596546 +0000 UTC m=+47.231725108" watchObservedRunningTime="2026-07-17 16:26:38.39136376 +0000 UTC m=+47.250492321"
Jul 17 16:26:38.391552 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:38.391483    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m" podStartSLOduration=3.73663149 podStartE2EDuration="13.391474613s" totalImagesPullingTime="9.654843123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:38.39003011 +0000 UTC m=+47.249158670" watchObservedRunningTime="2026-07-17 16:26:38.391474613 +0000 UTC m=+47.250603173"
Jul 17 16:26:38.409561 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:38.409518    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zwg7q" podStartSLOduration=1.8192270659999998 podStartE2EDuration="11.409500166s" totalImagesPullingTime="9.5902731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:38.408796124 +0000 UTC m=+47.267924686" watchObservedRunningTime="2026-07-17 16:26:38.409500166 +0000 UTC m=+47.268628728"
Jul 17 16:26:39.334061 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.334026    2566 generic.go:356] "Generic (PLEG): container finished" podID="b2d369cf-18b8-4166-8c42-1aa7751e1b40" containerID="962b9cb4680a2a760da5d3d3e19dc45c2f6b559a05f9290c795a410665b4face" exitCode=0
Jul 17 16:26:39.334517 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.334115    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5npd9" event={"ID":"b2d369cf-18b8-4166-8c42-1aa7751e1b40","Type":"ContainerDied","Data":"962b9cb4680a2a760da5d3d3e19dc45c2f6b559a05f9290c795a410665b4face"}
Jul 17 16:26:39.335760 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.335742    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:26:39.336182 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.336166    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/0.log"
Jul 17 16:26:39.336255 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.336205    2566 generic.go:356] "Generic (PLEG): container finished" podID="394cfdf6-9ca2-44ee-9728-118b029b5a30" containerID="e801181d84466b4027e46923225b50b70f741fcf53f9b67c575e3673bf8d2528" exitCode=255
Jul 17 16:26:39.336339 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.336302    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-k8z54" event={"ID":"394cfdf6-9ca2-44ee-9728-118b029b5a30","Type":"ContainerDied","Data":"e801181d84466b4027e46923225b50b70f741fcf53f9b67c575e3673bf8d2528"}
Jul 17 16:26:39.336395 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.336373    2566 scope.go:117] "RemoveContainer" containerID="c05e6f18f9881693383c3621f8f33c7868a3e23105573aecce50ca1e3a3f3a88"
Jul 17 16:26:39.336529 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.336473    2566 scope.go:117] "RemoveContainer" containerID="e801181d84466b4027e46923225b50b70f741fcf53f9b67c575e3673bf8d2528"
Jul 17 16:26:39.336666 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:39.336638    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-k8z54_openshift-console-operator(394cfdf6-9ca2-44ee-9728-118b029b5a30)\"" pod="openshift-console-operator/console-operator-565b7b569d-k8z54" podUID="394cfdf6-9ca2-44ee-9728-118b029b5a30"
Jul 17 16:26:39.675796 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.675695    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w7s6s"]
Jul 17 16:26:39.682381 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.682351    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:39.684902 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.684516    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 16:26:39.684902 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.684704    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bxh6h\""
Jul 17 16:26:39.684902 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.684793    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 16:26:39.693989 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.693964    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w7s6s"]
Jul 17 16:26:39.696099 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.696078    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:39.696195 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.696170    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89d0a6b7-cb49-43b9-9f91-767b6089bc91-crio-socket\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:39.696267 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.696252    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78gzq\" (UniqueName: \"kubernetes.io/projected/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-api-access-78gzq\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:39.696384 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.696369    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:39.696445 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.696431    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89d0a6b7-cb49-43b9-9f91-767b6089bc91-data-volume\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:39.796795 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.796767    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:39.796949 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.796836    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89d0a6b7-cb49-43b9-9f91-767b6089bc91-crio-socket\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:39.796949 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:39.796883    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 16:26:39.796949 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.796896    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78gzq\" (UniqueName: \"kubernetes.io/projected/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-api-access-78gzq\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:39.796949 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:39.796942    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm podName:89d0a6b7-cb49-43b9-9f91-767b6089bc91 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:40.296925455 +0000 UTC m=+49.156053997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7s6s" (UID: "89d0a6b7-cb49-43b9-9f91-767b6089bc91") : configmap "kube-rbac-proxy" not found
Jul 17 16:26:39.797137 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.797004    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:39.797137 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.797043    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89d0a6b7-cb49-43b9-9f91-767b6089bc91-data-volume\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:39.797137 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.797048    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89d0a6b7-cb49-43b9-9f91-767b6089bc91-crio-socket\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:39.797137 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:39.797132    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:39.797263 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:39.797180    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls podName:89d0a6b7-cb49-43b9-9f91-767b6089bc91 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:40.297160164 +0000 UTC m=+49.156288702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7s6s" (UID: "89d0a6b7-cb49-43b9-9f91-767b6089bc91") : secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:39.797385 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.797369    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89d0a6b7-cb49-43b9-9f91-767b6089bc91-data-volume\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:39.805908 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:39.805888    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78gzq\" (UniqueName: \"kubernetes.io/projected/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-api-access-78gzq\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:40.300333 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.300287    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:40.300499 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.300363    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:40.300499 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:40.300433    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:40.300499 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:40.300488    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 16:26:40.300595 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:40.300493    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls podName:89d0a6b7-cb49-43b9-9f91-767b6089bc91 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:41.300477756 +0000 UTC m=+50.159606293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7s6s" (UID: "89d0a6b7-cb49-43b9-9f91-767b6089bc91") : secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:40.300595 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:40.300546    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm podName:89d0a6b7-cb49-43b9-9f91-767b6089bc91 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:41.30052862 +0000 UTC m=+50.159657160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7s6s" (UID: "89d0a6b7-cb49-43b9-9f91-767b6089bc91") : configmap "kube-rbac-proxy" not found
Jul 17 16:26:40.342271 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.342241    2566 generic.go:356] "Generic (PLEG): container finished" podID="b2d369cf-18b8-4166-8c42-1aa7751e1b40" containerID="efecb863c2e65ab0165521d4ff86cf946b36dc21cc69cb0ba3f6b2f4e9fc6707" exitCode=0
Jul 17 16:26:40.342679 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.342340    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5npd9" event={"ID":"b2d369cf-18b8-4166-8c42-1aa7751e1b40","Type":"ContainerDied","Data":"efecb863c2e65ab0165521d4ff86cf946b36dc21cc69cb0ba3f6b2f4e9fc6707"}
Jul 17 16:26:40.343885 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.343867    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:26:40.344171 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.344157    2566 scope.go:117] "RemoveContainer" containerID="e801181d84466b4027e46923225b50b70f741fcf53f9b67c575e3673bf8d2528"
Jul 17 16:26:40.344344 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:40.344307    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-k8z54_openshift-console-operator(394cfdf6-9ca2-44ee-9728-118b029b5a30)\"" pod="openshift-console-operator/console-operator-565b7b569d-k8z54" podUID="394cfdf6-9ca2-44ee-9728-118b029b5a30"
Jul 17 16:26:40.646474 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.646398    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krd9m"]
Jul 17 16:26:40.669687 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.669647    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krd9m"]
Jul 17 16:26:40.669856 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.669734    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krd9m"
Jul 17 16:26:40.671861 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.671838    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 17 16:26:40.672006 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.671889    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bjr2k\""
Jul 17 16:26:40.672251 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.672221    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 17 16:26:40.684588 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.684568    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2fdh7_47d0c172-df3f-43c6-a05e-d482e3d05f5a/dns-node-resolver/0.log"
Jul 17 16:26:40.704177 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.704148    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd4fr\" (UniqueName: \"kubernetes.io/projected/b048294d-7860-49c5-b052-b62af14198ad-kube-api-access-jd4fr\") pod \"migrator-7cc9c7ffd7-krd9m\" (UID: \"b048294d-7860-49c5-b052-b62af14198ad\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krd9m"
Jul 17 16:26:40.804792 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.804758    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd4fr\" (UniqueName: \"kubernetes.io/projected/b048294d-7860-49c5-b052-b62af14198ad-kube-api-access-jd4fr\") pod \"migrator-7cc9c7ffd7-krd9m\" (UID: \"b048294d-7860-49c5-b052-b62af14198ad\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krd9m"
Jul 17 16:26:40.812588 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.812562    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd4fr\" (UniqueName: \"kubernetes.io/projected/b048294d-7860-49c5-b052-b62af14198ad-kube-api-access-jd4fr\") pod \"migrator-7cc9c7ffd7-krd9m\" (UID: \"b048294d-7860-49c5-b052-b62af14198ad\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krd9m"
Jul 17 16:26:40.979826 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:40.979756    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krd9m"
Jul 17 16:26:41.121348 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:41.121298    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krd9m"]
Jul 17 16:26:41.124024 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:26:41.123999    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb048294d_7860_49c5_b052_b62af14198ad.slice/crio-48b81501eb9ce1add65ae5f4437a2e617418785e3bace99b0898930fbb0765e6 WatchSource:0}: Error finding container 48b81501eb9ce1add65ae5f4437a2e617418785e3bace99b0898930fbb0765e6: Status 404 returned error can't find the container with id 48b81501eb9ce1add65ae5f4437a2e617418785e3bace99b0898930fbb0765e6
Jul 17 16:26:41.308741 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:41.308716    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:41.308901 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:41.308838    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 16:26:41.308944 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:41.308902    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm podName:89d0a6b7-cb49-43b9-9f91-767b6089bc91 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:43.308886496 +0000 UTC m=+52.168015032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7s6s" (UID: "89d0a6b7-cb49-43b9-9f91-767b6089bc91") : configmap "kube-rbac-proxy" not found
Jul 17 16:26:41.308995 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:41.308981    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:41.309095 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:41.309083    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:41.309125 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:41.309122    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls podName:89d0a6b7-cb49-43b9-9f91-767b6089bc91 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:43.30911433 +0000 UTC m=+52.168242866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7s6s" (UID: "89d0a6b7-cb49-43b9-9f91-767b6089bc91") : secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:41.347848 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:41.347812    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krd9m" event={"ID":"b048294d-7860-49c5-b052-b62af14198ad","Type":"ContainerStarted","Data":"48b81501eb9ce1add65ae5f4437a2e617418785e3bace99b0898930fbb0765e6"}
Jul 17 16:26:41.350821 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:41.350792    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5npd9" event={"ID":"b2d369cf-18b8-4166-8c42-1aa7751e1b40","Type":"ContainerStarted","Data":"502a03f1cb85ca3e62cba7b582e89f02022641becae49f03b06cf8e27d0146a0"}
Jul 17 16:26:41.374783 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:41.374737    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5npd9" podStartSLOduration=8.601716522 podStartE2EDuration="48.3747255s" totalImagesPullingTime="39.773008978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:41.373888095 +0000 UTC m=+50.233016654" watchObservedRunningTime="2026-07-17 16:26:41.3747255 +0000 UTC m=+50.233854037"
Jul 17 16:26:41.712437 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:41.712366    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5hbc5\" (UID: \"b3eb41d7-86a9-45d5-a13b-81ce258f9fde\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"
Jul 17 16:26:41.712562 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:41.712505    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 16:26:41.712597 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:41.712570    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert podName:b3eb41d7-86a9-45d5-a13b-81ce258f9fde nodeName:}" failed. No retries permitted until 2026-07-17 16:26:49.712553343 +0000 UTC m=+58.571681881 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5hbc5" (UID: "b3eb41d7-86a9-45d5-a13b-81ce258f9fde") : secret "networking-console-plugin-cert" not found
Jul 17 16:26:41.881672 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:41.881638    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jncft_085fe0bb-1721-4665-af0f-1ac3b8ad2e97/node-ca/0.log"
Jul 17 16:26:42.479759 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:42.479720    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zwg7q_a553f30c-cb45-4cc1-a83b-55aaf03da15d/serve-healthcheck-canary/0.log"
Jul 17 16:26:43.326258 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:43.326221    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:43.326421 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:43.326280    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:43.326421 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.326401    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:43.326421 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.326412    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 16:26:43.326688 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.326461    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls podName:89d0a6b7-cb49-43b9-9f91-767b6089bc91 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:47.326446862 +0000 UTC m=+56.185575399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7s6s" (UID: "89d0a6b7-cb49-43b9-9f91-767b6089bc91") : secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:43.326688 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.326476    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm podName:89d0a6b7-cb49-43b9-9f91-767b6089bc91 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:47.326469902 +0000 UTC m=+56.185598439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7s6s" (UID: "89d0a6b7-cb49-43b9-9f91-767b6089bc91") : configmap "kube-rbac-proxy" not found
Jul 17 16:26:43.359592 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:43.359566    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krd9m" event={"ID":"b048294d-7860-49c5-b052-b62af14198ad","Type":"ContainerStarted","Data":"cee4819eaa0460d644f6baec05101d4146484fe31cb442418261c259a7cce6a1"}
Jul 17 16:26:43.359715 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:43.359611    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krd9m" event={"ID":"b048294d-7860-49c5-b052-b62af14198ad","Type":"ContainerStarted","Data":"7cd7fd2aabcb3427dd68a675b6db14843d4781f8674d0ed0945070045739c39c"}
Jul 17 16:26:43.379333 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:43.379277    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-krd9m" podStartSLOduration=2.116257733 podStartE2EDuration="3.37926012s" totalImagesPullingTime="1.263002387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:43.37854836 +0000 UTC m=+52.237676919" watchObservedRunningTime="2026-07-17 16:26:43.37926012 +0000 UTC m=+52.238388681"
Jul 17 16:26:43.427623 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:43.427597    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:43.427719 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:43.427704    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-49v4r\" (UID: \"fbee38e7-0cc3-4da0-a247-67012aac1b75\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"
Jul 17 16:26:43.427771 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.427726    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 16:26:43.427830 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.427776    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls podName:5d24761b-ec84-4596-8784-16fb8394b3ac nodeName:}" failed. No retries permitted until 2026-07-17 16:26:59.427762443 +0000 UTC m=+68.286890985 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-mzfjl" (UID: "5d24761b-ec84-4596-8784-16fb8394b3ac") : secret "cluster-monitoring-operator-tls" not found
Jul 17 16:26:43.427830 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:43.427730    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:43.427830 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.427799    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 16:26:43.427955 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.427844    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls podName:fbee38e7-0cc3-4da0-a247-67012aac1b75 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:59.427829769 +0000 UTC m=+68.286958308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-49v4r" (UID: "fbee38e7-0cc3-4da0-a247-67012aac1b75") : secret "samples-operator-tls" not found
Jul 17 16:26:43.427955 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.427860    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 16:26:43.427955 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.427868    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5cd6cfdc-g486j: secret "image-registry-tls" not found
Jul 17 16:26:43.427955 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.427891    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls podName:f50a8f6f-4e12-4a44-9d68-e6de2ff77028 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:59.427884324 +0000 UTC m=+68.287012861 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls") pod "image-registry-6c5cd6cfdc-g486j" (UID: "f50a8f6f-4e12-4a44-9d68-e6de2ff77028") : secret "image-registry-tls" not found
Jul 17 16:26:43.528119 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:43.528096    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:43.528425 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:43.528198    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:43.528425 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.528225    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle podName:306ced93-2032-4527-8bad-8bba168bbcf5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:59.528211792 +0000 UTC m=+68.387340329 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle") pod "router-default-7559574b98-mjpbg" (UID: "306ced93-2032-4527-8bad-8bba168bbcf5") : configmap references non-existent config key: service-ca.crt
Jul 17 16:26:43.528425 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:43.528258    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:43.528425 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.528262    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 16:26:43.528425 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.528296    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs podName:306ced93-2032-4527-8bad-8bba168bbcf5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:59.52828508 +0000 UTC m=+68.387413616 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs") pod "router-default-7559574b98-mjpbg" (UID: "306ced93-2032-4527-8bad-8bba168bbcf5") : secret "router-metrics-certs-default" not found
Jul 17 16:26:43.528425 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.528360    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 16:26:43.528425 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:43.528398    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls podName:5e9b8ff7-d39a-4284-a2df-48e0e0052267 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:59.528385449 +0000 UTC m=+68.387514014 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls") pod "dns-default-n4r4v" (UID: "5e9b8ff7-d39a-4284-a2df-48e0e0052267") : secret "dns-default-metrics-tls" not found
Jul 17 16:26:47.362719 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:47.362683    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:47.363396 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:47.362766    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:47.363396 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:47.362951    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:47.363396 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:47.363033    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls podName:89d0a6b7-cb49-43b9-9f91-767b6089bc91 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:55.36301107 +0000 UTC m=+64.222139609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7s6s" (UID: "89d0a6b7-cb49-43b9-9f91-767b6089bc91") : secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:47.363396 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:47.363285    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89d0a6b7-cb49-43b9-9f91-767b6089bc91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:47.883414 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:47.883382    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:47.883592 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:47.883445    2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:26:47.883828 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:47.883811    2566 scope.go:117] "RemoveContainer" containerID="e801181d84466b4027e46923225b50b70f741fcf53f9b67c575e3673bf8d2528"
Jul 17 16:26:47.884001 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:47.883979    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-k8z54_openshift-console-operator(394cfdf6-9ca2-44ee-9728-118b029b5a30)\"" pod="openshift-console-operator/console-operator-565b7b569d-k8z54" podUID="394cfdf6-9ca2-44ee-9728-118b029b5a30"
Jul 17 16:26:49.785013 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:49.784985    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5hbc5\" (UID: \"b3eb41d7-86a9-45d5-a13b-81ce258f9fde\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"
Jul 17 16:26:49.785412 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:49.785149    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 16:26:49.785412 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:26:49.785231    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert podName:b3eb41d7-86a9-45d5-a13b-81ce258f9fde nodeName:}" failed. No retries permitted until 2026-07-17 16:27:05.785210863 +0000 UTC m=+74.644339415 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5hbc5" (UID: "b3eb41d7-86a9-45d5-a13b-81ce258f9fde") : secret "networking-console-plugin-cert" not found
Jul 17 16:26:53.269004 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:53.268977    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndt95"
Jul 17 16:26:55.436298 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:55.436253    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:55.438633 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:55.438613    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89d0a6b7-cb49-43b9-9f91-767b6089bc91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7s6s\" (UID: \"89d0a6b7-cb49-43b9-9f91-767b6089bc91\") " pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:55.595850 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:55.595820    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bxh6h\""
Jul 17 16:26:55.604119 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:55.604100    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w7s6s"
Jul 17 16:26:55.724345 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:55.724268    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w7s6s"]
Jul 17 16:26:55.727562 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:26:55.727534    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d0a6b7_cb49_43b9_9f91_767b6089bc91.slice/crio-b9884450195da9805a29b075e524218703cc0b49727f4e582003530a31fed665 WatchSource:0}: Error finding container b9884450195da9805a29b075e524218703cc0b49727f4e582003530a31fed665: Status 404 returned error can't find the container with id b9884450195da9805a29b075e524218703cc0b49727f4e582003530a31fed665
Jul 17 16:26:56.401557 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:56.401503    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7s6s" event={"ID":"89d0a6b7-cb49-43b9-9f91-767b6089bc91","Type":"ContainerStarted","Data":"b9884450195da9805a29b075e524218703cc0b49727f4e582003530a31fed665"}
Jul 17 16:26:57.555973 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:57.555930    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:57.558517 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:57.558492    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 16:26:57.568965 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:57.568940    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a98da8bd-6084-493e-bc85-56ec89e8c692-original-pull-secret\") pod \"global-pull-secret-syncer-2h942\" (UID: \"a98da8bd-6084-493e-bc85-56ec89e8c692\") " pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:57.656462 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:57.656427    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs\") pod \"network-metrics-daemon-9t2v9\" (UID: \"b33cb135-e718-4b22-a0c6-c5076d54547f\") " pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:57.660984 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:57.660963    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 16:26:57.669819 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:57.669791    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33cb135-e718-4b22-a0c6-c5076d54547f-metrics-certs\") pod \"network-metrics-daemon-9t2v9\" (UID: \"b33cb135-e718-4b22-a0c6-c5076d54547f\") " pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:57.757934 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:57.757904    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86cvp\" (UniqueName: \"kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp\") pod \"network-check-target-w5lv4\" (UID: \"0a6a4056-a373-47ae-b122-121a00fb2f5d\") " pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:57.761242 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:57.761211    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86cvp\" (UniqueName: \"kubernetes.io/projected/0a6a4056-a373-47ae-b122-121a00fb2f5d-kube-api-access-86cvp\") pod \"network-check-target-w5lv4\" (UID: \"0a6a4056-a373-47ae-b122-121a00fb2f5d\") " pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:57.843482 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:57.843425    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h942"
Jul 17 16:26:57.853489 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:57.853463    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h7wh7\""
Jul 17 16:26:57.861683 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:57.861660    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t2v9"
Jul 17 16:26:58.062876 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:58.062846    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-54g7g\""
Jul 17 16:26:58.069900 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:58.069877    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:26:59.472882 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.472836    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-49v4r\" (UID: \"fbee38e7-0cc3-4da0-a247-67012aac1b75\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"
Jul 17 16:26:59.473356 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.472892    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:59.473356 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.472924    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:59.475555 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.475531    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls\") pod \"image-registry-6c5cd6cfdc-g486j\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") " pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:59.475692 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.475560    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fbee38e7-0cc3-4da0-a247-67012aac1b75-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-49v4r\" (UID: \"fbee38e7-0cc3-4da0-a247-67012aac1b75\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"
Jul 17 16:26:59.475817 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.475793    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d24761b-ec84-4596-8784-16fb8394b3ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-mzfjl\" (UID: \"5d24761b-ec84-4596-8784-16fb8394b3ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:59.573911 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.573877    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:59.574073 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.573946    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:59.574073 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.573978    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:59.574579 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.574551    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/306ced93-2032-4527-8bad-8bba168bbcf5-service-ca-bundle\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:59.576292 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.576268    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e9b8ff7-d39a-4284-a2df-48e0e0052267-metrics-tls\") pod \"dns-default-n4r4v\" (UID: \"5e9b8ff7-d39a-4284-a2df-48e0e0052267\") " pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:26:59.576504 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.576485    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/306ced93-2032-4527-8bad-8bba168bbcf5-metrics-certs\") pod \"router-default-7559574b98-mjpbg\" (UID: \"306ced93-2032-4527-8bad-8bba168bbcf5\") " pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:59.623736 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.623704    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ktnr2\""
Jul 17 16:26:59.632175 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.632147    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:26:59.643901 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.643876    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-sft2p\""
Jul 17 16:26:59.651938 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.651921    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"
Jul 17 16:26:59.695086 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.695067    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x4qjt\""
Jul 17 16:26:59.703127 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.703111    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"
Jul 17 16:26:59.724881 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.724834    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6fpdv\""
Jul 17 16:26:59.733746 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.733728    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:26:59.737219 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.737203    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4x2wh\""
Jul 17 16:26:59.745339 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:26:59.745309    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:27:00.853609 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:00.853580    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2h942"]
Jul 17 16:27:00.855904 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:00.855880    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl"]
Jul 17 16:27:00.857217 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:27:00.857095    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98da8bd_6084_493e_bc85_56ec89e8c692.slice/crio-d5dcc86d85836d9eddf3ca184c4e2c900f2222ccf2ba8df3605e833213936bf7 WatchSource:0}: Error finding container d5dcc86d85836d9eddf3ca184c4e2c900f2222ccf2ba8df3605e833213936bf7: Status 404 returned error can't find the container with id d5dcc86d85836d9eddf3ca184c4e2c900f2222ccf2ba8df3605e833213936bf7
Jul 17 16:27:00.859982 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:27:00.859644    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d24761b_ec84_4596_8784_16fb8394b3ac.slice/crio-9ed6b09016493f8ccac45529a7636363692d3d969e8b89b5f0a486fef1813285 WatchSource:0}: Error finding container 9ed6b09016493f8ccac45529a7636363692d3d969e8b89b5f0a486fef1813285: Status 404 returned error can't find the container with id 9ed6b09016493f8ccac45529a7636363692d3d969e8b89b5f0a486fef1813285
Jul 17 16:27:00.859982 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:00.859679    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9t2v9"]
Jul 17 16:27:00.860983 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:00.860908    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4r4v"]
Jul 17 16:27:00.861862 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:27:00.861841    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33cb135_e718_4b22_a0c6_c5076d54547f.slice/crio-61447cabae86968ce66016237e33505b99e2a1003e1f21abe1032cecdaa36635 WatchSource:0}: Error finding container 61447cabae86968ce66016237e33505b99e2a1003e1f21abe1032cecdaa36635: Status 404 returned error can't find the container with id 61447cabae86968ce66016237e33505b99e2a1003e1f21abe1032cecdaa36635
Jul 17 16:27:00.862931 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:27:00.862820    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e9b8ff7_d39a_4284_a2df_48e0e0052267.slice/crio-805e28e279e2d812854a795307a0f569c70459dcf3bd769e5194daca7f0cc4f9 WatchSource:0}: Error finding container 805e28e279e2d812854a795307a0f569c70459dcf3bd769e5194daca7f0cc4f9: Status 404 returned error can't find the container with id 805e28e279e2d812854a795307a0f569c70459dcf3bd769e5194daca7f0cc4f9
Jul 17 16:27:00.923155 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:00.923125    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7559574b98-mjpbg"]
Jul 17 16:27:00.924568 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:00.924514    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w5lv4"]
Jul 17 16:27:00.925898 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:00.925855    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c5cd6cfdc-g486j"]
Jul 17 16:27:00.926473 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:27:00.926435    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a6a4056_a373_47ae_b122_121a00fb2f5d.slice/crio-c8055375ffabd95bb34986e3107ddd5eeeec30aea72020b6da9108a948836256 WatchSource:0}: Error finding container c8055375ffabd95bb34986e3107ddd5eeeec30aea72020b6da9108a948836256: Status 404 returned error can't find the container with id c8055375ffabd95bb34986e3107ddd5eeeec30aea72020b6da9108a948836256
Jul 17 16:27:00.927552 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:27:00.927528    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod306ced93_2032_4527_8bad_8bba168bbcf5.slice/crio-751b220536a0cf7a0881679476888f45410e2ad783a4999438a6021e4b7eec2d WatchSource:0}: Error finding container 751b220536a0cf7a0881679476888f45410e2ad783a4999438a6021e4b7eec2d: Status 404 returned error can't find the container with id 751b220536a0cf7a0881679476888f45410e2ad783a4999438a6021e4b7eec2d
Jul 17 16:27:00.929440 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:27:00.929418    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf50a8f6f_4e12_4a44_9d68_e6de2ff77028.slice/crio-ea5d96e0f20f8b7acb8592cc0e0e6da4eda93cbf3353ef62d17f8c1d64ad3730 WatchSource:0}: Error finding container ea5d96e0f20f8b7acb8592cc0e0e6da4eda93cbf3353ef62d17f8c1d64ad3730: Status 404 returned error can't find the container with id ea5d96e0f20f8b7acb8592cc0e0e6da4eda93cbf3353ef62d17f8c1d64ad3730
Jul 17 16:27:00.930446 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:00.930182    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r"]
Jul 17 16:27:01.425231 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.425118    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7s6s" event={"ID":"89d0a6b7-cb49-43b9-9f91-767b6089bc91","Type":"ContainerStarted","Data":"12a216f85a88943e75df24a59d8ab25e3508276500eb54ce573cdfad4627a5f6"}
Jul 17 16:27:01.428261 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.427370    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w5lv4" event={"ID":"0a6a4056-a373-47ae-b122-121a00fb2f5d","Type":"ContainerStarted","Data":"33a8ea3268d039e53ee7916d7b04ca58bea92d8e8e8a56e704d5888f040c3e8c"}
Jul 17 16:27:01.428261 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.427421    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w5lv4" event={"ID":"0a6a4056-a373-47ae-b122-121a00fb2f5d","Type":"ContainerStarted","Data":"c8055375ffabd95bb34986e3107ddd5eeeec30aea72020b6da9108a948836256"}
Jul 17 16:27:01.428261 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.428201    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:27:01.431104 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.431069    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j" event={"ID":"f50a8f6f-4e12-4a44-9d68-e6de2ff77028","Type":"ContainerStarted","Data":"4a0d2ee4c8a472a6936f99befdc4bb4eed7506c9187ff57dfe5d7ca7b0440a22"}
Jul 17 16:27:01.431211 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.431145    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j" event={"ID":"f50a8f6f-4e12-4a44-9d68-e6de2ff77028","Type":"ContainerStarted","Data":"ea5d96e0f20f8b7acb8592cc0e0e6da4eda93cbf3353ef62d17f8c1d64ad3730"}
Jul 17 16:27:01.431211 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.431174    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:27:01.435480 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.434949    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7559574b98-mjpbg" event={"ID":"306ced93-2032-4527-8bad-8bba168bbcf5","Type":"ContainerStarted","Data":"3f657024eb36db72b467b57a01f2ae1cd2a9c4b136d0010e81e90e6e75562540"}
Jul 17 16:27:01.435480 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.434995    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7559574b98-mjpbg" event={"ID":"306ced93-2032-4527-8bad-8bba168bbcf5","Type":"ContainerStarted","Data":"751b220536a0cf7a0881679476888f45410e2ad783a4999438a6021e4b7eec2d"}
Jul 17 16:27:01.437936 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.437908    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl" event={"ID":"5d24761b-ec84-4596-8784-16fb8394b3ac","Type":"ContainerStarted","Data":"9ed6b09016493f8ccac45529a7636363692d3d969e8b89b5f0a486fef1813285"}
Jul 17 16:27:01.440162 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.440135    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r" event={"ID":"fbee38e7-0cc3-4da0-a247-67012aac1b75","Type":"ContainerStarted","Data":"c0c9053bb3cc86eaa800b38d189936db432a404efdab6d12543a90b23f57123f"}
Jul 17 16:27:01.442217 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.442196    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9t2v9" event={"ID":"b33cb135-e718-4b22-a0c6-c5076d54547f","Type":"ContainerStarted","Data":"61447cabae86968ce66016237e33505b99e2a1003e1f21abe1032cecdaa36635"}
Jul 17 16:27:01.443640 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.443586    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4r4v" event={"ID":"5e9b8ff7-d39a-4284-a2df-48e0e0052267","Type":"ContainerStarted","Data":"805e28e279e2d812854a795307a0f569c70459dcf3bd769e5194daca7f0cc4f9"}
Jul 17 16:27:01.445279 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.445212    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2h942" event={"ID":"a98da8bd-6084-493e-bc85-56ec89e8c692","Type":"ContainerStarted","Data":"d5dcc86d85836d9eddf3ca184c4e2c900f2222ccf2ba8df3605e833213936bf7"}
Jul 17 16:27:01.449167 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.448504    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w5lv4" podStartSLOduration=68.448487575 podStartE2EDuration="1m8.448487575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:01.446186256 +0000 UTC m=+70.305314816" watchObservedRunningTime="2026-07-17 16:27:01.448487575 +0000 UTC m=+70.307616135"
Jul 17 16:27:01.471429 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.471371    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j" podStartSLOduration=68.471348427 podStartE2EDuration="1m8.471348427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:01.470337073 +0000 UTC m=+70.329465632" watchObservedRunningTime="2026-07-17 16:27:01.471348427 +0000 UTC m=+70.330476989"
Jul 17 16:27:01.491046 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.490400    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7559574b98-mjpbg" podStartSLOduration=36.49038482 podStartE2EDuration="36.49038482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:01.490129596 +0000 UTC m=+70.349258156" watchObservedRunningTime="2026-07-17 16:27:01.49038482 +0000 UTC m=+70.349513380"
Jul 17 16:27:01.735005 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.734924    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:27:01.737547 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:01.737515    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:27:02.452366 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:02.452199    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:27:02.453648 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:02.453425    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7559574b98-mjpbg"
Jul 17 16:27:03.028087 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:03.028062    2566 scope.go:117] "RemoveContainer" containerID="e801181d84466b4027e46923225b50b70f741fcf53f9b67c575e3673bf8d2528"
Jul 17 16:27:03.457459 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:03.457357    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9t2v9" event={"ID":"b33cb135-e718-4b22-a0c6-c5076d54547f","Type":"ContainerStarted","Data":"ee8212fc8d18e880e15e2863a0b736fc92083984be65d4103cdd90d4ae8af809"}
Jul 17 16:27:05.852047 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:05.852013    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5hbc5\" (UID: \"b3eb41d7-86a9-45d5-a13b-81ce258f9fde\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"
Jul 17 16:27:05.854362 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:05.854344    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3eb41d7-86a9-45d5-a13b-81ce258f9fde-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5hbc5\" (UID: \"b3eb41d7-86a9-45d5-a13b-81ce258f9fde\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"
Jul 17 16:27:06.018287 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:06.018258    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vv6qh\""
Jul 17 16:27:06.026833 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:06.026806    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"
Jul 17 16:27:08.796345 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:08.795951    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5"]
Jul 17 16:27:09.483922 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.483409    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4r4v" event={"ID":"5e9b8ff7-d39a-4284-a2df-48e0e0052267","Type":"ContainerStarted","Data":"a3118329461474aad3fce70ac6ecca4f1c77f2afb2817dd62f1ba6e2911bcfd8"}
Jul 17 16:27:09.483922 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.483530    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4r4v" event={"ID":"5e9b8ff7-d39a-4284-a2df-48e0e0052267","Type":"ContainerStarted","Data":"e9ff2010c51fe78b5b413cb8706b7473ee5f376e7f336511a748d84e75b3659c"}
Jul 17 16:27:09.483922 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.483646    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:27:09.486133 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.486087    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7s6s" event={"ID":"89d0a6b7-cb49-43b9-9f91-767b6089bc91","Type":"ContainerStarted","Data":"0a49e25b0fed0b0a57a272a4dc7d617de4f79892043ef762438047b287786cf7"}
Jul 17 16:27:09.488561 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.488503    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9t2v9" event={"ID":"b33cb135-e718-4b22-a0c6-c5076d54547f","Type":"ContainerStarted","Data":"1744eca034b75f143d8c0014afd2707be561d1053c78a9bf62b9a58bcc90b600"}
Jul 17 16:27:09.490144 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.490107    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5" event={"ID":"b3eb41d7-86a9-45d5-a13b-81ce258f9fde","Type":"ContainerStarted","Data":"6f65cfbbf00f9cf6db982047ec77fcbd91036a7e491d5c832e29c0b8967da3a7"}
Jul 17 16:27:09.491831 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.491807    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2h942" event={"ID":"a98da8bd-6084-493e-bc85-56ec89e8c692","Type":"ContainerStarted","Data":"b376c0334ea14a95ba09e5056b1fbc0c7f0973a81c4745591f94f2abfcec19b2"}
Jul 17 16:27:09.493956 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.493933    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl" event={"ID":"5d24761b-ec84-4596-8784-16fb8394b3ac","Type":"ContainerStarted","Data":"96c345fd11df3ee555adc5b7c17f9498f76dec78254226f6ed992850366337d0"}
Jul 17 16:27:09.496105 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.496084    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:27:09.496209 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.496175    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-k8z54" event={"ID":"394cfdf6-9ca2-44ee-9728-118b029b5a30","Type":"ContainerStarted","Data":"74cdd5e4d2f35acf0a7ebc470d304702ad62ea409941657f196498f9c1e896ee"}
Jul 17 16:27:09.496444 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.496427    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:27:09.498854 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.498830    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r" event={"ID":"fbee38e7-0cc3-4da0-a247-67012aac1b75","Type":"ContainerStarted","Data":"62bf7fdd69efd15832a38763e18ba78a5e401321df9fd92431912d924493ff6d"}
Jul 17 16:27:09.498956 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.498876    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r" event={"ID":"fbee38e7-0cc3-4da0-a247-67012aac1b75","Type":"ContainerStarted","Data":"a82d23605f2e150f9cf807cd928aa59514fdba529ce77750853e8f8ff90be3f4"}
Jul 17 16:27:09.502925 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.502871    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n4r4v" podStartSLOduration=34.912976614 podStartE2EDuration="42.502853106s" totalImagesPullingTime="7.589876492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:09.500085061 +0000 UTC m=+78.359213657" watchObservedRunningTime="2026-07-17 16:27:09.502853106 +0000 UTC m=+78.361981666"
Jul 17 16:27:09.517241 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.516509    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-mzfjl" podStartSLOduration=36.742015357 podStartE2EDuration="44.516491082s" totalImagesPullingTime="7.774475725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:09.515037977 +0000 UTC m=+78.374166537" watchObservedRunningTime="2026-07-17 16:27:09.516491082 +0000 UTC m=+78.375619643"
Jul 17 16:27:09.537832 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.536838    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-k8z54" podStartSLOduration=34.913261123 podStartE2EDuration="44.536820871s" totalImagesPullingTime="9.623559748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:09.536766108 +0000 UTC m=+78.395894668" watchObservedRunningTime="2026-07-17 16:27:09.536820871 +0000 UTC m=+78.395949436"
Jul 17 16:27:09.555158 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.555107    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-49v4r" podStartSLOduration=37.076344388 podStartE2EDuration="44.555093076s" totalImagesPullingTime="7.478748688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:09.553196792 +0000 UTC m=+78.412325352" watchObservedRunningTime="2026-07-17 16:27:09.555093076 +0000 UTC m=+78.414221636"
Jul 17 16:27:09.569337 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.569195    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9t2v9" podStartSLOduration=74.795450439 podStartE2EDuration="1m16.569176208s" totalImagesPullingTime="1.773725769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:09.567983735 +0000 UTC m=+78.427112294" watchObservedRunningTime="2026-07-17 16:27:09.569176208 +0000 UTC m=+78.428304781"
Jul 17 16:27:09.581672 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.581588    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2h942" podStartSLOduration=68.797152186 podStartE2EDuration="1m16.58156754s" totalImagesPullingTime="7.784415354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:09.580881298 +0000 UTC m=+78.440009857" watchObservedRunningTime="2026-07-17 16:27:09.58156754 +0000 UTC m=+78.440696103"
Jul 17 16:27:09.829224 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:09.829190    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-k8z54"
Jul 17 16:27:11.509532 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:11.509487    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5" event={"ID":"b3eb41d7-86a9-45d5-a13b-81ce258f9fde","Type":"ContainerStarted","Data":"0a05062df93963a98d6a831a13b7dbaa7dc09076d4265916265977d19ea95479"}
Jul 17 16:27:11.525659 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:11.525614    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5hbc5" podStartSLOduration=36.716836052 podStartE2EDuration="38.525596167s" totalImagesPullingTime="1.808760115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:11.523950769 +0000 UTC m=+80.383079330" watchObservedRunningTime="2026-07-17 16:27:11.525596167 +0000 UTC m=+80.384724728"
Jul 17 16:27:13.519281 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:13.519137    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7s6s" event={"ID":"89d0a6b7-cb49-43b9-9f91-767b6089bc91","Type":"ContainerStarted","Data":"014af6e6e2026332b349ee53f17ac880769277aeb7494c4524a055bc5e2d9818"}
Jul 17 16:27:13.536919 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:13.536873    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w7s6s" podStartSLOduration=17.34560614 podStartE2EDuration="34.536860052s" totalImagesPullingTime="17.191253912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:26:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:13.534964665 +0000 UTC m=+82.394093234" watchObservedRunningTime="2026-07-17 16:27:13.536860052 +0000 UTC m=+82.395988610"
Jul 17 16:27:19.506548 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:19.506517    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n4r4v"
Jul 17 16:27:22.456205 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:22.456180    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:27:27.847278 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:27.847247    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c5cd6cfdc-g486j"]
Jul 17 16:27:33.460376 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:33.460345    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w5lv4"
Jul 17 16:27:43.626236 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:43.626149    2566 generic.go:356] "Generic (PLEG): container finished" podID="7d6033c0-0006-4d58-b074-b731e58f602f" containerID="2e8518f4a7070083adf0703f0d9544692b935fe83948a5a29a1bda3ba66f3106" exitCode=0
Jul 17 16:27:43.626236 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:43.626223    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76" event={"ID":"7d6033c0-0006-4d58-b074-b731e58f602f","Type":"ContainerDied","Data":"2e8518f4a7070083adf0703f0d9544692b935fe83948a5a29a1bda3ba66f3106"}
Jul 17 16:27:43.626680 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:43.626580    2566 scope.go:117] "RemoveContainer" containerID="2e8518f4a7070083adf0703f0d9544692b935fe83948a5a29a1bda3ba66f3106"
Jul 17 16:27:44.631842 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:44.631809    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jn76" event={"ID":"7d6033c0-0006-4d58-b074-b731e58f602f","Type":"ContainerStarted","Data":"4dbf80b74ac4917ee42f93f299701a3e5a0870559e29a34d5b1e0879e73a590e"}
Jul 17 16:27:47.876595 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.876559    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wslpj"]
Jul 17 16:27:47.886721 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.886691    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:47.890460 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.890429    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 16:27:47.890594 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.890479    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 16:27:47.890594 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.890488    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zdw49\""
Jul 17 16:27:47.890785 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.890766    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 16:27:47.892352 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.892310    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 16:27:47.949476 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.949439    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07d6a2b8-ca86-499c-b6e1-813c91d87e15-sys\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:47.949476 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.949478    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07d6a2b8-ca86-499c-b6e1-813c91d87e15-metrics-client-ca\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:47.949668 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.949513    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:47.949668 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.949561    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-accelerators-collector-config\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:47.949668 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.949605    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd999\" (UniqueName: \"kubernetes.io/projected/07d6a2b8-ca86-499c-b6e1-813c91d87e15-kube-api-access-xd999\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:47.949668 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.949664    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-wtmp\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:47.949830 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.949725    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/07d6a2b8-ca86-499c-b6e1-813c91d87e15-root\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:47.949830 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.949752    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-tls\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:47.949830 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:47.949775    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-textfile\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.050954 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.050923    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/07d6a2b8-ca86-499c-b6e1-813c91d87e15-root\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.051089 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.050957    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-tls\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.051089 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.050983    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-textfile\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.051089 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.051016    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07d6a2b8-ca86-499c-b6e1-813c91d87e15-sys\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.051089 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.051034    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/07d6a2b8-ca86-499c-b6e1-813c91d87e15-root\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.051089 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.051038    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07d6a2b8-ca86-499c-b6e1-813c91d87e15-metrics-client-ca\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.051366 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.051118    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.051366 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.051132    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07d6a2b8-ca86-499c-b6e1-813c91d87e15-sys\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.051366 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.051145    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-accelerators-collector-config\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.051366 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.051177    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd999\" (UniqueName: \"kubernetes.io/projected/07d6a2b8-ca86-499c-b6e1-813c91d87e15-kube-api-access-xd999\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.051366 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.051231    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-wtmp\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.051634 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.051405    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-wtmp\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.051634 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.051490    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-textfile\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.051742 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.051721    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07d6a2b8-ca86-499c-b6e1-813c91d87e15-metrics-client-ca\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.051784 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.051737    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-accelerators-collector-config\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.053532 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.053512    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-tls\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.053633 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.053569    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07d6a2b8-ca86-499c-b6e1-813c91d87e15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.063637 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.063616    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd999\" (UniqueName: \"kubernetes.io/projected/07d6a2b8-ca86-499c-b6e1-813c91d87e15-kube-api-access-xd999\") pod \"node-exporter-wslpj\" (UID: \"07d6a2b8-ca86-499c-b6e1-813c91d87e15\") " pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.195537 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.195475    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wslpj"
Jul 17 16:27:48.205212 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:27:48.205187    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d6a2b8_ca86_499c_b6e1_813c91d87e15.slice/crio-42cb4cfee985a75362f26c6db9b39849dfda6345e61b946d440e05d4e42a2273 WatchSource:0}: Error finding container 42cb4cfee985a75362f26c6db9b39849dfda6345e61b946d440e05d4e42a2273: Status 404 returned error can't find the container with id 42cb4cfee985a75362f26c6db9b39849dfda6345e61b946d440e05d4e42a2273
Jul 17 16:27:48.647090 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:48.647052    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wslpj" event={"ID":"07d6a2b8-ca86-499c-b6e1-813c91d87e15","Type":"ContainerStarted","Data":"42cb4cfee985a75362f26c6db9b39849dfda6345e61b946d440e05d4e42a2273"}
Jul 17 16:27:49.010008 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.009574    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 16:27:49.013121 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.013098    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.023311 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.023101    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 17 16:27:49.023311 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.023114    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 17 16:27:49.023311 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.023115    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 17 16:27:49.023311 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.023103    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 17 16:27:49.023603 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.023361    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 17 16:27:49.023603 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.023399    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 17 16:27:49.023603 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.023503    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 17 16:27:49.023603 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.023531    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 17 16:27:49.023792 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.023618    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 17 16:27:49.023792 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.023640    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-456hm\""
Jul 17 16:27:49.058368 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.058343    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.058484 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.058378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.058484 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.058403    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.058601 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.058498    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b73d6c2-ac03-4915-97d3-b8071b0060e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.058601 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.058561    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.058601 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.058589    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9c6j\" (UniqueName: \"kubernetes.io/projected/5b73d6c2-ac03-4915-97d3-b8071b0060e6-kube-api-access-h9c6j\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.058742 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.058625    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-web-config\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.058742 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.058648    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b73d6c2-ac03-4915-97d3-b8071b0060e6-config-out\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.058742 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.058670    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b73d6c2-ac03-4915-97d3-b8071b0060e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.058742 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.058732    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b73d6c2-ac03-4915-97d3-b8071b0060e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.058950 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.058770    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.058950 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.058788    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b73d6c2-ac03-4915-97d3-b8071b0060e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.058950 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.058812    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.060384 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.060360    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 16:27:49.159487 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.159452    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.159657 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.159496    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9c6j\" (UniqueName: \"kubernetes.io/projected/5b73d6c2-ac03-4915-97d3-b8071b0060e6-kube-api-access-h9c6j\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.159657 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.159534    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-web-config\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.159657 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:27:49.159637    2566 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 17 16:27:49.159832 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.159684    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b73d6c2-ac03-4915-97d3-b8071b0060e6-config-out\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.159832 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:27:49.159717    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-main-tls podName:5b73d6c2-ac03-4915-97d3-b8071b0060e6 nodeName:}" failed. No retries permitted until 2026-07-17 16:27:49.659693705 +0000 UTC m=+118.518822247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5b73d6c2-ac03-4915-97d3-b8071b0060e6") : secret "alertmanager-main-tls" not found
Jul 17 16:27:49.159832 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.159756    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b73d6c2-ac03-4915-97d3-b8071b0060e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.159832 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.159818    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b73d6c2-ac03-4915-97d3-b8071b0060e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.160039 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.159850    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.160039 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.159875    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b73d6c2-ac03-4915-97d3-b8071b0060e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.160039 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.159942    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.161595 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.160606    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b73d6c2-ac03-4915-97d3-b8071b0060e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.161595 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.160655    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.161595 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.160706    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.161595 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.160735    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.161595 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.160828    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b73d6c2-ac03-4915-97d3-b8071b0060e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.161595 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.161239    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b73d6c2-ac03-4915-97d3-b8071b0060e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.162713 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.162154    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b73d6c2-ac03-4915-97d3-b8071b0060e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.165094 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.165052    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.165387 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.165342    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.165702 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.165651    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.165803 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.165778    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b73d6c2-ac03-4915-97d3-b8071b0060e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.166460 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.166421    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-web-config\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.166653 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.166595    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.167114 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.167091    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b73d6c2-ac03-4915-97d3-b8071b0060e6-config-out\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.167765 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.167732    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.172950 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.172928    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9c6j\" (UniqueName: \"kubernetes.io/projected/5b73d6c2-ac03-4915-97d3-b8071b0060e6-kube-api-access-h9c6j\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.652053 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.651962    2566 generic.go:356] "Generic (PLEG): container finished" podID="07d6a2b8-ca86-499c-b6e1-813c91d87e15" containerID="dca5f32b0fd1987bd80044df180caa60c96907cf022afcaa1dfbb1db3b858a75" exitCode=0
Jul 17 16:27:49.652229 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.652049    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wslpj" event={"ID":"07d6a2b8-ca86-499c-b6e1-813c91d87e15","Type":"ContainerDied","Data":"dca5f32b0fd1987bd80044df180caa60c96907cf022afcaa1dfbb1db3b858a75"}
Jul 17 16:27:49.653754 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.653731    2566 generic.go:356] "Generic (PLEG): container finished" podID="82c7f60e-1ba3-4fe2-8661-6c6ebc698b05" containerID="44f2b92a6f83172ddee846d7f67fd9e3ddd66f88b3f13f9c85802269095084a4" exitCode=0
Jul 17 16:27:49.653859 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.653778    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5gsh8" event={"ID":"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05","Type":"ContainerDied","Data":"44f2b92a6f83172ddee846d7f67fd9e3ddd66f88b3f13f9c85802269095084a4"}
Jul 17 16:27:49.654082 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.654067    2566 scope.go:117] "RemoveContainer" containerID="44f2b92a6f83172ddee846d7f67fd9e3ddd66f88b3f13f9c85802269095084a4"
Jul 17 16:27:49.667185 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.667160    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.670257 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.670217    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:49.924903 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:49.924816    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:27:50.095839 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:50.095801    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 16:27:50.099631 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:27:50.099606    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b73d6c2_ac03_4915_97d3_b8071b0060e6.slice/crio-466b271373a514d16837c08a89c896d5b883473ab563a871fa76cae5cdb3c638 WatchSource:0}: Error finding container 466b271373a514d16837c08a89c896d5b883473ab563a871fa76cae5cdb3c638: Status 404 returned error can't find the container with id 466b271373a514d16837c08a89c896d5b883473ab563a871fa76cae5cdb3c638
Jul 17 16:27:50.605215 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:50.605189    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-5hbc5_b3eb41d7-86a9-45d5-a13b-81ce258f9fde/networking-console-plugin/0.log"
Jul 17 16:27:50.659213 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:50.659178    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerStarted","Data":"466b271373a514d16837c08a89c896d5b883473ab563a871fa76cae5cdb3c638"}
Jul 17 16:27:50.660976 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:50.660948    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5gsh8" event={"ID":"82c7f60e-1ba3-4fe2-8661-6c6ebc698b05","Type":"ContainerStarted","Data":"9164b724154b64591fc24a99121afd993ae1b1da429f70e0954abc940c78a0e9"}
Jul 17 16:27:50.662844 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:50.662823    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wslpj" event={"ID":"07d6a2b8-ca86-499c-b6e1-813c91d87e15","Type":"ContainerStarted","Data":"3f7f6f06273692c9e819418777d1e7bf89bc42b71312aad21f2eaf5864d89379"}
Jul 17 16:27:50.662935 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:50.662866    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wslpj" event={"ID":"07d6a2b8-ca86-499c-b6e1-813c91d87e15","Type":"ContainerStarted","Data":"62914eeecf1554461f28fdd57aa4e92817f9780c4aab3bc22991a7f678bf701d"}
Jul 17 16:27:50.717967 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:50.717911    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wslpj" podStartSLOduration=2.50908057 podStartE2EDuration="3.717889754s" totalImagesPullingTime="1.144898412s" totalInitContainerRuntime="63.910772ms" isStatefulPod=true podCreationTimestamp="2026-07-17 16:27:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:50.71648361 +0000 UTC m=+119.575612170" watchObservedRunningTime="2026-07-17 16:27:50.717889754 +0000 UTC m=+119.577018316"
Jul 17 16:27:50.808682 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:50.808637    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:27:51.010834 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:51.010733    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/2.log"
Jul 17 16:27:51.668235 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:51.668202    2566 generic.go:356] "Generic (PLEG): container finished" podID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerID="3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5" exitCode=0
Jul 17 16:27:51.668711 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:51.668288    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerDied","Data":"3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5"}
Jul 17 16:27:51.805190 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:51.805160    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7559574b98-mjpbg_306ced93-2032-4527-8bad-8bba168bbcf5/router/0.log"
Jul 17 16:27:52.407482 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.407387    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zwg7q_a553f30c-cb45-4cc1-a83b-55aaf03da15d/serve-healthcheck-canary/0.log"
Jul 17 16:27:52.867959 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.867923    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j" podUID="f50a8f6f-4e12-4a44-9d68-e6de2ff77028" containerName="registry" containerID="cri-o://4a0d2ee4c8a472a6936f99befdc4bb4eed7506c9187ff57dfe5d7ca7b0440a22" gracePeriod=30
Jul 17 16:27:52.931100 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.931072    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6cbddbd754-zczcb"]
Jul 17 16:27:52.938746 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.938717    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:52.941486 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.941459    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hgxqm\""
Jul 17 16:27:52.941611 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.941510    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 17 16:27:52.941721 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.941616    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 17 16:27:52.941721 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.941707    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 17 16:27:52.941932 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.941914    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 17 16:27:52.942042 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.941982    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 17 16:27:52.949105 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.948778    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 17 16:27:52.949967 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.949945    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cbddbd754-zczcb"]
Jul 17 16:27:52.993153 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.993131    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee325963-6213-4dd6-aecd-2d76e82ed15a-metrics-client-ca\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:52.993284 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.993161    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ee325963-6213-4dd6-aecd-2d76e82ed15a-telemeter-client-tls\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:52.993284 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.993179    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsr2l\" (UniqueName: \"kubernetes.io/projected/ee325963-6213-4dd6-aecd-2d76e82ed15a-kube-api-access-zsr2l\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:52.993284 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.993208    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ee325963-6213-4dd6-aecd-2d76e82ed15a-federate-client-tls\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:52.993455 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.993282    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee325963-6213-4dd6-aecd-2d76e82ed15a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:52.993455 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.993341    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ee325963-6213-4dd6-aecd-2d76e82ed15a-secret-telemeter-client\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:52.993455 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.993382    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee325963-6213-4dd6-aecd-2d76e82ed15a-serving-certs-ca-bundle\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:52.993455 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:52.993446    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee325963-6213-4dd6-aecd-2d76e82ed15a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.094469 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.094429    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee325963-6213-4dd6-aecd-2d76e82ed15a-serving-certs-ca-bundle\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.094640 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.094505    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee325963-6213-4dd6-aecd-2d76e82ed15a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.094640 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.094556    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee325963-6213-4dd6-aecd-2d76e82ed15a-metrics-client-ca\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.094640 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.094587    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ee325963-6213-4dd6-aecd-2d76e82ed15a-telemeter-client-tls\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.094784 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.094751    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsr2l\" (UniqueName: \"kubernetes.io/projected/ee325963-6213-4dd6-aecd-2d76e82ed15a-kube-api-access-zsr2l\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.094841 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.094814    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ee325963-6213-4dd6-aecd-2d76e82ed15a-federate-client-tls\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.094897 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.094846    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee325963-6213-4dd6-aecd-2d76e82ed15a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.094897 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.094879    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ee325963-6213-4dd6-aecd-2d76e82ed15a-secret-telemeter-client\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.095276 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.095250    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee325963-6213-4dd6-aecd-2d76e82ed15a-serving-certs-ca-bundle\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.095429 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.095306    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee325963-6213-4dd6-aecd-2d76e82ed15a-metrics-client-ca\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.095775 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.095750    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee325963-6213-4dd6-aecd-2d76e82ed15a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.097578 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.097554    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee325963-6213-4dd6-aecd-2d76e82ed15a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.097578 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.097572    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ee325963-6213-4dd6-aecd-2d76e82ed15a-federate-client-tls\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.097726 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.097572    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ee325963-6213-4dd6-aecd-2d76e82ed15a-telemeter-client-tls\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.097869 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.097842    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ee325963-6213-4dd6-aecd-2d76e82ed15a-secret-telemeter-client\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.103439 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.103422    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsr2l\" (UniqueName: \"kubernetes.io/projected/ee325963-6213-4dd6-aecd-2d76e82ed15a-kube-api-access-zsr2l\") pod \"telemeter-client-6cbddbd754-zczcb\" (UID: \"ee325963-6213-4dd6-aecd-2d76e82ed15a\") " pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.252884 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.252852    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb"
Jul 17 16:27:53.378969 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.378944    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:27:53.415590 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.415540    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cbddbd754-zczcb"]
Jul 17 16:27:53.417861 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:27:53.417822    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee325963_6213_4dd6_aecd_2d76e82ed15a.slice/crio-7b3ce75f80f5f5158c710223c1182644c92daddd8b5a2c65138c6e005ffc4b6e WatchSource:0}: Error finding container 7b3ce75f80f5f5158c710223c1182644c92daddd8b5a2c65138c6e005ffc4b6e: Status 404 returned error can't find the container with id 7b3ce75f80f5f5158c710223c1182644c92daddd8b5a2c65138c6e005ffc4b6e
Jul 17 16:27:53.496413 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.496358    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls\") pod \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") "
Jul 17 16:27:53.496413 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.496389    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-certificates\") pod \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") "
Jul 17 16:27:53.496560 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.496438    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-ca-trust-extracted\") pod \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") "
Jul 17 16:27:53.496560 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.496466    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-installation-pull-secrets\") pod \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") "
Jul 17 16:27:53.496560 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.496508    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-bound-sa-token\") pod \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") "
Jul 17 16:27:53.496560 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.496531    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-trusted-ca\") pod \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") "
Jul 17 16:27:53.496758 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.496569    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-image-registry-private-configuration\") pod \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") "
Jul 17 16:27:53.496758 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.496649    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kk9x\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-kube-api-access-4kk9x\") pod \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\" (UID: \"f50a8f6f-4e12-4a44-9d68-e6de2ff77028\") "
Jul 17 16:27:53.496913 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.496888    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f50a8f6f-4e12-4a44-9d68-e6de2ff77028" (UID: "f50a8f6f-4e12-4a44-9d68-e6de2ff77028"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 16:27:53.497361 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.497313    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f50a8f6f-4e12-4a44-9d68-e6de2ff77028" (UID: "f50a8f6f-4e12-4a44-9d68-e6de2ff77028"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 16:27:53.498928 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.498903    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f50a8f6f-4e12-4a44-9d68-e6de2ff77028" (UID: "f50a8f6f-4e12-4a44-9d68-e6de2ff77028"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:27:53.499105 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.499085    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f50a8f6f-4e12-4a44-9d68-e6de2ff77028" (UID: "f50a8f6f-4e12-4a44-9d68-e6de2ff77028"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 16:27:53.499175 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.499112    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f50a8f6f-4e12-4a44-9d68-e6de2ff77028" (UID: "f50a8f6f-4e12-4a44-9d68-e6de2ff77028"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:27:53.499527 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.499505    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-kube-api-access-4kk9x" (OuterVolumeSpecName: "kube-api-access-4kk9x") pod "f50a8f6f-4e12-4a44-9d68-e6de2ff77028" (UID: "f50a8f6f-4e12-4a44-9d68-e6de2ff77028"). InnerVolumeSpecName "kube-api-access-4kk9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:27:53.499527 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.499518    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f50a8f6f-4e12-4a44-9d68-e6de2ff77028" (UID: "f50a8f6f-4e12-4a44-9d68-e6de2ff77028"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 16:27:53.505816 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.505795    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f50a8f6f-4e12-4a44-9d68-e6de2ff77028" (UID: "f50a8f6f-4e12-4a44-9d68-e6de2ff77028"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:27:53.597710 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.597686    2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-bound-sa-token\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:27:53.597710 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.597710    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-trusted-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:27:53.597852 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.597719    2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-image-registry-private-configuration\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:27:53.597852 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.597729    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kk9x\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-kube-api-access-4kk9x\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:27:53.597852 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.597737    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-tls\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:27:53.597852 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.597747    2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-registry-certificates\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:27:53.597852 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.597755    2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-ca-trust-extracted\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:27:53.597852 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.597763    2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f50a8f6f-4e12-4a44-9d68-e6de2ff77028-installation-pull-secrets\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:27:53.677015 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.676982    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb" event={"ID":"ee325963-6213-4dd6-aecd-2d76e82ed15a","Type":"ContainerStarted","Data":"7b3ce75f80f5f5158c710223c1182644c92daddd8b5a2c65138c6e005ffc4b6e"}
Jul 17 16:27:53.679995 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.679971    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerStarted","Data":"6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876"}
Jul 17 16:27:53.680119 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.680033    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerStarted","Data":"427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21"}
Jul 17 16:27:53.680119 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.680072    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerStarted","Data":"aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975"}
Jul 17 16:27:53.680119 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.680111    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerStarted","Data":"5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2"}
Jul 17 16:27:53.680263 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.680142    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerStarted","Data":"b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4"}
Jul 17 16:27:53.681108 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.681089    2566 generic.go:356] "Generic (PLEG): container finished" podID="f50a8f6f-4e12-4a44-9d68-e6de2ff77028" containerID="4a0d2ee4c8a472a6936f99befdc4bb4eed7506c9187ff57dfe5d7ca7b0440a22" exitCode=0
Jul 17 16:27:53.681188 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.681130    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j" event={"ID":"f50a8f6f-4e12-4a44-9d68-e6de2ff77028","Type":"ContainerDied","Data":"4a0d2ee4c8a472a6936f99befdc4bb4eed7506c9187ff57dfe5d7ca7b0440a22"}
Jul 17 16:27:53.681188 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.681135    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j"
Jul 17 16:27:53.681188 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.681155    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5cd6cfdc-g486j" event={"ID":"f50a8f6f-4e12-4a44-9d68-e6de2ff77028","Type":"ContainerDied","Data":"ea5d96e0f20f8b7acb8592cc0e0e6da4eda93cbf3353ef62d17f8c1d64ad3730"}
Jul 17 16:27:53.681188 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.681176    2566 scope.go:117] "RemoveContainer" containerID="4a0d2ee4c8a472a6936f99befdc4bb4eed7506c9187ff57dfe5d7ca7b0440a22"
Jul 17 16:27:53.689762 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.689747    2566 scope.go:117] "RemoveContainer" containerID="4a0d2ee4c8a472a6936f99befdc4bb4eed7506c9187ff57dfe5d7ca7b0440a22"
Jul 17 16:27:53.689996 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:27:53.689969    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a0d2ee4c8a472a6936f99befdc4bb4eed7506c9187ff57dfe5d7ca7b0440a22\": container with ID starting with 4a0d2ee4c8a472a6936f99befdc4bb4eed7506c9187ff57dfe5d7ca7b0440a22 not found: ID does not exist" containerID="4a0d2ee4c8a472a6936f99befdc4bb4eed7506c9187ff57dfe5d7ca7b0440a22"
Jul 17 16:27:53.690035 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.690004    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a0d2ee4c8a472a6936f99befdc4bb4eed7506c9187ff57dfe5d7ca7b0440a22"} err="failed to get container status \"4a0d2ee4c8a472a6936f99befdc4bb4eed7506c9187ff57dfe5d7ca7b0440a22\": rpc error: code = NotFound desc = could not find container \"4a0d2ee4c8a472a6936f99befdc4bb4eed7506c9187ff57dfe5d7ca7b0440a22\": container with ID starting with 4a0d2ee4c8a472a6936f99befdc4bb4eed7506c9187ff57dfe5d7ca7b0440a22 not found: ID does not exist"
Jul 17 16:27:53.702288 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.702265    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c5cd6cfdc-g486j"]
Jul 17 16:27:53.707541 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:53.707520    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6c5cd6cfdc-g486j"]
Jul 17 16:27:54.689738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:54.689705    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerStarted","Data":"7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13"}
Jul 17 16:27:54.717140 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:54.717043    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.891939802 podStartE2EDuration="6.717020419s" totalImagesPullingTime="3.805536459s" totalInitContainerRuntime="19.544158ms" isStatefulPod=false podCreationTimestamp="2026-07-17 16:27:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:54.714844761 +0000 UTC m=+123.573973318" watchObservedRunningTime="2026-07-17 16:27:54.717020419 +0000 UTC m=+123.576149052"
Jul 17 16:27:55.031486 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:55.031452    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f50a8f6f-4e12-4a44-9d68-e6de2ff77028" path="/var/lib/kubelet/pods/f50a8f6f-4e12-4a44-9d68-e6de2ff77028/volumes"
Jul 17 16:27:55.696380 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:55.696349    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb" event={"ID":"ee325963-6213-4dd6-aecd-2d76e82ed15a","Type":"ContainerStarted","Data":"5221fb1d50bbb8b1b240a7170525fdf2ff20bec4a3c0266cbd20b1ff32c5bbfe"}
Jul 17 16:27:55.696692 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:55.696408    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb" event={"ID":"ee325963-6213-4dd6-aecd-2d76e82ed15a","Type":"ContainerStarted","Data":"d57aad1940492fa8a44af9d0381c5d70aa3ee660103a131e475c711b81f3b130"}
Jul 17 16:27:55.696692 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:55.696429    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb" event={"ID":"ee325963-6213-4dd6-aecd-2d76e82ed15a","Type":"ContainerStarted","Data":"d2a97c5fbda527203041c32c55b062748c128cb845a3947991853673ac92d89c"}
Jul 17 16:27:55.727630 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:27:55.727590    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6cbddbd754-zczcb" podStartSLOduration=1.65021205 podStartE2EDuration="3.727576639s" totalImagesPullingTime="2.077364589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:55.726697208 +0000 UTC m=+124.585825768" watchObservedRunningTime="2026-07-17 16:27:55.727576639 +0000 UTC m=+124.586705198"
Jul 17 16:28:08.755183 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:28:08.755155    2566 generic.go:356] "Generic (PLEG): container finished" podID="ebfb68ae-7cd7-4682-9ed8-69a9f64ed712" containerID="978024da1614a3da4c6b087db207c13eba62f3d3143bf6757185404c734a4500" exitCode=0
Jul 17 16:28:08.755571 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:28:08.755232    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m" event={"ID":"ebfb68ae-7cd7-4682-9ed8-69a9f64ed712","Type":"ContainerDied","Data":"978024da1614a3da4c6b087db207c13eba62f3d3143bf6757185404c734a4500"}
Jul 17 16:28:08.755627 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:28:08.755578    2566 scope.go:117] "RemoveContainer" containerID="978024da1614a3da4c6b087db207c13eba62f3d3143bf6757185404c734a4500"
Jul 17 16:28:09.760655 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:28:09.760623    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zc24m" event={"ID":"ebfb68ae-7cd7-4682-9ed8-69a9f64ed712","Type":"ContainerStarted","Data":"28c9805785a7b5137a65dfd1b27420df640683574ff7107a2915bd8949b19126"}
Jul 17 16:29:08.194622 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.194589    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 16:29:08.195150 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.194853    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="alertmanager" containerID="cri-o://b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4" gracePeriod=120
Jul 17 16:29:08.195150 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.194924    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="kube-rbac-proxy-web" containerID="cri-o://aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975" gracePeriod=120
Jul 17 16:29:08.195150 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.194954    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="config-reloader" containerID="cri-o://5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2" gracePeriod=120
Jul 17 16:29:08.195150 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.194987    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="kube-rbac-proxy-metric" containerID="cri-o://6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876" gracePeriod=120
Jul 17 16:29:08.195150 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.194906    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="kube-rbac-proxy" containerID="cri-o://427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21" gracePeriod=120
Jul 17 16:29:08.195150 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.194975    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="prom-label-proxy" containerID="cri-o://7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13" gracePeriod=120
Jul 17 16:29:08.982701 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.982668    2566 generic.go:356] "Generic (PLEG): container finished" podID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerID="7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13" exitCode=0
Jul 17 16:29:08.982701 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.982698    2566 generic.go:356] "Generic (PLEG): container finished" podID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerID="427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21" exitCode=0
Jul 17 16:29:08.982701 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.982708    2566 generic.go:356] "Generic (PLEG): container finished" podID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerID="5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2" exitCode=0
Jul 17 16:29:08.982701 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.982716    2566 generic.go:356] "Generic (PLEG): container finished" podID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerID="b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4" exitCode=0
Jul 17 16:29:08.982958 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.982743    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerDied","Data":"7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13"}
Jul 17 16:29:08.982958 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.982836    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerDied","Data":"427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21"}
Jul 17 16:29:08.982958 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.982862    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerDied","Data":"5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2"}
Jul 17 16:29:08.982958 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:08.982887    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerDied","Data":"b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4"}
Jul 17 16:29:09.536131 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.536108    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:09.665315 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.665278    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy\") pod \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") "
Jul 17 16:29:09.665521 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.665351    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") "
Jul 17 16:29:09.665521 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.665388    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b73d6c2-ac03-4915-97d3-b8071b0060e6-alertmanager-trusted-ca-bundle\") pod \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") "
Jul 17 16:29:09.665521 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.665419    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-main-tls\") pod \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") "
Jul 17 16:29:09.665521 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.665445    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-web-config\") pod \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") "
Jul 17 16:29:09.665742 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.665586    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") "
Jul 17 16:29:09.665742 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.665627    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b73d6c2-ac03-4915-97d3-b8071b0060e6-config-out\") pod \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") "
Jul 17 16:29:09.665742 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.665667    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b73d6c2-ac03-4915-97d3-b8071b0060e6-alertmanager-main-db\") pod \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") "
Jul 17 16:29:09.665742 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.665742    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9c6j\" (UniqueName: \"kubernetes.io/projected/5b73d6c2-ac03-4915-97d3-b8071b0060e6-kube-api-access-h9c6j\") pod \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") "
Jul 17 16:29:09.665933 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.665771    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-cluster-tls-config\") pod \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") "
Jul 17 16:29:09.665933 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.665790    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b73d6c2-ac03-4915-97d3-b8071b0060e6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5b73d6c2-ac03-4915-97d3-b8071b0060e6" (UID: "5b73d6c2-ac03-4915-97d3-b8071b0060e6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 16:29:09.665933 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.665801    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b73d6c2-ac03-4915-97d3-b8071b0060e6-tls-assets\") pod \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") "
Jul 17 16:29:09.665933 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.665871    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-config-volume\") pod \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") "
Jul 17 16:29:09.665933 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.665899    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b73d6c2-ac03-4915-97d3-b8071b0060e6-metrics-client-ca\") pod \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\" (UID: \"5b73d6c2-ac03-4915-97d3-b8071b0060e6\") "
Jul 17 16:29:09.666176 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.666164    2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b73d6c2-ac03-4915-97d3-b8071b0060e6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:29:09.666840 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.666798    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b73d6c2-ac03-4915-97d3-b8071b0060e6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5b73d6c2-ac03-4915-97d3-b8071b0060e6" (UID: "5b73d6c2-ac03-4915-97d3-b8071b0060e6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:29:09.667180 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.667139    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b73d6c2-ac03-4915-97d3-b8071b0060e6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5b73d6c2-ac03-4915-97d3-b8071b0060e6" (UID: "5b73d6c2-ac03-4915-97d3-b8071b0060e6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 16:29:09.668477 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.668445    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5b73d6c2-ac03-4915-97d3-b8071b0060e6" (UID: "5b73d6c2-ac03-4915-97d3-b8071b0060e6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 16:29:09.668914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.668877    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b73d6c2-ac03-4915-97d3-b8071b0060e6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5b73d6c2-ac03-4915-97d3-b8071b0060e6" (UID: "5b73d6c2-ac03-4915-97d3-b8071b0060e6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:29:09.669191 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.669145    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5b73d6c2-ac03-4915-97d3-b8071b0060e6" (UID: "5b73d6c2-ac03-4915-97d3-b8071b0060e6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 16:29:09.669334 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.669293    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-config-volume" (OuterVolumeSpecName: "config-volume") pod "5b73d6c2-ac03-4915-97d3-b8071b0060e6" (UID: "5b73d6c2-ac03-4915-97d3-b8071b0060e6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 16:29:09.669453 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.669425    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5b73d6c2-ac03-4915-97d3-b8071b0060e6" (UID: "5b73d6c2-ac03-4915-97d3-b8071b0060e6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 16:29:09.669572 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.669517    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b73d6c2-ac03-4915-97d3-b8071b0060e6-config-out" (OuterVolumeSpecName: "config-out") pod "5b73d6c2-ac03-4915-97d3-b8071b0060e6" (UID: "5b73d6c2-ac03-4915-97d3-b8071b0060e6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:29:09.669738 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.669717    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b73d6c2-ac03-4915-97d3-b8071b0060e6-kube-api-access-h9c6j" (OuterVolumeSpecName: "kube-api-access-h9c6j") pod "5b73d6c2-ac03-4915-97d3-b8071b0060e6" (UID: "5b73d6c2-ac03-4915-97d3-b8071b0060e6"). InnerVolumeSpecName "kube-api-access-h9c6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:29:09.669799 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.669730    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5b73d6c2-ac03-4915-97d3-b8071b0060e6" (UID: "5b73d6c2-ac03-4915-97d3-b8071b0060e6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 16:29:09.673691 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.673652    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5b73d6c2-ac03-4915-97d3-b8071b0060e6" (UID: "5b73d6c2-ac03-4915-97d3-b8071b0060e6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 16:29:09.679789 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.679770    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-web-config" (OuterVolumeSpecName: "web-config") pod "5b73d6c2-ac03-4915-97d3-b8071b0060e6" (UID: "5b73d6c2-ac03-4915-97d3-b8071b0060e6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 16:29:09.767243 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.767216    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:29:09.767243 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.767239    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:29:09.767243 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.767250    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-main-tls\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:29:09.767463 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.767260    2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-web-config\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:29:09.767463 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.767269    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:29:09.767463 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.767278    2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b73d6c2-ac03-4915-97d3-b8071b0060e6-config-out\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:29:09.767463 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.767286    2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b73d6c2-ac03-4915-97d3-b8071b0060e6-alertmanager-main-db\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:29:09.767463 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.767294    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9c6j\" (UniqueName: \"kubernetes.io/projected/5b73d6c2-ac03-4915-97d3-b8071b0060e6-kube-api-access-h9c6j\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:29:09.767463 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.767302    2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-cluster-tls-config\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:29:09.767463 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.767310    2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b73d6c2-ac03-4915-97d3-b8071b0060e6-tls-assets\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:29:09.767463 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.767335    2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b73d6c2-ac03-4915-97d3-b8071b0060e6-config-volume\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:29:09.767463 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.767342    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b73d6c2-ac03-4915-97d3-b8071b0060e6-metrics-client-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:29:09.989512 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.989474    2566 generic.go:356] "Generic (PLEG): container finished" podID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerID="6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876" exitCode=0
Jul 17 16:29:09.989512 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.989503    2566 generic.go:356] "Generic (PLEG): container finished" podID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerID="aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975" exitCode=0
Jul 17 16:29:09.989700 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.989539    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerDied","Data":"6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876"}
Jul 17 16:29:09.989700 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.989563    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:09.989700 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.989596    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerDied","Data":"aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975"}
Jul 17 16:29:09.989700 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.989624    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b73d6c2-ac03-4915-97d3-b8071b0060e6","Type":"ContainerDied","Data":"466b271373a514d16837c08a89c896d5b883473ab563a871fa76cae5cdb3c638"}
Jul 17 16:29:09.989700 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.989654    2566 scope.go:117] "RemoveContainer" containerID="7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13"
Jul 17 16:29:09.997870 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:09.997759    2566 scope.go:117] "RemoveContainer" containerID="6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876"
Jul 17 16:29:10.004658 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.004641    2566 scope.go:117] "RemoveContainer" containerID="427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21"
Jul 17 16:29:10.011097 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.011074    2566 scope.go:117] "RemoveContainer" containerID="aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975"
Jul 17 16:29:10.013638 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.013616    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 16:29:10.018848 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.018830    2566 scope.go:117] "RemoveContainer" containerID="5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2"
Jul 17 16:29:10.019224 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.019204    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 16:29:10.025461 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.025443    2566 scope.go:117] "RemoveContainer" containerID="b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4"
Jul 17 16:29:10.031892 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.031863    2566 scope.go:117] "RemoveContainer" containerID="3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5"
Jul 17 16:29:10.038131 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.038113    2566 scope.go:117] "RemoveContainer" containerID="7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13"
Jul 17 16:29:10.038378 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:29:10.038356    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13\": container with ID starting with 7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13 not found: ID does not exist" containerID="7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13"
Jul 17 16:29:10.038440 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.038386    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13"} err="failed to get container status \"7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13\": rpc error: code = NotFound desc = could not find container \"7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13\": container with ID starting with 7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13 not found: ID does not exist"
Jul 17 16:29:10.038440 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.038403    2566 scope.go:117] "RemoveContainer" containerID="6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876"
Jul 17 16:29:10.038627 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:29:10.038611    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876\": container with ID starting with 6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876 not found: ID does not exist" containerID="6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876"
Jul 17 16:29:10.038674 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.038630    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876"} err="failed to get container status \"6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876\": rpc error: code = NotFound desc = could not find container \"6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876\": container with ID starting with 6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876 not found: ID does not exist"
Jul 17 16:29:10.038674 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.038644    2566 scope.go:117] "RemoveContainer" containerID="427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21"
Jul 17 16:29:10.038863 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:29:10.038845    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21\": container with ID starting with 427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21 not found: ID does not exist" containerID="427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21"
Jul 17 16:29:10.038903 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.038869    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21"} err="failed to get container status \"427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21\": rpc error: code = NotFound desc = could not find container \"427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21\": container with ID starting with 427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21 not found: ID does not exist"
Jul 17 16:29:10.038903 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.038885    2566 scope.go:117] "RemoveContainer" containerID="aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975"
Jul 17 16:29:10.039119 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:29:10.039101    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975\": container with ID starting with aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975 not found: ID does not exist" containerID="aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975"
Jul 17 16:29:10.039162 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.039125    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975"} err="failed to get container status \"aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975\": rpc error: code = NotFound desc = could not find container \"aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975\": container with ID starting with aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975 not found: ID does not exist"
Jul 17 16:29:10.039162 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.039139    2566 scope.go:117] "RemoveContainer" containerID="5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2"
Jul 17 16:29:10.039389 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:29:10.039372    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2\": container with ID starting with 5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2 not found: ID does not exist" containerID="5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2"
Jul 17 16:29:10.039461 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.039393    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2"} err="failed to get container status \"5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2\": rpc error: code = NotFound desc = could not find container \"5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2\": container with ID starting with 5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2 not found: ID does not exist"
Jul 17 16:29:10.039461 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.039406    2566 scope.go:117] "RemoveContainer" containerID="b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4"
Jul 17 16:29:10.039651 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:29:10.039630    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4\": container with ID starting with b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4 not found: ID does not exist" containerID="b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4"
Jul 17 16:29:10.039730 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.039654    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4"} err="failed to get container status \"b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4\": rpc error: code = NotFound desc = could not find container \"b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4\": container with ID starting with b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4 not found: ID does not exist"
Jul 17 16:29:10.039730 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.039666    2566 scope.go:117] "RemoveContainer" containerID="3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5"
Jul 17 16:29:10.039913 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:29:10.039896    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5\": container with ID starting with 3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5 not found: ID does not exist" containerID="3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5"
Jul 17 16:29:10.039968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.039916    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5"} err="failed to get container status \"3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5\": rpc error: code = NotFound desc = could not find container \"3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5\": container with ID starting with 3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5 not found: ID does not exist"
Jul 17 16:29:10.039968 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.039932    2566 scope.go:117] "RemoveContainer" containerID="7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13"
Jul 17 16:29:10.040236 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.040218    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13"} err="failed to get container status \"7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13\": rpc error: code = NotFound desc = could not find container \"7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13\": container with ID starting with 7e9434b1f947ff6552a0bfab2bea0fe9413ef3de95575ed18042ceeee9435d13 not found: ID does not exist"
Jul 17 16:29:10.040302 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.040237    2566 scope.go:117] "RemoveContainer" containerID="6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876"
Jul 17 16:29:10.040491 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.040475    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876"} err="failed to get container status \"6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876\": rpc error: code = NotFound desc = could not find container \"6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876\": container with ID starting with 6b3860e4966934241d4e4ba0d508f9d794612f5d2dc4684e143dcecb97876876 not found: ID does not exist"
Jul 17 16:29:10.040534 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.040491    2566 scope.go:117] "RemoveContainer" containerID="427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21"
Jul 17 16:29:10.040732 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.040712    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21"} err="failed to get container status \"427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21\": rpc error: code = NotFound desc = could not find container \"427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21\": container with ID starting with 427d9b75c7b7b922c41f15469ad3fdbe6cea20ed908966f5480c247ed7f08e21 not found: ID does not exist"
Jul 17 16:29:10.041072 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.040733    2566 scope.go:117] "RemoveContainer" containerID="aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975"
Jul 17 16:29:10.041290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.041271    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975"} err="failed to get container status \"aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975\": rpc error: code = NotFound desc = could not find container \"aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975\": container with ID starting with aa75def24381dce5a865f5ace2e02aae058d4200df06556aa2b7e1a693841975 not found: ID does not exist"
Jul 17 16:29:10.041290 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.041290    2566 scope.go:117] "RemoveContainer" containerID="5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2"
Jul 17 16:29:10.041531 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.041512    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2"} err="failed to get container status \"5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2\": rpc error: code = NotFound desc = could not find container \"5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2\": container with ID starting with 5c09342b5e015e3ea26c33501c297d37018f61bc482f90a2c4e610dce53567a2 not found: ID does not exist"
Jul 17 16:29:10.041573 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.041532    2566 scope.go:117] "RemoveContainer" containerID="b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4"
Jul 17 16:29:10.041745 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.041728    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4"} err="failed to get container status \"b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4\": rpc error: code = NotFound desc = could not find container \"b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4\": container with ID starting with b32226614258a7b769d8c9fbf9869e79903eb18997c9445c26d601d36b88d5b4 not found: ID does not exist"
Jul 17 16:29:10.041745 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.041744    2566 scope.go:117] "RemoveContainer" containerID="3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5"
Jul 17 16:29:10.041966 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.041948    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5"} err="failed to get container status \"3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5\": rpc error: code = NotFound desc = could not find container \"3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5\": container with ID starting with 3afa5d49f0e3515c83ee543cc148f0b544434b84bade5d7c27d929f5a7c035a5 not found: ID does not exist"
Jul 17 16:29:10.049790 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.049771    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 16:29:10.050034 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050023    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f50a8f6f-4e12-4a44-9d68-e6de2ff77028" containerName="registry"
Jul 17 16:29:10.050074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050036    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f50a8f6f-4e12-4a44-9d68-e6de2ff77028" containerName="registry"
Jul 17 16:29:10.050074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050051    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="config-reloader"
Jul 17 16:29:10.050074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050057    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="config-reloader"
Jul 17 16:29:10.050074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050064    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="prom-label-proxy"
Jul 17 16:29:10.050074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050069    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="prom-label-proxy"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050077    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="alertmanager"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050083    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="alertmanager"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050089    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="kube-rbac-proxy-web"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050095    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="kube-rbac-proxy-web"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050107    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="init-config-reloader"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050113    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="init-config-reloader"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050117    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="kube-rbac-proxy-metric"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050123    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="kube-rbac-proxy-metric"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050129    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="kube-rbac-proxy"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050134    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="kube-rbac-proxy"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050175    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="prom-label-proxy"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050183    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="kube-rbac-proxy"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050189    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="config-reloader"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050194    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="kube-rbac-proxy-metric"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050200    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="kube-rbac-proxy-web"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050205    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f50a8f6f-4e12-4a44-9d68-e6de2ff77028" containerName="registry"
Jul 17 16:29:10.050212 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.050211    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" containerName="alertmanager"
Jul 17 16:29:10.053663 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.053645    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.059770 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.059724    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 17 16:29:10.060268 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.059724    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-456hm\""
Jul 17 16:29:10.060268 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.059972    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 17 16:29:10.060268 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.059993    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 17 16:29:10.060268 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.060005    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 17 16:29:10.060268 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.060097    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 17 16:29:10.060268 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.060133    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 17 16:29:10.060268 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.060174    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 17 16:29:10.060579 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.060444    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 17 16:29:10.065623 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.065605    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 17 16:29:10.073610 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.073585    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 16:29:10.170461 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.170433    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/09b59f0c-59ad-4a7e-9431-8ae978993f3c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.170571 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.170466    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.170571 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.170484    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09b59f0c-59ad-4a7e-9431-8ae978993f3c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.170571 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.170503    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-web-config\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.170571 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.170558    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.170703 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.170592    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwpj4\" (UniqueName: \"kubernetes.io/projected/09b59f0c-59ad-4a7e-9431-8ae978993f3c-kube-api-access-nwpj4\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.170703 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.170613    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.170703 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.170651    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.170703 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.170674    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/09b59f0c-59ad-4a7e-9431-8ae978993f3c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.170703 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.170691    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.170848 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.170710    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09b59f0c-59ad-4a7e-9431-8ae978993f3c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.170848 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.170753    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/09b59f0c-59ad-4a7e-9431-8ae978993f3c-config-out\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.170848 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.170771    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-config-volume\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.273079 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.272996    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/09b59f0c-59ad-4a7e-9431-8ae978993f3c-config-out\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.273079 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.273042    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-config-volume\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.273079 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.273080    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/09b59f0c-59ad-4a7e-9431-8ae978993f3c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.273346 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.273110    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.273346 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.273134    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09b59f0c-59ad-4a7e-9431-8ae978993f3c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.273346 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.273169    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-web-config\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.273346 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.273202    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.273346 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.273239    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwpj4\" (UniqueName: \"kubernetes.io/projected/09b59f0c-59ad-4a7e-9431-8ae978993f3c-kube-api-access-nwpj4\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.273346 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.273262    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.273346 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.273345    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.273673 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.273371    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/09b59f0c-59ad-4a7e-9431-8ae978993f3c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.273673 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.273398    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.273673 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.273426    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09b59f0c-59ad-4a7e-9431-8ae978993f3c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.275370 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.274346    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09b59f0c-59ad-4a7e-9431-8ae978993f3c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.275370 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.275057    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09b59f0c-59ad-4a7e-9431-8ae978993f3c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.276443 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.275787    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/09b59f0c-59ad-4a7e-9431-8ae978993f3c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.277727 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.277697    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.278338 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.278298    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-config-volume\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.279132 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.278934    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-web-config\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.279990 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.279820    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.279990 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.279949    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.280130 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.280085    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/09b59f0c-59ad-4a7e-9431-8ae978993f3c-config-out\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.280996 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.280977    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/09b59f0c-59ad-4a7e-9431-8ae978993f3c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.281072 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.281003    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.281127 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.281081    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/09b59f0c-59ad-4a7e-9431-8ae978993f3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.283565 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.283544    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwpj4\" (UniqueName: \"kubernetes.io/projected/09b59f0c-59ad-4a7e-9431-8ae978993f3c-kube-api-access-nwpj4\") pod \"alertmanager-main-0\" (UID: \"09b59f0c-59ad-4a7e-9431-8ae978993f3c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.363247 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.363220    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 16:29:10.505553 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.505423    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 16:29:10.507555 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:29:10.507530    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b59f0c_59ad_4a7e_9431_8ae978993f3c.slice/crio-3d4744e2060db23b032423bcab69fc7b7c7f0f618f08bb855984b9c097766335 WatchSource:0}: Error finding container 3d4744e2060db23b032423bcab69fc7b7c7f0f618f08bb855984b9c097766335: Status 404 returned error can't find the container with id 3d4744e2060db23b032423bcab69fc7b7c7f0f618f08bb855984b9c097766335
Jul 17 16:29:10.995758 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.995722    2566 generic.go:356] "Generic (PLEG): container finished" podID="09b59f0c-59ad-4a7e-9431-8ae978993f3c" containerID="0933bbc9c65fe8137da10afbcf26b66b5ec134f504273df6406d7e0b6bd87224" exitCode=0
Jul 17 16:29:10.996206 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.995771    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b59f0c-59ad-4a7e-9431-8ae978993f3c","Type":"ContainerDied","Data":"0933bbc9c65fe8137da10afbcf26b66b5ec134f504273df6406d7e0b6bd87224"}
Jul 17 16:29:10.996206 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:10.995819    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b59f0c-59ad-4a7e-9431-8ae978993f3c","Type":"ContainerStarted","Data":"3d4744e2060db23b032423bcab69fc7b7c7f0f618f08bb855984b9c097766335"}
Jul 17 16:29:11.031634 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:11.031605    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b73d6c2-ac03-4915-97d3-b8071b0060e6" path="/var/lib/kubelet/pods/5b73d6c2-ac03-4915-97d3-b8071b0060e6/volumes"
Jul 17 16:29:12.005197 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:12.005155    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b59f0c-59ad-4a7e-9431-8ae978993f3c","Type":"ContainerStarted","Data":"dd97403947c2432c813b20992ebd3601b3050a72134861c944193eab5a54f757"}
Jul 17 16:29:12.005591 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:12.005244    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b59f0c-59ad-4a7e-9431-8ae978993f3c","Type":"ContainerStarted","Data":"7ff4d003f03c1fa6f35aa8d8729c79a81b1dad11a137f92d0db624e034121996"}
Jul 17 16:29:12.005591 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:12.005286    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b59f0c-59ad-4a7e-9431-8ae978993f3c","Type":"ContainerStarted","Data":"916b81233068edd133b3852f9caf5dd016d79c2c12dce9d7d8ace8397a31443f"}
Jul 17 16:29:12.005591 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:12.005341    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b59f0c-59ad-4a7e-9431-8ae978993f3c","Type":"ContainerStarted","Data":"50f638afd502903d3fa856ac50cc157a8c03c10b21b41cebefe7216254e9a836"}
Jul 17 16:29:12.005591 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:12.005378    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b59f0c-59ad-4a7e-9431-8ae978993f3c","Type":"ContainerStarted","Data":"e4697fa28b13b76f8092d4c642cfda3dd9eed419d9dc5bcbbc8d7ac660e096d6"}
Jul 17 16:29:12.005591 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:12.005420    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b59f0c-59ad-4a7e-9431-8ae978993f3c","Type":"ContainerStarted","Data":"fd288adac40ae8ca42f3d1a8d44398d15193f494b765c0bf3d47e0be4f09f3b5"}
Jul 17 16:29:12.031151 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:29:12.031099    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.018704181 podStartE2EDuration="2.031082699s" totalImagesPullingTime="0s" totalInitContainerRuntime="12.378518ms" isStatefulPod=false podCreationTimestamp="2026-07-17 16:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:29:12.029136169 +0000 UTC m=+200.888264753" watchObservedRunningTime="2026-07-17 16:29:12.031082699 +0000 UTC m=+200.890211257"
Jul 17 16:30:47.215396 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:47.215363    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pxw46"]
Jul 17 16:30:47.218699 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:47.218683    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pxw46"
Jul 17 16:30:47.221065 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:47.221043    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 17 16:30:47.221718 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:47.221701    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-nmjvg\""
Jul 17 16:30:47.221829 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:47.221706    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 17 16:30:47.230314 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:47.230295    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pxw46"]
Jul 17 16:30:47.293976 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:47.293950    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzxm9\" (UniqueName: \"kubernetes.io/projected/63d169d7-6fc5-4f5f-b046-169c90149fde-kube-api-access-fzxm9\") pod \"cert-manager-webhook-6486ffd997-pxw46\" (UID: \"63d169d7-6fc5-4f5f-b046-169c90149fde\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pxw46"
Jul 17 16:30:47.294071 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:47.293999    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63d169d7-6fc5-4f5f-b046-169c90149fde-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pxw46\" (UID: \"63d169d7-6fc5-4f5f-b046-169c90149fde\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pxw46"
Jul 17 16:30:47.394571 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:47.394541    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63d169d7-6fc5-4f5f-b046-169c90149fde-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pxw46\" (UID: \"63d169d7-6fc5-4f5f-b046-169c90149fde\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pxw46"
Jul 17 16:30:47.394688 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:47.394587    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxm9\" (UniqueName: \"kubernetes.io/projected/63d169d7-6fc5-4f5f-b046-169c90149fde-kube-api-access-fzxm9\") pod \"cert-manager-webhook-6486ffd997-pxw46\" (UID: \"63d169d7-6fc5-4f5f-b046-169c90149fde\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pxw46"
Jul 17 16:30:47.402984 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:47.402952    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63d169d7-6fc5-4f5f-b046-169c90149fde-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pxw46\" (UID: \"63d169d7-6fc5-4f5f-b046-169c90149fde\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pxw46"
Jul 17 16:30:47.404134 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:47.404117    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzxm9\" (UniqueName: \"kubernetes.io/projected/63d169d7-6fc5-4f5f-b046-169c90149fde-kube-api-access-fzxm9\") pod \"cert-manager-webhook-6486ffd997-pxw46\" (UID: \"63d169d7-6fc5-4f5f-b046-169c90149fde\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pxw46"
Jul 17 16:30:47.536681 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:47.536656    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pxw46"
Jul 17 16:30:47.664833 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:47.664805    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pxw46"]
Jul 17 16:30:47.668418 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:30:47.668391    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63d169d7_6fc5_4f5f_b046_169c90149fde.slice/crio-e6ec541928b6321bf13c1dcabc6b32598e38bd7191c31b973d803452c5f203da WatchSource:0}: Error finding container e6ec541928b6321bf13c1dcabc6b32598e38bd7191c31b973d803452c5f203da: Status 404 returned error can't find the container with id e6ec541928b6321bf13c1dcabc6b32598e38bd7191c31b973d803452c5f203da
Jul 17 16:30:48.364465 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:48.364430    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pxw46" event={"ID":"63d169d7-6fc5-4f5f-b046-169c90149fde","Type":"ContainerStarted","Data":"e6ec541928b6321bf13c1dcabc6b32598e38bd7191c31b973d803452c5f203da"}
Jul 17 16:30:51.387568 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:51.387527    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pxw46" event={"ID":"63d169d7-6fc5-4f5f-b046-169c90149fde","Type":"ContainerStarted","Data":"b474558ab33fbea7bbb551dc076f3c524c4100d81ce0ccc35599e13f80eccf0b"}
Jul 17 16:30:51.387938 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:51.387649    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pxw46"
Jul 17 16:30:51.403932 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:51.403882    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-pxw46" podStartSLOduration=1.244749653 podStartE2EDuration="4.403864803s" totalImagesPullingTime="3.15911515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:30:51.403337284 +0000 UTC m=+300.262465837" watchObservedRunningTime="2026-07-17 16:30:51.403864803 +0000 UTC m=+300.262993362"
Jul 17 16:30:52.813179 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:52.813150    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:30:52.815497 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:52.815474    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:30:52.824575 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:52.824556    2566 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 16:30:57.393690 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:30:57.393652    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pxw46"
Jul 17 16:31:00.481478 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.481445    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-slx42"]
Jul 17 16:31:00.484720 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.484704    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-slx42"
Jul 17 16:31:00.486793 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.486769    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 17 16:31:00.487539 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.487519    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 17 16:31:00.487628 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.487519    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xzw7s\""
Jul 17 16:31:00.494041 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.494019    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-slx42"]
Jul 17 16:31:00.596710 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.596683    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgzjm\" (UniqueName: \"kubernetes.io/projected/8ec91a46-9d9f-49c8-bd0f-256962cf2335-kube-api-access-bgzjm\") pod \"openshift-lws-operator-fd8ccff4c-slx42\" (UID: \"8ec91a46-9d9f-49c8-bd0f-256962cf2335\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-slx42"
Jul 17 16:31:00.596860 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.596724    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ec91a46-9d9f-49c8-bd0f-256962cf2335-tmp\") pod \"openshift-lws-operator-fd8ccff4c-slx42\" (UID: \"8ec91a46-9d9f-49c8-bd0f-256962cf2335\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-slx42"
Jul 17 16:31:00.697774 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.697738    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgzjm\" (UniqueName: \"kubernetes.io/projected/8ec91a46-9d9f-49c8-bd0f-256962cf2335-kube-api-access-bgzjm\") pod \"openshift-lws-operator-fd8ccff4c-slx42\" (UID: \"8ec91a46-9d9f-49c8-bd0f-256962cf2335\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-slx42"
Jul 17 16:31:00.697774 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.697780    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ec91a46-9d9f-49c8-bd0f-256962cf2335-tmp\") pod \"openshift-lws-operator-fd8ccff4c-slx42\" (UID: \"8ec91a46-9d9f-49c8-bd0f-256962cf2335\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-slx42"
Jul 17 16:31:00.698110 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.698094    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ec91a46-9d9f-49c8-bd0f-256962cf2335-tmp\") pod \"openshift-lws-operator-fd8ccff4c-slx42\" (UID: \"8ec91a46-9d9f-49c8-bd0f-256962cf2335\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-slx42"
Jul 17 16:31:00.705480 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.705458    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgzjm\" (UniqueName: \"kubernetes.io/projected/8ec91a46-9d9f-49c8-bd0f-256962cf2335-kube-api-access-bgzjm\") pod \"openshift-lws-operator-fd8ccff4c-slx42\" (UID: \"8ec91a46-9d9f-49c8-bd0f-256962cf2335\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-slx42"
Jul 17 16:31:00.793791 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.793767    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-slx42"
Jul 17 16:31:00.921027 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.920876    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-slx42"]
Jul 17 16:31:00.923787 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:31:00.923762    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ec91a46_9d9f_49c8_bd0f_256962cf2335.slice/crio-7e8a835b5c6be55894ff3412787f6defbb7e68f85ef5bbef1bc44c3d3d2ac30e WatchSource:0}: Error finding container 7e8a835b5c6be55894ff3412787f6defbb7e68f85ef5bbef1bc44c3d3d2ac30e: Status 404 returned error can't find the container with id 7e8a835b5c6be55894ff3412787f6defbb7e68f85ef5bbef1bc44c3d3d2ac30e
Jul 17 16:31:00.925253 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:00.925237    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 16:31:01.428641 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:01.428604    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-slx42" event={"ID":"8ec91a46-9d9f-49c8-bd0f-256962cf2335","Type":"ContainerStarted","Data":"7e8a835b5c6be55894ff3412787f6defbb7e68f85ef5bbef1bc44c3d3d2ac30e"}
Jul 17 16:31:04.446178 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:04.446142    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-slx42" event={"ID":"8ec91a46-9d9f-49c8-bd0f-256962cf2335","Type":"ContainerStarted","Data":"ae50e5a92b8ce344a63b3cdd5092f78185bb9e2b46c3cc02ba3e59c9a26209e9"}
Jul 17 16:31:04.461972 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:04.461926    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-slx42" podStartSLOduration=1.602943512 podStartE2EDuration="4.461911117s" totalImagesPullingTime="2.858967605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:31:04.460786075 +0000 UTC m=+313.319914639" watchObservedRunningTime="2026-07-17 16:31:04.461911117 +0000 UTC m=+313.321039675"
Jul 17 16:31:07.339940 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:07.339908    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5gnnn"]
Jul 17 16:31:07.343110 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:07.343093    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5gnnn"
Jul 17 16:31:07.345482 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:07.345458    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8m486\""
Jul 17 16:31:07.352188 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:07.352166    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5gnnn"]
Jul 17 16:31:07.354997 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:07.354978    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7a7bb0f-096e-4a56-b3ae-bac1b34e1c97-bound-sa-token\") pod \"cert-manager-55b4d954d5-5gnnn\" (UID: \"f7a7bb0f-096e-4a56-b3ae-bac1b34e1c97\") " pod="cert-manager/cert-manager-55b4d954d5-5gnnn"
Jul 17 16:31:07.355093 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:07.355016    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb4xm\" (UniqueName: \"kubernetes.io/projected/f7a7bb0f-096e-4a56-b3ae-bac1b34e1c97-kube-api-access-fb4xm\") pod \"cert-manager-55b4d954d5-5gnnn\" (UID: \"f7a7bb0f-096e-4a56-b3ae-bac1b34e1c97\") " pod="cert-manager/cert-manager-55b4d954d5-5gnnn"
Jul 17 16:31:07.455426 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:07.455387    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4xm\" (UniqueName: \"kubernetes.io/projected/f7a7bb0f-096e-4a56-b3ae-bac1b34e1c97-kube-api-access-fb4xm\") pod \"cert-manager-55b4d954d5-5gnnn\" (UID: \"f7a7bb0f-096e-4a56-b3ae-bac1b34e1c97\") " pod="cert-manager/cert-manager-55b4d954d5-5gnnn"
Jul 17 16:31:07.455627 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:07.455501    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7a7bb0f-096e-4a56-b3ae-bac1b34e1c97-bound-sa-token\") pod \"cert-manager-55b4d954d5-5gnnn\" (UID: \"f7a7bb0f-096e-4a56-b3ae-bac1b34e1c97\") " pod="cert-manager/cert-manager-55b4d954d5-5gnnn"
Jul 17 16:31:07.469155 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:07.469120    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb4xm\" (UniqueName: \"kubernetes.io/projected/f7a7bb0f-096e-4a56-b3ae-bac1b34e1c97-kube-api-access-fb4xm\") pod \"cert-manager-55b4d954d5-5gnnn\" (UID: \"f7a7bb0f-096e-4a56-b3ae-bac1b34e1c97\") " pod="cert-manager/cert-manager-55b4d954d5-5gnnn"
Jul 17 16:31:07.469307 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:07.469296    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7a7bb0f-096e-4a56-b3ae-bac1b34e1c97-bound-sa-token\") pod \"cert-manager-55b4d954d5-5gnnn\" (UID: \"f7a7bb0f-096e-4a56-b3ae-bac1b34e1c97\") " pod="cert-manager/cert-manager-55b4d954d5-5gnnn"
Jul 17 16:31:07.652626 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:07.652536    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5gnnn"
Jul 17 16:31:07.777936 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:07.777892    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5gnnn"]
Jul 17 16:31:07.780038 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:31:07.780013    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7a7bb0f_096e_4a56_b3ae_bac1b34e1c97.slice/crio-5924c8186c4c74a753f0e96e8c3ffca6703b0059f2c41702815f25c65a94be9b WatchSource:0}: Error finding container 5924c8186c4c74a753f0e96e8c3ffca6703b0059f2c41702815f25c65a94be9b: Status 404 returned error can't find the container with id 5924c8186c4c74a753f0e96e8c3ffca6703b0059f2c41702815f25c65a94be9b
Jul 17 16:31:08.462718 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:08.462686    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5gnnn" event={"ID":"f7a7bb0f-096e-4a56-b3ae-bac1b34e1c97","Type":"ContainerStarted","Data":"9712f552b2bebe7055bc7933744d924de1fdb88535c4124cfa4a1824b251b4a0"}
Jul 17 16:31:08.462718 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:08.462721    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5gnnn" event={"ID":"f7a7bb0f-096e-4a56-b3ae-bac1b34e1c97","Type":"ContainerStarted","Data":"5924c8186c4c74a753f0e96e8c3ffca6703b0059f2c41702815f25c65a94be9b"}
Jul 17 16:31:08.479471 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:08.479427    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-5gnnn" podStartSLOduration=1.479413491 podStartE2EDuration="1.479413491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:31:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:31:08.478448001 +0000 UTC m=+317.337576559" watchObservedRunningTime="2026-07-17 16:31:08.479413491 +0000 UTC m=+317.338542049"
Jul 17 16:31:24.873539 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:24.873506    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"]
Jul 17 16:31:24.918697 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:24.918672    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"]
Jul 17 16:31:24.918847 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:24.918766    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:24.924332 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:24.924299    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 16:31:24.924465 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:24.924371    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 16:31:24.928475 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:24.928456    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 16:31:24.929764 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:24.929740    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 16:31:24.929963 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:24.929948    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4r79r\""
Jul 17 16:31:24.988280 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:24.988256    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d881fe92-2ba0-4342-8393-1ec14706fde6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:24.988399 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:24.988311    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d881fe92-2ba0-4342-8393-1ec14706fde6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:24.988441 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:24.988407    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d881fe92-2ba0-4342-8393-1ec14706fde6-tmp\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:24.988480 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:24.988450    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d881fe92-2ba0-4342-8393-1ec14706fde6-manifests\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:24.988565 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:24.988530    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjjj2\" (UniqueName: \"kubernetes.io/projected/d881fe92-2ba0-4342-8393-1ec14706fde6-kube-api-access-zjjj2\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:25.089814 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:25.089784    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d881fe92-2ba0-4342-8393-1ec14706fde6-tmp\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:25.089983 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:25.089824    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d881fe92-2ba0-4342-8393-1ec14706fde6-manifests\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:25.089983 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:25.089864    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjj2\" (UniqueName: \"kubernetes.io/projected/d881fe92-2ba0-4342-8393-1ec14706fde6-kube-api-access-zjjj2\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:25.089983 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:25.089967    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d881fe92-2ba0-4342-8393-1ec14706fde6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:25.090151 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:25.090014    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d881fe92-2ba0-4342-8393-1ec14706fde6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:25.090244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:25.090216    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d881fe92-2ba0-4342-8393-1ec14706fde6-manifests\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:25.092337 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:25.092299    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d881fe92-2ba0-4342-8393-1ec14706fde6-tmp\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:25.092442 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:25.092396    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d881fe92-2ba0-4342-8393-1ec14706fde6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:25.092520 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:25.092498    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d881fe92-2ba0-4342-8393-1ec14706fde6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:25.097976 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:25.097958    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjjj2\" (UniqueName: \"kubernetes.io/projected/d881fe92-2ba0-4342-8393-1ec14706fde6-kube-api-access-zjjj2\") pod \"opendatahub-operator-controller-manager-5cc76599b9-f8rr2\" (UID: \"d881fe92-2ba0-4342-8393-1ec14706fde6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:25.229353 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:25.229261    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:25.374416 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:25.374395    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"]
Jul 17 16:31:25.376521 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:31:25.376489    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd881fe92_2ba0_4342_8393_1ec14706fde6.slice/crio-b28eb2eeb8f3fd0f5f716d9eb946cd981363f0765eccee650d50ce3d9f4589f8 WatchSource:0}: Error finding container b28eb2eeb8f3fd0f5f716d9eb946cd981363f0765eccee650d50ce3d9f4589f8: Status 404 returned error can't find the container with id b28eb2eeb8f3fd0f5f716d9eb946cd981363f0765eccee650d50ce3d9f4589f8
Jul 17 16:31:25.530388 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:25.530353    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2" event={"ID":"d881fe92-2ba0-4342-8393-1ec14706fde6","Type":"ContainerStarted","Data":"b28eb2eeb8f3fd0f5f716d9eb946cd981363f0765eccee650d50ce3d9f4589f8"}
Jul 17 16:31:28.549580 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:28.549544    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2" event={"ID":"d881fe92-2ba0-4342-8393-1ec14706fde6","Type":"ContainerStarted","Data":"d55939ac5955f296cc4d0da2d95915468e03c960346d36ef00ba5c3ed1c513d2"}
Jul 17 16:31:29.555597 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:29.555558    2566 generic.go:356] "Generic (PLEG): container finished" podID="d881fe92-2ba0-4342-8393-1ec14706fde6" containerID="d55939ac5955f296cc4d0da2d95915468e03c960346d36ef00ba5c3ed1c513d2" exitCode=0
Jul 17 16:31:29.556065 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:29.555644    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2" event={"ID":"d881fe92-2ba0-4342-8393-1ec14706fde6","Type":"ContainerDied","Data":"d55939ac5955f296cc4d0da2d95915468e03c960346d36ef00ba5c3ed1c513d2"}
Jul 17 16:31:30.562304 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:30.562266    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2" event={"ID":"d881fe92-2ba0-4342-8393-1ec14706fde6","Type":"ContainerStarted","Data":"0f6d1f056cd59ee8efd7e708932faccec52de6f2c621a829ccee3a33ff48e10d"}
Jul 17 16:31:30.562701 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:30.562400    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:30.585808 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:30.585758    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2" podStartSLOduration=2.261179566 podStartE2EDuration="6.585740799s" totalImagesPullingTime="3.293383366s" totalInitContainerRuntime="1.031177867s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:31:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:31:30.585095953 +0000 UTC m=+339.444224535" watchObservedRunningTime="2026-07-17 16:31:30.585740799 +0000 UTC m=+339.444869360"
Jul 17 16:31:41.568924 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:41.568891    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-f8rr2"
Jul 17 16:31:52.360805 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.360731    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"]
Jul 17 16:31:52.365410 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.365388    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:52.368383 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.368357    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 17 16:31:52.368514 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.368361    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 17 16:31:52.368514 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.368422    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 17 16:31:52.368514 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.368489    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-spj29\""
Jul 17 16:31:52.372829 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.372690    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"]
Jul 17 16:31:52.512182 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.512155    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw27w\" (UniqueName: \"kubernetes.io/projected/ac0fb846-36cc-4329-8d84-da8889b4246c-kube-api-access-gw27w\") pod \"lws-controller-manager-64bdb655c8-lw8zr\" (UID: \"ac0fb846-36cc-4329-8d84-da8889b4246c\") " pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:52.512367 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.512204    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac0fb846-36cc-4329-8d84-da8889b4246c-metrics-cert\") pod \"lws-controller-manager-64bdb655c8-lw8zr\" (UID: \"ac0fb846-36cc-4329-8d84-da8889b4246c\") " pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:52.512367 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.512260    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ac0fb846-36cc-4329-8d84-da8889b4246c-manager-config\") pod \"lws-controller-manager-64bdb655c8-lw8zr\" (UID: \"ac0fb846-36cc-4329-8d84-da8889b4246c\") " pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:52.512367 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.512288    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac0fb846-36cc-4329-8d84-da8889b4246c-cert\") pod \"lws-controller-manager-64bdb655c8-lw8zr\" (UID: \"ac0fb846-36cc-4329-8d84-da8889b4246c\") " pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:52.613580 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.613492    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw27w\" (UniqueName: \"kubernetes.io/projected/ac0fb846-36cc-4329-8d84-da8889b4246c-kube-api-access-gw27w\") pod \"lws-controller-manager-64bdb655c8-lw8zr\" (UID: \"ac0fb846-36cc-4329-8d84-da8889b4246c\") " pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:52.613580 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.613547    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac0fb846-36cc-4329-8d84-da8889b4246c-metrics-cert\") pod \"lws-controller-manager-64bdb655c8-lw8zr\" (UID: \"ac0fb846-36cc-4329-8d84-da8889b4246c\") " pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:52.613766 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.613584    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ac0fb846-36cc-4329-8d84-da8889b4246c-manager-config\") pod \"lws-controller-manager-64bdb655c8-lw8zr\" (UID: \"ac0fb846-36cc-4329-8d84-da8889b4246c\") " pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:52.613766 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.613599    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac0fb846-36cc-4329-8d84-da8889b4246c-cert\") pod \"lws-controller-manager-64bdb655c8-lw8zr\" (UID: \"ac0fb846-36cc-4329-8d84-da8889b4246c\") " pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:52.614367 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.614313    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ac0fb846-36cc-4329-8d84-da8889b4246c-manager-config\") pod \"lws-controller-manager-64bdb655c8-lw8zr\" (UID: \"ac0fb846-36cc-4329-8d84-da8889b4246c\") " pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:52.615987 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.615964    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac0fb846-36cc-4329-8d84-da8889b4246c-cert\") pod \"lws-controller-manager-64bdb655c8-lw8zr\" (UID: \"ac0fb846-36cc-4329-8d84-da8889b4246c\") " pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:52.616089 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.616047    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac0fb846-36cc-4329-8d84-da8889b4246c-metrics-cert\") pod \"lws-controller-manager-64bdb655c8-lw8zr\" (UID: \"ac0fb846-36cc-4329-8d84-da8889b4246c\") " pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:52.639133 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.639107    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw27w\" (UniqueName: \"kubernetes.io/projected/ac0fb846-36cc-4329-8d84-da8889b4246c-kube-api-access-gw27w\") pod \"lws-controller-manager-64bdb655c8-lw8zr\" (UID: \"ac0fb846-36cc-4329-8d84-da8889b4246c\") " pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:52.676015 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.675992    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:52.831311 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:52.827952    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"]
Jul 17 16:31:53.665553 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:53.665510    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr" event={"ID":"ac0fb846-36cc-4329-8d84-da8889b4246c","Type":"ContainerStarted","Data":"7fd188a0b074e0a0943fa54acd834a9d7e3a702719b8b5383107a35f801ea861"}
Jul 17 16:31:54.671360 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:54.671234    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr" event={"ID":"ac0fb846-36cc-4329-8d84-da8889b4246c","Type":"ContainerStarted","Data":"b7327c3605e69f1fa5c60f9503a0be7f4bae19256fd9554461ee54cb7893ddbb"}
Jul 17 16:31:54.671360 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:54.671300    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:31:54.711553 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:31:54.711504    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr" podStartSLOduration=1.2630723480000001 podStartE2EDuration="2.711485716s" totalImagesPullingTime="1.448413368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:31:54.710849373 +0000 UTC m=+363.569977933" watchObservedRunningTime="2026-07-17 16:31:54.711485716 +0000 UTC m=+363.570614275"
Jul 17 16:32:03.612500 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.612467    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"]
Jul 17 16:32:03.618902 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.618881    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.621463 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.621442    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 16:32:03.621463 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.621457    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-g8lsg\""
Jul 17 16:32:03.631383 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.631361    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"]
Jul 17 16:32:03.704832 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.704808    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.704976 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.704837    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.704976 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.704865    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.704976 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.704891    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93053b78-3b7b-4f0e-950f-0fb6da559f33-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.704976 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.704962    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.705166 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.704994    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g48z\" (UniqueName: \"kubernetes.io/projected/93053b78-3b7b-4f0e-950f-0fb6da559f33-kube-api-access-2g48z\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.705166 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.705038    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93053b78-3b7b-4f0e-950f-0fb6da559f33-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.705166 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.705082    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93053b78-3b7b-4f0e-950f-0fb6da559f33-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.705166 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.705146    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.805823 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.805782    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93053b78-3b7b-4f0e-950f-0fb6da559f33-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.806014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.805838    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.806014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.805864    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.806014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.805882    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.806014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.805917    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.806014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.805944    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93053b78-3b7b-4f0e-950f-0fb6da559f33-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.806014 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.805973    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.806282 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.806019    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g48z\" (UniqueName: \"kubernetes.io/projected/93053b78-3b7b-4f0e-950f-0fb6da559f33-kube-api-access-2g48z\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.806282 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.806115    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93053b78-3b7b-4f0e-950f-0fb6da559f33-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.806427 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.806346    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.806486 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.806435    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.806539 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.806495    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.806574 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.806559    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.806805 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.806788    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93053b78-3b7b-4f0e-950f-0fb6da559f33-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.808795 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.808773    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93053b78-3b7b-4f0e-950f-0fb6da559f33-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.808959 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.808940    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93053b78-3b7b-4f0e-950f-0fb6da559f33-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.815674 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.815647    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93053b78-3b7b-4f0e-950f-0fb6da559f33-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.816452 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.816436    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g48z\" (UniqueName: \"kubernetes.io/projected/93053b78-3b7b-4f0e-950f-0fb6da559f33-kube-api-access-2g48z\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782wt76\" (UID: \"93053b78-3b7b-4f0e-950f-0fb6da559f33\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:03.928535 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:03.928458    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:04.065680 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:04.065652    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"]
Jul 17 16:32:04.067762 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:32:04.067739    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93053b78_3b7b_4f0e_950f_0fb6da559f33.slice/crio-39b13d2debd3fc7591f7a95b6deed094c0873c760da49b82fd526e6ab096faa1 WatchSource:0}: Error finding container 39b13d2debd3fc7591f7a95b6deed094c0873c760da49b82fd526e6ab096faa1: Status 404 returned error can't find the container with id 39b13d2debd3fc7591f7a95b6deed094c0873c760da49b82fd526e6ab096faa1
Jul 17 16:32:04.719500 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:04.719454    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76" event={"ID":"93053b78-3b7b-4f0e-950f-0fb6da559f33","Type":"ContainerStarted","Data":"39b13d2debd3fc7591f7a95b6deed094c0873c760da49b82fd526e6ab096faa1"}
Jul 17 16:32:05.679086 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:05.679052    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-64bdb655c8-lw8zr"
Jul 17 16:32:06.597251 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:06.597211    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:32:06.597645 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:06.597300    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:32:06.597645 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:06.597377    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:32:06.732097 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:06.732065    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76" event={"ID":"93053b78-3b7b-4f0e-950f-0fb6da559f33","Type":"ContainerStarted","Data":"be43942814b1d027581572eb03cacbcaf6ae39457f8a4649302ea5787080918f"}
Jul 17 16:32:06.756097 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:06.756044    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76" podStartSLOduration=1.229284215 podStartE2EDuration="3.756027283s" totalImagesPullingTime="2.526743068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:32:06.753643339 +0000 UTC m=+375.612771899" watchObservedRunningTime="2026-07-17 16:32:06.756027283 +0000 UTC m=+375.615155841"
Jul 17 16:32:06.929121 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:06.929038    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:07.933710 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:07.933681    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:08.740376 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:08.740346    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:08.741336 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:08.741304    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782wt76"
Jul 17 16:32:45.451599 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:45.451565    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88nw6"]
Jul 17 16:32:45.454569 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:45.454552    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-88nw6"
Jul 17 16:32:45.457210 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:45.457174    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-nv2jn\""
Jul 17 16:32:45.457432 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:45.457231    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 16:32:45.457960 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:45.457940    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 16:32:45.464223 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:45.464204    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88nw6"]
Jul 17 16:32:45.545249 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:45.545215    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxhq8\" (UniqueName: \"kubernetes.io/projected/2e415f18-2860-40f5-b05e-e9b60a723056-kube-api-access-jxhq8\") pod \"kuadrant-operator-catalog-88nw6\" (UID: \"2e415f18-2860-40f5-b05e-e9b60a723056\") " pod="kuadrant-system/kuadrant-operator-catalog-88nw6"
Jul 17 16:32:45.646090 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:45.646063    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxhq8\" (UniqueName: \"kubernetes.io/projected/2e415f18-2860-40f5-b05e-e9b60a723056-kube-api-access-jxhq8\") pod \"kuadrant-operator-catalog-88nw6\" (UID: \"2e415f18-2860-40f5-b05e-e9b60a723056\") " pod="kuadrant-system/kuadrant-operator-catalog-88nw6"
Jul 17 16:32:45.654279 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:45.654256    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxhq8\" (UniqueName: \"kubernetes.io/projected/2e415f18-2860-40f5-b05e-e9b60a723056-kube-api-access-jxhq8\") pod \"kuadrant-operator-catalog-88nw6\" (UID: \"2e415f18-2860-40f5-b05e-e9b60a723056\") " pod="kuadrant-system/kuadrant-operator-catalog-88nw6"
Jul 17 16:32:45.765853 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:45.765799    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-88nw6"
Jul 17 16:32:45.800036 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:45.800010    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88nw6"]
Jul 17 16:32:45.890142 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:45.890118    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88nw6"]
Jul 17 16:32:45.892938 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:32:45.892912    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e415f18_2860_40f5_b05e_e9b60a723056.slice/crio-8775d1a7fdd91fc2b765e4bd6cd2cfbf7f311f76f08401e47f25cba72559619f WatchSource:0}: Error finding container 8775d1a7fdd91fc2b765e4bd6cd2cfbf7f311f76f08401e47f25cba72559619f: Status 404 returned error can't find the container with id 8775d1a7fdd91fc2b765e4bd6cd2cfbf7f311f76f08401e47f25cba72559619f
Jul 17 16:32:45.907878 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:45.907848    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-88nw6" event={"ID":"2e415f18-2860-40f5-b05e-e9b60a723056","Type":"ContainerStarted","Data":"8775d1a7fdd91fc2b765e4bd6cd2cfbf7f311f76f08401e47f25cba72559619f"}
Jul 17 16:32:46.012308 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:46.012280    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxvzl"]
Jul 17 16:32:46.016370 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:46.016308    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zxvzl"
Jul 17 16:32:46.023974 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:46.023936    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxvzl"]
Jul 17 16:32:46.049529 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:46.049506    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnxmn\" (UniqueName: \"kubernetes.io/projected/b31624ed-b741-4593-bc1d-bbc4ff03ef38-kube-api-access-jnxmn\") pod \"kuadrant-operator-catalog-zxvzl\" (UID: \"b31624ed-b741-4593-bc1d-bbc4ff03ef38\") " pod="kuadrant-system/kuadrant-operator-catalog-zxvzl"
Jul 17 16:32:46.150405 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:46.150366    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnxmn\" (UniqueName: \"kubernetes.io/projected/b31624ed-b741-4593-bc1d-bbc4ff03ef38-kube-api-access-jnxmn\") pod \"kuadrant-operator-catalog-zxvzl\" (UID: \"b31624ed-b741-4593-bc1d-bbc4ff03ef38\") " pod="kuadrant-system/kuadrant-operator-catalog-zxvzl"
Jul 17 16:32:46.158446 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:46.158426    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnxmn\" (UniqueName: \"kubernetes.io/projected/b31624ed-b741-4593-bc1d-bbc4ff03ef38-kube-api-access-jnxmn\") pod \"kuadrant-operator-catalog-zxvzl\" (UID: \"b31624ed-b741-4593-bc1d-bbc4ff03ef38\") " pod="kuadrant-system/kuadrant-operator-catalog-zxvzl"
Jul 17 16:32:46.326514 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:46.326481    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zxvzl"
Jul 17 16:32:46.467006 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:46.466977    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxvzl"]
Jul 17 16:32:46.479979 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:32:46.479937    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31624ed_b741_4593_bc1d_bbc4ff03ef38.slice/crio-766108176abcef6086f3ac79c6d48673929451a35a80252f5f941fc1175cfbd0 WatchSource:0}: Error finding container 766108176abcef6086f3ac79c6d48673929451a35a80252f5f941fc1175cfbd0: Status 404 returned error can't find the container with id 766108176abcef6086f3ac79c6d48673929451a35a80252f5f941fc1175cfbd0
Jul 17 16:32:46.914001 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:46.913968    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zxvzl" event={"ID":"b31624ed-b741-4593-bc1d-bbc4ff03ef38","Type":"ContainerStarted","Data":"766108176abcef6086f3ac79c6d48673929451a35a80252f5f941fc1175cfbd0"}
Jul 17 16:32:48.924297 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:48.924255    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-88nw6" event={"ID":"2e415f18-2860-40f5-b05e-e9b60a723056","Type":"ContainerStarted","Data":"bc49903cc9e55be3f4db34eace619bc6c506722681d811374282c69b28ead1b8"}
Jul 17 16:32:48.924707 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:48.924341    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-88nw6" podUID="2e415f18-2860-40f5-b05e-e9b60a723056" containerName="registry-server" containerID="cri-o://bc49903cc9e55be3f4db34eace619bc6c506722681d811374282c69b28ead1b8" gracePeriod=2
Jul 17 16:32:48.939718 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:48.939664    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-88nw6" podStartSLOduration=1.866848005 podStartE2EDuration="3.939646229s" totalImagesPullingTime="2.072798224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:32:48.939454441 +0000 UTC m=+417.798583001" watchObservedRunningTime="2026-07-17 16:32:48.939646229 +0000 UTC m=+417.798774788"
Jul 17 16:32:49.165775 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:49.165751    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-88nw6"
Jul 17 16:32:49.274873 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:49.274780    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxhq8\" (UniqueName: \"kubernetes.io/projected/2e415f18-2860-40f5-b05e-e9b60a723056-kube-api-access-jxhq8\") pod \"2e415f18-2860-40f5-b05e-e9b60a723056\" (UID: \"2e415f18-2860-40f5-b05e-e9b60a723056\") "
Jul 17 16:32:49.276989 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:49.276962    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e415f18-2860-40f5-b05e-e9b60a723056-kube-api-access-jxhq8" (OuterVolumeSpecName: "kube-api-access-jxhq8") pod "2e415f18-2860-40f5-b05e-e9b60a723056" (UID: "2e415f18-2860-40f5-b05e-e9b60a723056"). InnerVolumeSpecName "kube-api-access-jxhq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:32:49.375591 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:49.375538    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxhq8\" (UniqueName: \"kubernetes.io/projected/2e415f18-2860-40f5-b05e-e9b60a723056-kube-api-access-jxhq8\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:32:49.929928 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:49.929897    2566 generic.go:356] "Generic (PLEG): container finished" podID="2e415f18-2860-40f5-b05e-e9b60a723056" containerID="bc49903cc9e55be3f4db34eace619bc6c506722681d811374282c69b28ead1b8" exitCode=0
Jul 17 16:32:49.930342 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:49.929937    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-88nw6"
Jul 17 16:32:49.930342 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:49.929984    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-88nw6" event={"ID":"2e415f18-2860-40f5-b05e-e9b60a723056","Type":"ContainerDied","Data":"bc49903cc9e55be3f4db34eace619bc6c506722681d811374282c69b28ead1b8"}
Jul 17 16:32:49.930342 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:49.930031    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-88nw6" event={"ID":"2e415f18-2860-40f5-b05e-e9b60a723056","Type":"ContainerDied","Data":"8775d1a7fdd91fc2b765e4bd6cd2cfbf7f311f76f08401e47f25cba72559619f"}
Jul 17 16:32:49.930342 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:49.930053    2566 scope.go:117] "RemoveContainer" containerID="bc49903cc9e55be3f4db34eace619bc6c506722681d811374282c69b28ead1b8"
Jul 17 16:32:49.939050 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:49.939035    2566 scope.go:117] "RemoveContainer" containerID="bc49903cc9e55be3f4db34eace619bc6c506722681d811374282c69b28ead1b8"
Jul 17 16:32:49.939282 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:32:49.939266    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc49903cc9e55be3f4db34eace619bc6c506722681d811374282c69b28ead1b8\": container with ID starting with bc49903cc9e55be3f4db34eace619bc6c506722681d811374282c69b28ead1b8 not found: ID does not exist" containerID="bc49903cc9e55be3f4db34eace619bc6c506722681d811374282c69b28ead1b8"
Jul 17 16:32:49.939347 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:49.939289    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc49903cc9e55be3f4db34eace619bc6c506722681d811374282c69b28ead1b8"} err="failed to get container status \"bc49903cc9e55be3f4db34eace619bc6c506722681d811374282c69b28ead1b8\": rpc error: code = NotFound desc = could not find container \"bc49903cc9e55be3f4db34eace619bc6c506722681d811374282c69b28ead1b8\": container with ID starting with bc49903cc9e55be3f4db34eace619bc6c506722681d811374282c69b28ead1b8 not found: ID does not exist"
Jul 17 16:32:49.949912 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:49.949892    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88nw6"]
Jul 17 16:32:49.953717 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:49.953697    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88nw6"]
Jul 17 16:32:51.031120 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:32:51.031076    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e415f18-2860-40f5-b05e-e9b60a723056" path="/var/lib/kubelet/pods/2e415f18-2860-40f5-b05e-e9b60a723056/volumes"
Jul 17 16:32:57.611001 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:32:57.610954    2566 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:5e5d4ac256b57ef55bb57f4e00764634f98e6fa4c63ce8264f911320b3a8bf2e: fetching blob: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" image="quay.io/kuadrant/kuadrant-operator-catalog:v1.4.2"
Jul 17 16:32:57.611477 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:32:57.611071    2566 kuberuntime_manager.go:1459] "Unhandled Error" err="container registry-server start failed in pod kuadrant-operator-catalog-zxvzl_kuadrant-system(b31624ed-b741-4593-bc1d-bbc4ff03ef38): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:5e5d4ac256b57ef55bb57f4e00764634f98e6fa4c63ce8264f911320b3a8bf2e: fetching blob: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 17 16:32:57.611477 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:32:57.611101    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry-server\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:5e5d4ac256b57ef55bb57f4e00764634f98e6fa4c63ce8264f911320b3a8bf2e: fetching blob: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image\"" pod="kuadrant-system/kuadrant-operator-catalog-zxvzl" podUID="b31624ed-b741-4593-bc1d-bbc4ff03ef38"
Jul 17 16:32:57.972861 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:32:57.972821    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry-server\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/kuadrant/kuadrant-operator-catalog:v1.4.2\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:5e5d4ac256b57ef55bb57f4e00764634f98e6fa4c63ce8264f911320b3a8bf2e: fetching blob: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image\"" pod="kuadrant-system/kuadrant-operator-catalog-zxvzl" podUID="b31624ed-b741-4593-bc1d-bbc4ff03ef38"
Jul 17 16:33:10.030804 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:10.030769    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zxvzl" event={"ID":"b31624ed-b741-4593-bc1d-bbc4ff03ef38","Type":"ContainerStarted","Data":"07f96f9a61aecdc7d419881bc8012cd6a6c59b613f6ecdaa4f6418622d1e3ea5"}
Jul 17 16:33:10.048945 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:10.048884    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zxvzl" podStartSLOduration=2.057667679 podStartE2EDuration="25.048864966s" totalImagesPullingTime="22.991197287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-17 16:33:10.048500395 +0000 UTC m=+438.907628953" watchObservedRunningTime="2026-07-17 16:33:10.048864966 +0000 UTC m=+438.907993526"
Jul 17 16:33:16.327243 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:16.327155    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zxvzl"
Jul 17 16:33:16.327243 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:16.327210    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zxvzl"
Jul 17 16:33:16.349651 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:16.349622    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zxvzl"
Jul 17 16:33:17.082051 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:17.082020    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zxvzl"
Jul 17 16:33:34.238231 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:34.238192    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2fz9g"]
Jul 17 16:33:34.238759 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:34.238742    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e415f18-2860-40f5-b05e-e9b60a723056" containerName="registry-server"
Jul 17 16:33:34.238849 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:34.238764    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e415f18-2860-40f5-b05e-e9b60a723056" containerName="registry-server"
Jul 17 16:33:34.238892 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:34.238881    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e415f18-2860-40f5-b05e-e9b60a723056" containerName="registry-server"
Jul 17 16:33:34.246905 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:34.246882    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2fz9g"
Jul 17 16:33:34.250685 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:34.250661    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bg75k\""
Jul 17 16:33:34.250848 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:34.250700    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 17 16:33:34.252080 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:34.252061    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2fz9g"]
Jul 17 16:33:34.336647 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:34.336621    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcrzb\" (UniqueName: \"kubernetes.io/projected/f61f09b6-e8c3-4472-9304-5a5ae852cc1e-kube-api-access-vcrzb\") pod \"dns-operator-controller-manager-864dd78c4c-2fz9g\" (UID: \"f61f09b6-e8c3-4472-9304-5a5ae852cc1e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2fz9g"
Jul 17 16:33:34.437887 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:34.437855    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcrzb\" (UniqueName: \"kubernetes.io/projected/f61f09b6-e8c3-4472-9304-5a5ae852cc1e-kube-api-access-vcrzb\") pod \"dns-operator-controller-manager-864dd78c4c-2fz9g\" (UID: \"f61f09b6-e8c3-4472-9304-5a5ae852cc1e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2fz9g"
Jul 17 16:33:34.446728 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:34.446705    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcrzb\" (UniqueName: \"kubernetes.io/projected/f61f09b6-e8c3-4472-9304-5a5ae852cc1e-kube-api-access-vcrzb\") pod \"dns-operator-controller-manager-864dd78c4c-2fz9g\" (UID: \"f61f09b6-e8c3-4472-9304-5a5ae852cc1e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2fz9g"
Jul 17 16:33:34.557517 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:34.557498    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2fz9g"
Jul 17 16:33:34.686072 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:34.686049    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2fz9g"]
Jul 17 16:33:34.688196 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:33:34.688172    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf61f09b6_e8c3_4472_9304_5a5ae852cc1e.slice/crio-52f9c4a1107f55ff1dd4d82dd9c2890dc6cd6b7588c28cff66ba8ecc6de9a0c4 WatchSource:0}: Error finding container 52f9c4a1107f55ff1dd4d82dd9c2890dc6cd6b7588c28cff66ba8ecc6de9a0c4: Status 404 returned error can't find the container with id 52f9c4a1107f55ff1dd4d82dd9c2890dc6cd6b7588c28cff66ba8ecc6de9a0c4
Jul 17 16:33:35.137310 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:35.137277    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2fz9g" event={"ID":"f61f09b6-e8c3-4472-9304-5a5ae852cc1e","Type":"ContainerStarted","Data":"52f9c4a1107f55ff1dd4d82dd9c2890dc6cd6b7588c28cff66ba8ecc6de9a0c4"}
Jul 17 16:33:37.148047 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:37.147966    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2fz9g" event={"ID":"f61f09b6-e8c3-4472-9304-5a5ae852cc1e","Type":"ContainerStarted","Data":"9dd123f1fe09dffa08c7939bee0f027b30887dcb1deef17913aa0e6d5f81ec9d"}
Jul 17 16:33:37.148047 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:37.148018    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2fz9g"
Jul 17 16:33:37.165465 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:37.165417    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2fz9g" podStartSLOduration=0.99739424 podStartE2EDuration="3.16540166s" totalImagesPullingTime="2.16800742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:33:37.164417752 +0000 UTC m=+466.023546314" watchObservedRunningTime="2026-07-17 16:33:37.16540166 +0000 UTC m=+466.024530218"
Jul 17 16:33:37.689721 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:37.689687    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"]
Jul 17 16:33:37.693015 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:37.692998    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"
Jul 17 16:33:37.695156 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:37.695132    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jn9c8\""
Jul 17 16:33:37.704396 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:37.704376    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"]
Jul 17 16:33:37.762822 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:37.762796    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mc69\" (UniqueName: \"kubernetes.io/projected/58cb3fd7-bcda-4e55-9112-ba0a692713b2-kube-api-access-7mc69\") pod \"limitador-operator-controller-manager-859d7b78bd-q28d5\" (UID: \"58cb3fd7-bcda-4e55-9112-ba0a692713b2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"
Jul 17 16:33:37.863194 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:37.863165    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mc69\" (UniqueName: \"kubernetes.io/projected/58cb3fd7-bcda-4e55-9112-ba0a692713b2-kube-api-access-7mc69\") pod \"limitador-operator-controller-manager-859d7b78bd-q28d5\" (UID: \"58cb3fd7-bcda-4e55-9112-ba0a692713b2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"
Jul 17 16:33:37.871100 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:37.871077    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mc69\" (UniqueName: \"kubernetes.io/projected/58cb3fd7-bcda-4e55-9112-ba0a692713b2-kube-api-access-7mc69\") pod \"limitador-operator-controller-manager-859d7b78bd-q28d5\" (UID: \"58cb3fd7-bcda-4e55-9112-ba0a692713b2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"
Jul 17 16:33:38.003341 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:38.003262    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"
Jul 17 16:33:38.136388 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:38.136363    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"]
Jul 17 16:33:38.139297 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:33:38.139268    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58cb3fd7_bcda_4e55_9112_ba0a692713b2.slice/crio-7e3856c8697a01d155e6c7d22b337457e06ebdc634b04e818715a3874a4dd9c2 WatchSource:0}: Error finding container 7e3856c8697a01d155e6c7d22b337457e06ebdc634b04e818715a3874a4dd9c2: Status 404 returned error can't find the container with id 7e3856c8697a01d155e6c7d22b337457e06ebdc634b04e818715a3874a4dd9c2
Jul 17 16:33:38.159971 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:38.159938    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5" event={"ID":"58cb3fd7-bcda-4e55-9112-ba0a692713b2","Type":"ContainerStarted","Data":"7e3856c8697a01d155e6c7d22b337457e06ebdc634b04e818715a3874a4dd9c2"}
Jul 17 16:33:40.170305 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:40.170265    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5" event={"ID":"58cb3fd7-bcda-4e55-9112-ba0a692713b2","Type":"ContainerStarted","Data":"45fe2d06acf72359849247af942c338aa366d1bad99d062901c4410207fe8a63"}
Jul 17 16:33:40.170686 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:40.170348    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"
Jul 17 16:33:40.186462 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:40.186418    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5" podStartSLOduration=1.579118711 podStartE2EDuration="3.186405213s" totalImagesPullingTime="1.607286502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:33:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:33:40.184526092 +0000 UTC m=+469.043654652" watchObservedRunningTime="2026-07-17 16:33:40.186405213 +0000 UTC m=+469.045533772"
Jul 17 16:33:46.527547 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:46.527507    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"]
Jul 17 16:33:46.530999 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:46.530978    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"
Jul 17 16:33:46.534583 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:46.534564    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-st7cb\""
Jul 17 16:33:46.549703 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:46.549676    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"]
Jul 17 16:33:46.628244 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:46.628215    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hscd\" (UniqueName: \"kubernetes.io/projected/567da1f4-103f-4c8c-a75d-4ee99ff3b57b-kube-api-access-4hscd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5w9hm\" (UID: \"567da1f4-103f-4c8c-a75d-4ee99ff3b57b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"
Jul 17 16:33:46.628389 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:46.628267    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/567da1f4-103f-4c8c-a75d-4ee99ff3b57b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5w9hm\" (UID: \"567da1f4-103f-4c8c-a75d-4ee99ff3b57b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"
Jul 17 16:33:46.728956 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:46.728932    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hscd\" (UniqueName: \"kubernetes.io/projected/567da1f4-103f-4c8c-a75d-4ee99ff3b57b-kube-api-access-4hscd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5w9hm\" (UID: \"567da1f4-103f-4c8c-a75d-4ee99ff3b57b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"
Jul 17 16:33:46.729052 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:46.728970    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/567da1f4-103f-4c8c-a75d-4ee99ff3b57b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5w9hm\" (UID: \"567da1f4-103f-4c8c-a75d-4ee99ff3b57b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"
Jul 17 16:33:46.729279 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:46.729255    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/567da1f4-103f-4c8c-a75d-4ee99ff3b57b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5w9hm\" (UID: \"567da1f4-103f-4c8c-a75d-4ee99ff3b57b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"
Jul 17 16:33:46.738705 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:46.738684    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hscd\" (UniqueName: \"kubernetes.io/projected/567da1f4-103f-4c8c-a75d-4ee99ff3b57b-kube-api-access-4hscd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5w9hm\" (UID: \"567da1f4-103f-4c8c-a75d-4ee99ff3b57b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"
Jul 17 16:33:46.840858 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:46.840801    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"
Jul 17 16:33:46.979307 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:46.979259    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"]
Jul 17 16:33:46.981806 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:33:46.981780    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod567da1f4_103f_4c8c_a75d_4ee99ff3b57b.slice/crio-695f95851f538fdfd9524cda63a1dad0580ea2b075857c2a197c428488c0431d WatchSource:0}: Error finding container 695f95851f538fdfd9524cda63a1dad0580ea2b075857c2a197c428488c0431d: Status 404 returned error can't find the container with id 695f95851f538fdfd9524cda63a1dad0580ea2b075857c2a197c428488c0431d
Jul 17 16:33:47.208601 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:47.208517    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm" event={"ID":"567da1f4-103f-4c8c-a75d-4ee99ff3b57b","Type":"ContainerStarted","Data":"695f95851f538fdfd9524cda63a1dad0580ea2b075857c2a197c428488c0431d"}
Jul 17 16:33:48.162121 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:48.162089    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2fz9g"
Jul 17 16:33:51.177538 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:51.177510    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"
Jul 17 16:33:54.252239 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:54.252203    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm" event={"ID":"567da1f4-103f-4c8c-a75d-4ee99ff3b57b","Type":"ContainerStarted","Data":"0a44974ee1f068ff6d01b164e3fcf5f06557403c904bf58fcda7f17d7afb13f4"}
Jul 17 16:33:54.252624 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:54.252352    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"
Jul 17 16:33:54.273450 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:33:54.273399    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm" podStartSLOduration=1.5318059019999999 podStartE2EDuration="8.273385207s" totalImagesPullingTime="6.741579305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:33:54.27238272 +0000 UTC m=+483.131511279" watchObservedRunningTime="2026-07-17 16:33:54.273385207 +0000 UTC m=+483.132513765"
Jul 17 16:34:05.260591 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:05.260559    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"
Jul 17 16:34:06.960781 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:06.960749    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"]
Jul 17 16:34:06.961157 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:06.960958    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm" podUID="567da1f4-103f-4c8c-a75d-4ee99ff3b57b" containerName="manager" containerID="cri-o://0a44974ee1f068ff6d01b164e3fcf5f06557403c904bf58fcda7f17d7afb13f4" gracePeriod=2
Jul 17 16:34:06.970046 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:06.970009    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"]
Jul 17 16:34:06.987373 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:06.987345    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"]
Jul 17 16:34:06.987605 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:06.987579    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5" podUID="58cb3fd7-bcda-4e55-9112-ba0a692713b2" containerName="manager" containerID="cri-o://45fe2d06acf72359849247af942c338aa366d1bad99d062901c4410207fe8a63" gracePeriod=2
Jul 17 16:34:06.999460 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:06.999431    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"]
Jul 17 16:34:06.999791 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:06.999778    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="567da1f4-103f-4c8c-a75d-4ee99ff3b57b" containerName="manager"
Jul 17 16:34:06.999791 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:06.999792    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="567da1f4-103f-4c8c-a75d-4ee99ff3b57b" containerName="manager"
Jul 17 16:34:06.999907 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:06.999859    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="567da1f4-103f-4c8c-a75d-4ee99ff3b57b" containerName="manager"
Jul 17 16:34:07.002841 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.002821    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"
Jul 17 16:34:07.009654 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.009628    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"]
Jul 17 16:34:07.010583 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:34:07.010549    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"58cb3fd7-bcda-4e55-9112-ba0a692713b2\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-q28d5\": pods \"limitador-operator-controller-manager-859d7b78bd-q28d5\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"
Jul 17 16:34:07.012472 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:34:07.012437    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5w9hm\" is forbidden: User \"system:node:ip-10-0-130-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-95.ec2.internal' and this object" podUID="567da1f4-103f-4c8c-a75d-4ee99ff3b57b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"
Jul 17 16:34:07.014170 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:34:07.014143    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q28d5\" is forbidden: User \"system:node:ip-10-0-130-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-95.ec2.internal' and this object" podUID="58cb3fd7-bcda-4e55-9112-ba0a692713b2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"
Jul 17 16:34:07.016784 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.016761    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"]
Jul 17 16:34:07.021972 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.021951    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thrm2"]
Jul 17 16:34:07.022333 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.022307    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58cb3fd7-bcda-4e55-9112-ba0a692713b2" containerName="manager"
Jul 17 16:34:07.022464 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.022336    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="58cb3fd7-bcda-4e55-9112-ba0a692713b2" containerName="manager"
Jul 17 16:34:07.022464 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.022393    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="58cb3fd7-bcda-4e55-9112-ba0a692713b2" containerName="manager"
Jul 17 16:34:07.025043 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.025027    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thrm2"
Jul 17 16:34:07.040841 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.040815    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thrm2"]
Jul 17 16:34:07.042441 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:34:07.042416    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5w9hm\" is forbidden: User \"system:node:ip-10-0-130-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-95.ec2.internal' and this object" podUID="567da1f4-103f-4c8c-a75d-4ee99ff3b57b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"
Jul 17 16:34:07.097181 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.097152    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tttp\" (UniqueName: \"kubernetes.io/projected/db64618e-efe2-4dfc-9994-acc28d56b321-kube-api-access-8tttp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69tlp\" (UID: \"db64618e-efe2-4dfc-9994-acc28d56b321\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"
Jul 17 16:34:07.097306 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.097223    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw4hr\" (UniqueName: \"kubernetes.io/projected/8a4f39cd-f267-4d9e-884b-fa6184c368a8-kube-api-access-dw4hr\") pod \"limitador-operator-controller-manager-859d7b78bd-thrm2\" (UID: \"8a4f39cd-f267-4d9e-884b-fa6184c368a8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thrm2"
Jul 17 16:34:07.097306 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.097251    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db64618e-efe2-4dfc-9994-acc28d56b321-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69tlp\" (UID: \"db64618e-efe2-4dfc-9994-acc28d56b321\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"
Jul 17 16:34:07.198724 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.198695    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tttp\" (UniqueName: \"kubernetes.io/projected/db64618e-efe2-4dfc-9994-acc28d56b321-kube-api-access-8tttp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69tlp\" (UID: \"db64618e-efe2-4dfc-9994-acc28d56b321\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"
Jul 17 16:34:07.198879 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.198754    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw4hr\" (UniqueName: \"kubernetes.io/projected/8a4f39cd-f267-4d9e-884b-fa6184c368a8-kube-api-access-dw4hr\") pod \"limitador-operator-controller-manager-859d7b78bd-thrm2\" (UID: \"8a4f39cd-f267-4d9e-884b-fa6184c368a8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thrm2"
Jul 17 16:34:07.198951 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.198931    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db64618e-efe2-4dfc-9994-acc28d56b321-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69tlp\" (UID: \"db64618e-efe2-4dfc-9994-acc28d56b321\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"
Jul 17 16:34:07.199341 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.199299    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db64618e-efe2-4dfc-9994-acc28d56b321-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69tlp\" (UID: \"db64618e-efe2-4dfc-9994-acc28d56b321\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"
Jul 17 16:34:07.216570 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.216552    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tttp\" (UniqueName: \"kubernetes.io/projected/db64618e-efe2-4dfc-9994-acc28d56b321-kube-api-access-8tttp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69tlp\" (UID: \"db64618e-efe2-4dfc-9994-acc28d56b321\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"
Jul 17 16:34:07.216875 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.216858    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw4hr\" (UniqueName: \"kubernetes.io/projected/8a4f39cd-f267-4d9e-884b-fa6184c368a8-kube-api-access-dw4hr\") pod \"limitador-operator-controller-manager-859d7b78bd-thrm2\" (UID: \"8a4f39cd-f267-4d9e-884b-fa6184c368a8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thrm2"
Jul 17 16:34:07.237648 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.237631    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"
Jul 17 16:34:07.239576 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.239562    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"
Jul 17 16:34:07.300049 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.300028    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/567da1f4-103f-4c8c-a75d-4ee99ff3b57b-extensions-socket-volume\") pod \"567da1f4-103f-4c8c-a75d-4ee99ff3b57b\" (UID: \"567da1f4-103f-4c8c-a75d-4ee99ff3b57b\") "
Jul 17 16:34:07.300142 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.300103    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hscd\" (UniqueName: \"kubernetes.io/projected/567da1f4-103f-4c8c-a75d-4ee99ff3b57b-kube-api-access-4hscd\") pod \"567da1f4-103f-4c8c-a75d-4ee99ff3b57b\" (UID: \"567da1f4-103f-4c8c-a75d-4ee99ff3b57b\") "
Jul 17 16:34:07.300142 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.300133    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mc69\" (UniqueName: \"kubernetes.io/projected/58cb3fd7-bcda-4e55-9112-ba0a692713b2-kube-api-access-7mc69\") pod \"58cb3fd7-bcda-4e55-9112-ba0a692713b2\" (UID: \"58cb3fd7-bcda-4e55-9112-ba0a692713b2\") "
Jul 17 16:34:07.300503 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.300480    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567da1f4-103f-4c8c-a75d-4ee99ff3b57b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "567da1f4-103f-4c8c-a75d-4ee99ff3b57b" (UID: "567da1f4-103f-4c8c-a75d-4ee99ff3b57b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:34:07.301979 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.301956    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/567da1f4-103f-4c8c-a75d-4ee99ff3b57b-kube-api-access-4hscd" (OuterVolumeSpecName: "kube-api-access-4hscd") pod "567da1f4-103f-4c8c-a75d-4ee99ff3b57b" (UID: "567da1f4-103f-4c8c-a75d-4ee99ff3b57b"). InnerVolumeSpecName "kube-api-access-4hscd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:34:07.302086 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.302066    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58cb3fd7-bcda-4e55-9112-ba0a692713b2-kube-api-access-7mc69" (OuterVolumeSpecName: "kube-api-access-7mc69") pod "58cb3fd7-bcda-4e55-9112-ba0a692713b2" (UID: "58cb3fd7-bcda-4e55-9112-ba0a692713b2"). InnerVolumeSpecName "kube-api-access-7mc69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:34:07.315236 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.315211    2566 generic.go:356] "Generic (PLEG): container finished" podID="58cb3fd7-bcda-4e55-9112-ba0a692713b2" containerID="45fe2d06acf72359849247af942c338aa366d1bad99d062901c4410207fe8a63" exitCode=0
Jul 17 16:34:07.315335 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.315252    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q28d5"
Jul 17 16:34:07.315335 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.315308    2566 scope.go:117] "RemoveContainer" containerID="45fe2d06acf72359849247af942c338aa366d1bad99d062901c4410207fe8a63"
Jul 17 16:34:07.316828 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.316803    2566 generic.go:356] "Generic (PLEG): container finished" podID="567da1f4-103f-4c8c-a75d-4ee99ff3b57b" containerID="0a44974ee1f068ff6d01b164e3fcf5f06557403c904bf58fcda7f17d7afb13f4" exitCode=0
Jul 17 16:34:07.316944 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.316843    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5w9hm"
Jul 17 16:34:07.324257 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.324240    2566 scope.go:117] "RemoveContainer" containerID="45fe2d06acf72359849247af942c338aa366d1bad99d062901c4410207fe8a63"
Jul 17 16:34:07.324624 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:34:07.324605    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45fe2d06acf72359849247af942c338aa366d1bad99d062901c4410207fe8a63\": container with ID starting with 45fe2d06acf72359849247af942c338aa366d1bad99d062901c4410207fe8a63 not found: ID does not exist" containerID="45fe2d06acf72359849247af942c338aa366d1bad99d062901c4410207fe8a63"
Jul 17 16:34:07.324691 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.324631    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45fe2d06acf72359849247af942c338aa366d1bad99d062901c4410207fe8a63"} err="failed to get container status \"45fe2d06acf72359849247af942c338aa366d1bad99d062901c4410207fe8a63\": rpc error: code = NotFound desc = could not find container \"45fe2d06acf72359849247af942c338aa366d1bad99d062901c4410207fe8a63\": container with ID starting with 45fe2d06acf72359849247af942c338aa366d1bad99d062901c4410207fe8a63 not found: ID does not exist"
Jul 17 16:34:07.324691 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.324651    2566 scope.go:117] "RemoveContainer" containerID="0a44974ee1f068ff6d01b164e3fcf5f06557403c904bf58fcda7f17d7afb13f4"
Jul 17 16:34:07.332436 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.332420    2566 scope.go:117] "RemoveContainer" containerID="0a44974ee1f068ff6d01b164e3fcf5f06557403c904bf58fcda7f17d7afb13f4"
Jul 17 16:34:07.332672 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:34:07.332655    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a44974ee1f068ff6d01b164e3fcf5f06557403c904bf58fcda7f17d7afb13f4\": container with ID starting with 0a44974ee1f068ff6d01b164e3fcf5f06557403c904bf58fcda7f17d7afb13f4 not found: ID does not exist" containerID="0a44974ee1f068ff6d01b164e3fcf5f06557403c904bf58fcda7f17d7afb13f4"
Jul 17 16:34:07.332709 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.332678    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a44974ee1f068ff6d01b164e3fcf5f06557403c904bf58fcda7f17d7afb13f4"} err="failed to get container status \"0a44974ee1f068ff6d01b164e3fcf5f06557403c904bf58fcda7f17d7afb13f4\": rpc error: code = NotFound desc = could not find container \"0a44974ee1f068ff6d01b164e3fcf5f06557403c904bf58fcda7f17d7afb13f4\": container with ID starting with 0a44974ee1f068ff6d01b164e3fcf5f06557403c904bf58fcda7f17d7afb13f4 not found: ID does not exist"
Jul 17 16:34:07.401532 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.401510    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/567da1f4-103f-4c8c-a75d-4ee99ff3b57b-extensions-socket-volume\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:34:07.401532 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.401528    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hscd\" (UniqueName: \"kubernetes.io/projected/567da1f4-103f-4c8c-a75d-4ee99ff3b57b-kube-api-access-4hscd\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:34:07.401653 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.401537    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mc69\" (UniqueName: \"kubernetes.io/projected/58cb3fd7-bcda-4e55-9112-ba0a692713b2-kube-api-access-7mc69\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:34:07.406395 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.406380    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"
Jul 17 16:34:07.412456 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.412439    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thrm2"
Jul 17 16:34:07.555510 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.555488    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"]
Jul 17 16:34:07.557690 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:34:07.557663    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb64618e_efe2_4dfc_9994_acc28d56b321.slice/crio-3492af55b7e2e216ee5b4ec707c62feef8b601c462ac3918c3e19572aa6c95ad WatchSource:0}: Error finding container 3492af55b7e2e216ee5b4ec707c62feef8b601c462ac3918c3e19572aa6c95ad: Status 404 returned error can't find the container with id 3492af55b7e2e216ee5b4ec707c62feef8b601c462ac3918c3e19572aa6c95ad
Jul 17 16:34:07.568868 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:07.568845    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thrm2"]
Jul 17 16:34:07.570470 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:34:07.570445    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a4f39cd_f267_4d9e_884b_fa6184c368a8.slice/crio-20d649403dcb04b8536488546a7aa4ce76efdb17f217e9f513837b5b20ae224b WatchSource:0}: Error finding container 20d649403dcb04b8536488546a7aa4ce76efdb17f217e9f513837b5b20ae224b: Status 404 returned error can't find the container with id 20d649403dcb04b8536488546a7aa4ce76efdb17f217e9f513837b5b20ae224b
Jul 17 16:34:08.323588 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:08.323553    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thrm2" event={"ID":"8a4f39cd-f267-4d9e-884b-fa6184c368a8","Type":"ContainerStarted","Data":"cb748e17d1bd328c040bbd4c9148d357c4838a59abbdb277feaf0d31ddfa4338"}
Jul 17 16:34:08.324022 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:08.323609    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thrm2" event={"ID":"8a4f39cd-f267-4d9e-884b-fa6184c368a8","Type":"ContainerStarted","Data":"20d649403dcb04b8536488546a7aa4ce76efdb17f217e9f513837b5b20ae224b"}
Jul 17 16:34:08.324022 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:08.323686    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thrm2"
Jul 17 16:34:08.325208 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:08.325184    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp" event={"ID":"db64618e-efe2-4dfc-9994-acc28d56b321","Type":"ContainerStarted","Data":"b5209a6f6686b2b618f635d64656ce4af822d6140cb5e127fc69436e0a40ba3d"}
Jul 17 16:34:08.325353 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:08.325235    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"
Jul 17 16:34:08.325353 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:08.325259    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp" event={"ID":"db64618e-efe2-4dfc-9994-acc28d56b321","Type":"ContainerStarted","Data":"3492af55b7e2e216ee5b4ec707c62feef8b601c462ac3918c3e19572aa6c95ad"}
Jul 17 16:34:08.345183 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:08.345139    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thrm2" podStartSLOduration=2.34512659 podStartE2EDuration="2.34512659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:34:08.343396743 +0000 UTC m=+497.202525303" watchObservedRunningTime="2026-07-17 16:34:08.34512659 +0000 UTC m=+497.204255148"
Jul 17 16:34:08.362291 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:08.362248    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp" podStartSLOduration=2.362234005 podStartE2EDuration="2.362234005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:34:08.360456301 +0000 UTC m=+497.219584860" watchObservedRunningTime="2026-07-17 16:34:08.362234005 +0000 UTC m=+497.221362563"
Jul 17 16:34:09.031897 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:09.031860    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="567da1f4-103f-4c8c-a75d-4ee99ff3b57b" path="/var/lib/kubelet/pods/567da1f4-103f-4c8c-a75d-4ee99ff3b57b/volumes"
Jul 17 16:34:09.032173 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:09.032161    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58cb3fd7-bcda-4e55-9112-ba0a692713b2" path="/var/lib/kubelet/pods/58cb3fd7-bcda-4e55-9112-ba0a692713b2/volumes"
Jul 17 16:34:19.332150 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:19.332110    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"
Jul 17 16:34:19.332646 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:19.332253    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-thrm2"
Jul 17 16:34:35.740443 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:35.740397    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"]
Jul 17 16:34:35.740858 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:35.740608    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp" podUID="db64618e-efe2-4dfc-9994-acc28d56b321" containerName="manager" containerID="cri-o://b5209a6f6686b2b618f635d64656ce4af822d6140cb5e127fc69436e0a40ba3d" gracePeriod=10
Jul 17 16:34:35.952171 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:35.952137    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"]
Jul 17 16:34:35.954567 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:35.954545    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"
Jul 17 16:34:35.967937 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:35.967916    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"]
Jul 17 16:34:35.982882 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:35.982864    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"
Jul 17 16:34:36.130686 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.130661    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tttp\" (UniqueName: \"kubernetes.io/projected/db64618e-efe2-4dfc-9994-acc28d56b321-kube-api-access-8tttp\") pod \"db64618e-efe2-4dfc-9994-acc28d56b321\" (UID: \"db64618e-efe2-4dfc-9994-acc28d56b321\") "
Jul 17 16:34:36.130849 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.130784    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db64618e-efe2-4dfc-9994-acc28d56b321-extensions-socket-volume\") pod \"db64618e-efe2-4dfc-9994-acc28d56b321\" (UID: \"db64618e-efe2-4dfc-9994-acc28d56b321\") "
Jul 17 16:34:36.130990 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.130973    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d42dee2f-72ba-4991-a954-3e716e2c1533-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nmn9h\" (UID: \"d42dee2f-72ba-4991-a954-3e716e2c1533\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"
Jul 17 16:34:36.131072 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.131050    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76v9b\" (UniqueName: \"kubernetes.io/projected/d42dee2f-72ba-4991-a954-3e716e2c1533-kube-api-access-76v9b\") pod \"kuadrant-operator-controller-manager-86878c769f-nmn9h\" (UID: \"d42dee2f-72ba-4991-a954-3e716e2c1533\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"
Jul 17 16:34:36.131180 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.131151    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db64618e-efe2-4dfc-9994-acc28d56b321-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "db64618e-efe2-4dfc-9994-acc28d56b321" (UID: "db64618e-efe2-4dfc-9994-acc28d56b321"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:34:36.132694 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.132674    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db64618e-efe2-4dfc-9994-acc28d56b321-kube-api-access-8tttp" (OuterVolumeSpecName: "kube-api-access-8tttp") pod "db64618e-efe2-4dfc-9994-acc28d56b321" (UID: "db64618e-efe2-4dfc-9994-acc28d56b321"). InnerVolumeSpecName "kube-api-access-8tttp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:34:36.232065 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.232030    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d42dee2f-72ba-4991-a954-3e716e2c1533-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nmn9h\" (UID: \"d42dee2f-72ba-4991-a954-3e716e2c1533\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"
Jul 17 16:34:36.232354 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.232074    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76v9b\" (UniqueName: \"kubernetes.io/projected/d42dee2f-72ba-4991-a954-3e716e2c1533-kube-api-access-76v9b\") pod \"kuadrant-operator-controller-manager-86878c769f-nmn9h\" (UID: \"d42dee2f-72ba-4991-a954-3e716e2c1533\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"
Jul 17 16:34:36.232354 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.232104    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db64618e-efe2-4dfc-9994-acc28d56b321-extensions-socket-volume\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:34:36.232354 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.232114    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tttp\" (UniqueName: \"kubernetes.io/projected/db64618e-efe2-4dfc-9994-acc28d56b321-kube-api-access-8tttp\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:34:36.232534 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.232415    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d42dee2f-72ba-4991-a954-3e716e2c1533-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nmn9h\" (UID: \"d42dee2f-72ba-4991-a954-3e716e2c1533\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"
Jul 17 16:34:36.257662 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.257632    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76v9b\" (UniqueName: \"kubernetes.io/projected/d42dee2f-72ba-4991-a954-3e716e2c1533-kube-api-access-76v9b\") pod \"kuadrant-operator-controller-manager-86878c769f-nmn9h\" (UID: \"d42dee2f-72ba-4991-a954-3e716e2c1533\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"
Jul 17 16:34:36.280335 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.280286    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"
Jul 17 16:34:36.415433 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.415409    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"]
Jul 17 16:34:36.418132 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:34:36.418103    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42dee2f_72ba_4991_a954_3e716e2c1533.slice/crio-a4909281d54c42e0a47b682aece97a1a93c7b1079335289bc4c9bf9938b23fe5 WatchSource:0}: Error finding container a4909281d54c42e0a47b682aece97a1a93c7b1079335289bc4c9bf9938b23fe5: Status 404 returned error can't find the container with id a4909281d54c42e0a47b682aece97a1a93c7b1079335289bc4c9bf9938b23fe5
Jul 17 16:34:36.459747 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.459720    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h" event={"ID":"d42dee2f-72ba-4991-a954-3e716e2c1533","Type":"ContainerStarted","Data":"a4909281d54c42e0a47b682aece97a1a93c7b1079335289bc4c9bf9938b23fe5"}
Jul 17 16:34:36.461018 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.460995    2566 generic.go:356] "Generic (PLEG): container finished" podID="db64618e-efe2-4dfc-9994-acc28d56b321" containerID="b5209a6f6686b2b618f635d64656ce4af822d6140cb5e127fc69436e0a40ba3d" exitCode=0
Jul 17 16:34:36.461115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.461036    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"
Jul 17 16:34:36.461115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.461037    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp" event={"ID":"db64618e-efe2-4dfc-9994-acc28d56b321","Type":"ContainerDied","Data":"b5209a6f6686b2b618f635d64656ce4af822d6140cb5e127fc69436e0a40ba3d"}
Jul 17 16:34:36.461115 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.461093    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp" event={"ID":"db64618e-efe2-4dfc-9994-acc28d56b321","Type":"ContainerDied","Data":"3492af55b7e2e216ee5b4ec707c62feef8b601c462ac3918c3e19572aa6c95ad"}
Jul 17 16:34:36.461239 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.461121    2566 scope.go:117] "RemoveContainer" containerID="b5209a6f6686b2b618f635d64656ce4af822d6140cb5e127fc69436e0a40ba3d"
Jul 17 16:34:36.471406 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.471388    2566 scope.go:117] "RemoveContainer" containerID="b5209a6f6686b2b618f635d64656ce4af822d6140cb5e127fc69436e0a40ba3d"
Jul 17 16:34:36.471652 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:34:36.471630    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5209a6f6686b2b618f635d64656ce4af822d6140cb5e127fc69436e0a40ba3d\": container with ID starting with b5209a6f6686b2b618f635d64656ce4af822d6140cb5e127fc69436e0a40ba3d not found: ID does not exist" containerID="b5209a6f6686b2b618f635d64656ce4af822d6140cb5e127fc69436e0a40ba3d"
Jul 17 16:34:36.471710 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.471662    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5209a6f6686b2b618f635d64656ce4af822d6140cb5e127fc69436e0a40ba3d"} err="failed to get container status \"b5209a6f6686b2b618f635d64656ce4af822d6140cb5e127fc69436e0a40ba3d\": rpc error: code = NotFound desc = could not find container \"b5209a6f6686b2b618f635d64656ce4af822d6140cb5e127fc69436e0a40ba3d\": container with ID starting with b5209a6f6686b2b618f635d64656ce4af822d6140cb5e127fc69436e0a40ba3d not found: ID does not exist"
Jul 17 16:34:36.487041 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.487019    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"]
Jul 17 16:34:36.488911 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:36.488891    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69tlp"]
Jul 17 16:34:37.032588 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:37.032556    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db64618e-efe2-4dfc-9994-acc28d56b321" path="/var/lib/kubelet/pods/db64618e-efe2-4dfc-9994-acc28d56b321/volumes"
Jul 17 16:34:37.467248 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:37.467169    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h" event={"ID":"d42dee2f-72ba-4991-a954-3e716e2c1533","Type":"ContainerStarted","Data":"983536a4c70dcaaea6e387d8a8f194be9afa341ad1d73db65ac8a2b4cdf78035"}
Jul 17 16:34:37.467428 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:37.467277    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"
Jul 17 16:34:37.491295 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:37.491246    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h" podStartSLOduration=2.491232889 podStartE2EDuration="2.491232889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:34:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:34:37.488843507 +0000 UTC m=+526.347972067" watchObservedRunningTime="2026-07-17 16:34:37.491232889 +0000 UTC m=+526.350361448"
Jul 17 16:34:48.475980 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:48.475904    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"
Jul 17 16:34:52.077527 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.077489    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"]
Jul 17 16:34:52.077898 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.077859    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db64618e-efe2-4dfc-9994-acc28d56b321" containerName="manager"
Jul 17 16:34:52.077898 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.077870    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="db64618e-efe2-4dfc-9994-acc28d56b321" containerName="manager"
Jul 17 16:34:52.077970 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.077937    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="db64618e-efe2-4dfc-9994-acc28d56b321" containerName="manager"
Jul 17 16:34:52.079729 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.079713    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.082094 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.082077    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tfpmj\""
Jul 17 16:34:52.091373 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.091352    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"]
Jul 17 16:34:52.155638 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.155610    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.155638 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.155640    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d72e7b3-283b-45d6-b427-d70193a9eefe-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.155801 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.155670    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d72e7b3-283b-45d6-b427-d70193a9eefe-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.155801 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.155695    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8cpl\" (UniqueName: \"kubernetes.io/projected/1d72e7b3-283b-45d6-b427-d70193a9eefe-kube-api-access-z8cpl\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.155801 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.155726    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.155801 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.155744    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.155801 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.155783    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.155984 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.155868    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.155984 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.155894    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d72e7b3-283b-45d6-b427-d70193a9eefe-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.256620 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.256591    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d72e7b3-283b-45d6-b427-d70193a9eefe-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.256776 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.256633    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.256776 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.256658    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d72e7b3-283b-45d6-b427-d70193a9eefe-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.256776 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.256705    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d72e7b3-283b-45d6-b427-d70193a9eefe-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.256776 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.256728    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8cpl\" (UniqueName: \"kubernetes.io/projected/1d72e7b3-283b-45d6-b427-d70193a9eefe-kube-api-access-z8cpl\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.256776 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.256757    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.257054 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.256780    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.257054 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.256876    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.257054 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.256964    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.257230 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.257063    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.257230 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.257186    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.257230 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.257216    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.257398 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.257378    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.257468 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.257451    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d72e7b3-283b-45d6-b427-d70193a9eefe-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.259135 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.259117    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d72e7b3-283b-45d6-b427-d70193a9eefe-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.259192 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.259170    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d72e7b3-283b-45d6-b427-d70193a9eefe-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.264960 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.264939    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d72e7b3-283b-45d6-b427-d70193a9eefe-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.266927 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.266906    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8cpl\" (UniqueName: \"kubernetes.io/projected/1d72e7b3-283b-45d6-b427-d70193a9eefe-kube-api-access-z8cpl\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nccbk\" (UID: \"1d72e7b3-283b-45d6-b427-d70193a9eefe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.391136 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.391067    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:52.529791 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.529768    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"]
Jul 17 16:34:52.531932 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:34:52.531906    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d72e7b3_283b_45d6_b427_d70193a9eefe.slice/crio-e1d3968351a342f89ae207387aa4deead0ba2feac7f9e068b858c27163f9cbb9 WatchSource:0}: Error finding container e1d3968351a342f89ae207387aa4deead0ba2feac7f9e068b858c27163f9cbb9: Status 404 returned error can't find the container with id e1d3968351a342f89ae207387aa4deead0ba2feac7f9e068b858c27163f9cbb9
Jul 17 16:34:52.534590 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.534554    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:34:52.534681 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.534635    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:34:52.534719 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.534677    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:34:52.540450 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:52.540426    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk" event={"ID":"1d72e7b3-283b-45d6-b427-d70193a9eefe","Type":"ContainerStarted","Data":"e1d3968351a342f89ae207387aa4deead0ba2feac7f9e068b858c27163f9cbb9"}
Jul 17 16:34:53.546587 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:53.546552    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk" event={"ID":"1d72e7b3-283b-45d6-b427-d70193a9eefe","Type":"ContainerStarted","Data":"6cab2d34b9ebda144805f570991280e43eedc5aceeebe434a174ae51fe8f982d"}
Jul 17 16:34:53.569682 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:53.569637    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk" podStartSLOduration=1.569624648 podStartE2EDuration="1.569624648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:34:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:34:53.567744216 +0000 UTC m=+542.426872800" watchObservedRunningTime="2026-07-17 16:34:53.569624648 +0000 UTC m=+542.428753206"
Jul 17 16:34:54.392217 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:54.392184    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:54.397114 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:54.397090    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:54.551466 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:54.551436    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:54.552337 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:54.552299    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:34:55.618006 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:55.617979    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-sgpdk"]
Jul 17 16:34:55.620976 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:55.620959    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sgpdk"
Jul 17 16:34:55.624412 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:55.623755    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5ldvq\""
Jul 17 16:34:55.626194 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:55.626172    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sgpdk"]
Jul 17 16:34:55.687933 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:55.687912    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4mqk\" (UniqueName: \"kubernetes.io/projected/25daa0bc-fe68-4ad1-adbe-5df873074a08-kube-api-access-p4mqk\") pod \"authorino-75d556bd77-sgpdk\" (UID: \"25daa0bc-fe68-4ad1-adbe-5df873074a08\") " pod="kuadrant-system/authorino-75d556bd77-sgpdk"
Jul 17 16:34:55.788932 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:55.788906    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4mqk\" (UniqueName: \"kubernetes.io/projected/25daa0bc-fe68-4ad1-adbe-5df873074a08-kube-api-access-p4mqk\") pod \"authorino-75d556bd77-sgpdk\" (UID: \"25daa0bc-fe68-4ad1-adbe-5df873074a08\") " pod="kuadrant-system/authorino-75d556bd77-sgpdk"
Jul 17 16:34:55.798596 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:55.798571    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4mqk\" (UniqueName: \"kubernetes.io/projected/25daa0bc-fe68-4ad1-adbe-5df873074a08-kube-api-access-p4mqk\") pod \"authorino-75d556bd77-sgpdk\" (UID: \"25daa0bc-fe68-4ad1-adbe-5df873074a08\") " pod="kuadrant-system/authorino-75d556bd77-sgpdk"
Jul 17 16:34:55.933189 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:55.933127    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sgpdk"
Jul 17 16:34:56.057158 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:56.057060    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sgpdk"]
Jul 17 16:34:56.562629 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:56.562596    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sgpdk" event={"ID":"25daa0bc-fe68-4ad1-adbe-5df873074a08","Type":"ContainerStarted","Data":"63247a777747762f640c94efacdafc40dcafa357f1dd1775393acfafe611a68c"}
Jul 17 16:34:59.578948 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:59.578914    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sgpdk" event={"ID":"25daa0bc-fe68-4ad1-adbe-5df873074a08","Type":"ContainerStarted","Data":"ad7367fa8ca8eec3e25abd4c4c5aed0b2efe055ef432fa9f6c4edf966196390d"}
Jul 17 16:34:59.597937 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:34:59.597892    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-sgpdk" podStartSLOduration=1.7314947840000001 podStartE2EDuration="4.597878209s" totalImagesPullingTime="2.866383425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:34:59.595418883 +0000 UTC m=+548.454547453" watchObservedRunningTime="2026-07-17 16:34:59.597878209 +0000 UTC m=+548.457006767"
Jul 17 16:35:28.754800 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:28.754767    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-679c6c6d8f-65r7n"]
Jul 17 16:35:28.759859 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:28.759839    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-679c6c6d8f-65r7n"
Jul 17 16:35:28.766346 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:28.766290    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-679c6c6d8f-65r7n"]
Jul 17 16:35:28.866354 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:28.866307    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhqrr\" (UniqueName: \"kubernetes.io/projected/016d28df-68fb-4261-9a16-471bf0a25e96-kube-api-access-hhqrr\") pod \"authorino-679c6c6d8f-65r7n\" (UID: \"016d28df-68fb-4261-9a16-471bf0a25e96\") " pod="kuadrant-system/authorino-679c6c6d8f-65r7n"
Jul 17 16:35:28.937029 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:28.937000    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-679c6c6d8f-65r7n"]
Jul 17 16:35:28.937250 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:35:28.937230    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hhqrr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-679c6c6d8f-65r7n" podUID="016d28df-68fb-4261-9a16-471bf0a25e96"
Jul 17 16:35:28.967458 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:28.967426    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqrr\" (UniqueName: \"kubernetes.io/projected/016d28df-68fb-4261-9a16-471bf0a25e96-kube-api-access-hhqrr\") pod \"authorino-679c6c6d8f-65r7n\" (UID: \"016d28df-68fb-4261-9a16-471bf0a25e96\") " pod="kuadrant-system/authorino-679c6c6d8f-65r7n"
Jul 17 16:35:28.980643 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:28.980613    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhqrr\" (UniqueName: \"kubernetes.io/projected/016d28df-68fb-4261-9a16-471bf0a25e96-kube-api-access-hhqrr\") pod \"authorino-679c6c6d8f-65r7n\" (UID: \"016d28df-68fb-4261-9a16-471bf0a25e96\") " pod="kuadrant-system/authorino-679c6c6d8f-65r7n"
Jul 17 16:35:29.718075 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:29.718038    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-679c6c6d8f-65r7n"
Jul 17 16:35:29.725253 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:29.725232    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-679c6c6d8f-65r7n"
Jul 17 16:35:29.876383 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:29.876353    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhqrr\" (UniqueName: \"kubernetes.io/projected/016d28df-68fb-4261-9a16-471bf0a25e96-kube-api-access-hhqrr\") pod \"016d28df-68fb-4261-9a16-471bf0a25e96\" (UID: \"016d28df-68fb-4261-9a16-471bf0a25e96\") "
Jul 17 16:35:29.878445 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:29.878418    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016d28df-68fb-4261-9a16-471bf0a25e96-kube-api-access-hhqrr" (OuterVolumeSpecName: "kube-api-access-hhqrr") pod "016d28df-68fb-4261-9a16-471bf0a25e96" (UID: "016d28df-68fb-4261-9a16-471bf0a25e96"). InnerVolumeSpecName "kube-api-access-hhqrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:35:29.976966 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:29.976910    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhqrr\" (UniqueName: \"kubernetes.io/projected/016d28df-68fb-4261-9a16-471bf0a25e96-kube-api-access-hhqrr\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:35:30.042692 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.042659    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sgpdk"]
Jul 17 16:35:30.042869 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.042847    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-sgpdk" podUID="25daa0bc-fe68-4ad1-adbe-5df873074a08" containerName="authorino" containerID="cri-o://ad7367fa8ca8eec3e25abd4c4c5aed0b2efe055ef432fa9f6c4edf966196390d" gracePeriod=30
Jul 17 16:35:30.297413 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.297383    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sgpdk"
Jul 17 16:35:30.482921 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.482886    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4mqk\" (UniqueName: \"kubernetes.io/projected/25daa0bc-fe68-4ad1-adbe-5df873074a08-kube-api-access-p4mqk\") pod \"25daa0bc-fe68-4ad1-adbe-5df873074a08\" (UID: \"25daa0bc-fe68-4ad1-adbe-5df873074a08\") "
Jul 17 16:35:30.484888 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.484859    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25daa0bc-fe68-4ad1-adbe-5df873074a08-kube-api-access-p4mqk" (OuterVolumeSpecName: "kube-api-access-p4mqk") pod "25daa0bc-fe68-4ad1-adbe-5df873074a08" (UID: "25daa0bc-fe68-4ad1-adbe-5df873074a08"). InnerVolumeSpecName "kube-api-access-p4mqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:35:30.584452 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.584429    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4mqk\" (UniqueName: \"kubernetes.io/projected/25daa0bc-fe68-4ad1-adbe-5df873074a08-kube-api-access-p4mqk\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:35:30.724007 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.723973    2566 generic.go:356] "Generic (PLEG): container finished" podID="25daa0bc-fe68-4ad1-adbe-5df873074a08" containerID="ad7367fa8ca8eec3e25abd4c4c5aed0b2efe055ef432fa9f6c4edf966196390d" exitCode=0
Jul 17 16:35:30.724172 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.724014    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sgpdk"
Jul 17 16:35:30.724172 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.724060    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sgpdk" event={"ID":"25daa0bc-fe68-4ad1-adbe-5df873074a08","Type":"ContainerDied","Data":"ad7367fa8ca8eec3e25abd4c4c5aed0b2efe055ef432fa9f6c4edf966196390d"}
Jul 17 16:35:30.724172 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.724093    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sgpdk" event={"ID":"25daa0bc-fe68-4ad1-adbe-5df873074a08","Type":"ContainerDied","Data":"63247a777747762f640c94efacdafc40dcafa357f1dd1775393acfafe611a68c"}
Jul 17 16:35:30.724172 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.724116    2566 scope.go:117] "RemoveContainer" containerID="ad7367fa8ca8eec3e25abd4c4c5aed0b2efe055ef432fa9f6c4edf966196390d"
Jul 17 16:35:30.724409 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.724240    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-679c6c6d8f-65r7n"
Jul 17 16:35:30.733931 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.733915    2566 scope.go:117] "RemoveContainer" containerID="ad7367fa8ca8eec3e25abd4c4c5aed0b2efe055ef432fa9f6c4edf966196390d"
Jul 17 16:35:30.734206 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:35:30.734188    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad7367fa8ca8eec3e25abd4c4c5aed0b2efe055ef432fa9f6c4edf966196390d\": container with ID starting with ad7367fa8ca8eec3e25abd4c4c5aed0b2efe055ef432fa9f6c4edf966196390d not found: ID does not exist" containerID="ad7367fa8ca8eec3e25abd4c4c5aed0b2efe055ef432fa9f6c4edf966196390d"
Jul 17 16:35:30.734255 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.734215    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad7367fa8ca8eec3e25abd4c4c5aed0b2efe055ef432fa9f6c4edf966196390d"} err="failed to get container status \"ad7367fa8ca8eec3e25abd4c4c5aed0b2efe055ef432fa9f6c4edf966196390d\": rpc error: code = NotFound desc = could not find container \"ad7367fa8ca8eec3e25abd4c4c5aed0b2efe055ef432fa9f6c4edf966196390d\": container with ID starting with ad7367fa8ca8eec3e25abd4c4c5aed0b2efe055ef432fa9f6c4edf966196390d not found: ID does not exist"
Jul 17 16:35:30.758757 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.758730    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-679c6c6d8f-65r7n"]
Jul 17 16:35:30.762793 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.762773    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-679c6c6d8f-65r7n"]
Jul 17 16:35:30.782912 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.782889    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sgpdk"]
Jul 17 16:35:30.789559 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:30.789539    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sgpdk"]
Jul 17 16:35:31.032140 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:31.032102    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="016d28df-68fb-4261-9a16-471bf0a25e96" path="/var/lib/kubelet/pods/016d28df-68fb-4261-9a16-471bf0a25e96/volumes"
Jul 17 16:35:31.032549 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:31.032347    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25daa0bc-fe68-4ad1-adbe-5df873074a08" path="/var/lib/kubelet/pods/25daa0bc-fe68-4ad1-adbe-5df873074a08/volumes"
Jul 17 16:35:52.844900 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:52.844872    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:35:52.845445 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:35:52.845078    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:36:18.954630 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:18.954596    2566 generic.go:356] "Generic (PLEG): container finished" podID="1d72e7b3-283b-45d6-b427-d70193a9eefe" containerID="6cab2d34b9ebda144805f570991280e43eedc5aceeebe434a174ae51fe8f982d" exitCode=0
Jul 17 16:36:18.955030 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:18.954645    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk" event={"ID":"1d72e7b3-283b-45d6-b427-d70193a9eefe","Type":"ContainerDied","Data":"6cab2d34b9ebda144805f570991280e43eedc5aceeebe434a174ae51fe8f982d"}
Jul 17 16:36:18.955030 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:18.954988    2566 scope.go:117] "RemoveContainer" containerID="6cab2d34b9ebda144805f570991280e43eedc5aceeebe434a174ae51fe8f982d"
Jul 17 16:36:18.955930 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:18.955903    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:36:18.955978 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:18.955970    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:36:18.956016 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:18.956004    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:36:19.960843 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:19.960809    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk" event={"ID":"1d72e7b3-283b-45d6-b427-d70193a9eefe","Type":"ContainerStarted","Data":"24c8f48e96163e5c43565159ad61fb1ec8e78607fcb9f358e2e1bff49cd8255e"}
Jul 17 16:36:20.391800 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:20.391761    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:36:20.392592 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:20.392568    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-nccbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 17 16:36:20.392666 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:20.392624    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk" podUID="1d72e7b3-283b-45d6-b427-d70193a9eefe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 17 16:36:21.392033 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:21.392001    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-nccbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 17 16:36:21.392416 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:21.392053    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk" podUID="1d72e7b3-283b-45d6-b427-d70193a9eefe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 17 16:36:22.391608 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:22.391570    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-nccbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 17 16:36:22.391796 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:22.391627    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk" podUID="1d72e7b3-283b-45d6-b427-d70193a9eefe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 17 16:36:23.391665 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:23.391632    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-nccbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 17 16:36:23.392016 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:23.391682    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk" podUID="1d72e7b3-283b-45d6-b427-d70193a9eefe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 17 16:36:24.395291 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:24.395259    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:36:24.395760 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:24.395544    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:36:24.396239 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:24.396222    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nccbk"
Jul 17 16:36:40.396394 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.396338    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"]
Jul 17 16:36:40.396855 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.396745    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25daa0bc-fe68-4ad1-adbe-5df873074a08" containerName="authorino"
Jul 17 16:36:40.396855 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.396756    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="25daa0bc-fe68-4ad1-adbe-5df873074a08" containerName="authorino"
Jul 17 16:36:40.396855 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.396827    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="25daa0bc-fe68-4ad1-adbe-5df873074a08" containerName="authorino"
Jul 17 16:36:40.398973 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.398951    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.402656 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.402626    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 16:36:40.402807 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.402657    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jpw69\""
Jul 17 16:36:40.402807 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.402676    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 16:36:40.402807 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.402641    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 17 16:36:40.414639 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.414618    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"]
Jul 17 16:36:40.561717 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.561682    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/415e7a42-3e01-4326-b9d0-4209f6f0a55b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.561894 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.561745    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9gc8\" (UniqueName: \"kubernetes.io/projected/415e7a42-3e01-4326-b9d0-4209f6f0a55b-kube-api-access-d9gc8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.561894 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.561778    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/415e7a42-3e01-4326-b9d0-4209f6f0a55b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.561894 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.561799    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/415e7a42-3e01-4326-b9d0-4209f6f0a55b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.561894 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.561817    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/415e7a42-3e01-4326-b9d0-4209f6f0a55b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.562045 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.561941    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/415e7a42-3e01-4326-b9d0-4209f6f0a55b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.662791 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.662711    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9gc8\" (UniqueName: \"kubernetes.io/projected/415e7a42-3e01-4326-b9d0-4209f6f0a55b-kube-api-access-d9gc8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.662791 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.662751    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/415e7a42-3e01-4326-b9d0-4209f6f0a55b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.662791 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.662772    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/415e7a42-3e01-4326-b9d0-4209f6f0a55b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.662791 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.662789    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/415e7a42-3e01-4326-b9d0-4209f6f0a55b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.663129 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.662823    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/415e7a42-3e01-4326-b9d0-4209f6f0a55b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.663129 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.662863    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/415e7a42-3e01-4326-b9d0-4209f6f0a55b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.663267 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.663244    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/415e7a42-3e01-4326-b9d0-4209f6f0a55b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.663354 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.663254    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/415e7a42-3e01-4326-b9d0-4209f6f0a55b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.663428 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.663392    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/415e7a42-3e01-4326-b9d0-4209f6f0a55b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.665225 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.665205    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/415e7a42-3e01-4326-b9d0-4209f6f0a55b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.665441 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.665423    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/415e7a42-3e01-4326-b9d0-4209f6f0a55b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.672292 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.672266    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9gc8\" (UniqueName: \"kubernetes.io/projected/415e7a42-3e01-4326-b9d0-4209f6f0a55b-kube-api-access-d9gc8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6x6x2\" (UID: \"415e7a42-3e01-4326-b9d0-4209f6f0a55b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.710296 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.710267    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:40.843742 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.843713    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"]
Jul 17 16:36:40.845579 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:36:40.845549    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415e7a42_3e01_4326_b9d0_4209f6f0a55b.slice/crio-b8fcad4071985a1b3ce11fb8112b8b61a7f03b501c7c8543bbe94edf538f1b7d WatchSource:0}: Error finding container b8fcad4071985a1b3ce11fb8112b8b61a7f03b501c7c8543bbe94edf538f1b7d: Status 404 returned error can't find the container with id b8fcad4071985a1b3ce11fb8112b8b61a7f03b501c7c8543bbe94edf538f1b7d
Jul 17 16:36:40.847022 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:40.847002    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 16:36:41.068271 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:41.068225    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2" event={"ID":"415e7a42-3e01-4326-b9d0-4209f6f0a55b","Type":"ContainerStarted","Data":"b8fcad4071985a1b3ce11fb8112b8b61a7f03b501c7c8543bbe94edf538f1b7d"}
Jul 17 16:36:42.074698 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:42.074659    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2" event={"ID":"415e7a42-3e01-4326-b9d0-4209f6f0a55b","Type":"ContainerStarted","Data":"cd1e14ddc04ad912d2aef7aa39d5fa33bd5144905566002a6ac394453d26f397"}
Jul 17 16:36:42.094179 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:42.094128    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2" podStartSLOduration=1.089927065 podStartE2EDuration="2.094112943s" totalImagesPullingTime="1.004185878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:36:42.092722644 +0000 UTC m=+650.951851218" watchObservedRunningTime="2026-07-17 16:36:42.094112943 +0000 UTC m=+650.953241502"
Jul 17 16:36:50.710725 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:50.710689    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:50.711229 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:50.710754    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:50.723184 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:50.723159    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:51.127455 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.127423    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6x6x2"
Jul 17 16:36:51.297990 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.297963    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"]
Jul 17 16:36:51.301414 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.301392    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.303599 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.303581    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 17 16:36:51.310870 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.310850    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"]
Jul 17 16:36:51.350800 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.350771    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58ec5999-e7d4-4fb7-9836-094369e4937d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.350934 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.350806    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58ec5999-e7d4-4fb7-9836-094369e4937d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.350934 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.350836    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58ec5999-e7d4-4fb7-9836-094369e4937d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.350934 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.350909    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58ec5999-e7d4-4fb7-9836-094369e4937d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.351080 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.350992    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4srbp\" (UniqueName: \"kubernetes.io/projected/58ec5999-e7d4-4fb7-9836-094369e4937d-kube-api-access-4srbp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.351080 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.351041    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58ec5999-e7d4-4fb7-9836-094369e4937d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.452542 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.452442    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58ec5999-e7d4-4fb7-9836-094369e4937d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.452542 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.452500    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58ec5999-e7d4-4fb7-9836-094369e4937d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.452765 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.452549    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58ec5999-e7d4-4fb7-9836-094369e4937d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.452765 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.452578    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58ec5999-e7d4-4fb7-9836-094369e4937d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.452765 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.452629    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4srbp\" (UniqueName: \"kubernetes.io/projected/58ec5999-e7d4-4fb7-9836-094369e4937d-kube-api-access-4srbp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.452765 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.452661    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58ec5999-e7d4-4fb7-9836-094369e4937d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.453036 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.452950    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58ec5999-e7d4-4fb7-9836-094369e4937d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.453308 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.453282    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58ec5999-e7d4-4fb7-9836-094369e4937d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.453436 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.453386    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58ec5999-e7d4-4fb7-9836-094369e4937d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.454965 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.454939    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58ec5999-e7d4-4fb7-9836-094369e4937d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.455421 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.455400    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58ec5999-e7d4-4fb7-9836-094369e4937d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.461437 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.461413    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4srbp\" (UniqueName: \"kubernetes.io/projected/58ec5999-e7d4-4fb7-9836-094369e4937d-kube-api-access-4srbp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-k7rqr\" (UID: \"58ec5999-e7d4-4fb7-9836-094369e4937d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.612454 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.612418    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:36:51.743386 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:51.743358    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"]
Jul 17 16:36:51.745573 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:36:51.745544    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ec5999_e7d4_4fb7_9836_094369e4937d.slice/crio-bfb2af88a6d1bdb2d2b2ef48650fbdfc29ff468349a026d59a5fb7501ece7f92 WatchSource:0}: Error finding container bfb2af88a6d1bdb2d2b2ef48650fbdfc29ff468349a026d59a5fb7501ece7f92: Status 404 returned error can't find the container with id bfb2af88a6d1bdb2d2b2ef48650fbdfc29ff468349a026d59a5fb7501ece7f92
Jul 17 16:36:52.122683 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:52.122649    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr" event={"ID":"58ec5999-e7d4-4fb7-9836-094369e4937d","Type":"ContainerStarted","Data":"844ab1c98e7100864ce28790953d786a3236ee21106e0fe762672f8cf187b01d"}
Jul 17 16:36:52.122844 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:52.122699    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr" event={"ID":"58ec5999-e7d4-4fb7-9836-094369e4937d","Type":"ContainerStarted","Data":"bfb2af88a6d1bdb2d2b2ef48650fbdfc29ff468349a026d59a5fb7501ece7f92"}
Jul 17 16:36:52.146056 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:36:52.146007    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr" podStartSLOduration=0.921788641 podStartE2EDuration="1.14599253s" totalImagesPullingTime="224.203889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:36:52.1435432 +0000 UTC m=+661.002671794" watchObservedRunningTime="2026-07-17 16:36:52.14599253 +0000 UTC m=+661.005121088"
Jul 17 16:37:01.613197 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:37:01.613159    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:37:01.613714 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:37:01.613254    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:37:01.625760 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:37:01.625729    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:37:02.182897 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:37:02.182867    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-k7rqr"
Jul 17 16:38:41.818881 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:41.818846    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5488795fc6-2n9z4"]
Jul 17 16:38:41.822430 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:41.822404    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5488795fc6-2n9z4"
Jul 17 16:38:41.825281 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:41.825251    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5ldvq\""
Jul 17 16:38:41.825281 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:41.825251    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 17 16:38:41.830208 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:41.829941    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5488795fc6-2n9z4"]
Jul 17 16:38:41.885113 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:41.885087    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/413ce04c-b00c-4b02-9d9f-db66279ad755-tls-cert\") pod \"authorino-5488795fc6-2n9z4\" (UID: \"413ce04c-b00c-4b02-9d9f-db66279ad755\") " pod="kuadrant-system/authorino-5488795fc6-2n9z4"
Jul 17 16:38:41.885239 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:41.885127    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvvbv\" (UniqueName: \"kubernetes.io/projected/413ce04c-b00c-4b02-9d9f-db66279ad755-kube-api-access-hvvbv\") pod \"authorino-5488795fc6-2n9z4\" (UID: \"413ce04c-b00c-4b02-9d9f-db66279ad755\") " pod="kuadrant-system/authorino-5488795fc6-2n9z4"
Jul 17 16:38:41.986257 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:41.986229    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/413ce04c-b00c-4b02-9d9f-db66279ad755-tls-cert\") pod \"authorino-5488795fc6-2n9z4\" (UID: \"413ce04c-b00c-4b02-9d9f-db66279ad755\") " pod="kuadrant-system/authorino-5488795fc6-2n9z4"
Jul 17 16:38:41.986429 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:41.986267    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvvbv\" (UniqueName: \"kubernetes.io/projected/413ce04c-b00c-4b02-9d9f-db66279ad755-kube-api-access-hvvbv\") pod \"authorino-5488795fc6-2n9z4\" (UID: \"413ce04c-b00c-4b02-9d9f-db66279ad755\") " pod="kuadrant-system/authorino-5488795fc6-2n9z4"
Jul 17 16:38:41.988628 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:41.988607    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/413ce04c-b00c-4b02-9d9f-db66279ad755-tls-cert\") pod \"authorino-5488795fc6-2n9z4\" (UID: \"413ce04c-b00c-4b02-9d9f-db66279ad755\") " pod="kuadrant-system/authorino-5488795fc6-2n9z4"
Jul 17 16:38:41.994125 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:41.994102    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvvbv\" (UniqueName: \"kubernetes.io/projected/413ce04c-b00c-4b02-9d9f-db66279ad755-kube-api-access-hvvbv\") pod \"authorino-5488795fc6-2n9z4\" (UID: \"413ce04c-b00c-4b02-9d9f-db66279ad755\") " pod="kuadrant-system/authorino-5488795fc6-2n9z4"
Jul 17 16:38:42.132921 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:42.132832    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5488795fc6-2n9z4"
Jul 17 16:38:42.265520 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:42.265491    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5488795fc6-2n9z4"]
Jul 17 16:38:42.268155 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:38:42.268128    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod413ce04c_b00c_4b02_9d9f_db66279ad755.slice/crio-d1b57d46705a46e079dc7cf6d1fe2637c29d3a75187e4ad866293a5fdfc772ec WatchSource:0}: Error finding container d1b57d46705a46e079dc7cf6d1fe2637c29d3a75187e4ad866293a5fdfc772ec: Status 404 returned error can't find the container with id d1b57d46705a46e079dc7cf6d1fe2637c29d3a75187e4ad866293a5fdfc772ec
Jul 17 16:38:42.659399 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:42.659353    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5488795fc6-2n9z4" event={"ID":"413ce04c-b00c-4b02-9d9f-db66279ad755","Type":"ContainerStarted","Data":"d1b57d46705a46e079dc7cf6d1fe2637c29d3a75187e4ad866293a5fdfc772ec"}
Jul 17 16:38:43.671978 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:43.671934    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5488795fc6-2n9z4" event={"ID":"413ce04c-b00c-4b02-9d9f-db66279ad755","Type":"ContainerStarted","Data":"ed331fde3f32e05dcd28a86de5e700098cd74878e7edd662b66ca66f9c3e7015"}
Jul 17 16:38:43.690378 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:38:43.690288    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5488795fc6-2n9z4" podStartSLOduration=2.260917784 podStartE2EDuration="2.690270993s" totalImagesPullingTime="429.353209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:38:43.689526267 +0000 UTC m=+772.548654827" watchObservedRunningTime="2026-07-17 16:38:43.690270993 +0000 UTC m=+772.549399553"
Jul 17 16:40:52.875754 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:40:52.875679    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:40:52.875754 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:40:52.875727    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:45:36.288138 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:36.288106    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"]
Jul 17 16:45:36.288659 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:36.288345    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h" podUID="d42dee2f-72ba-4991-a954-3e716e2c1533" containerName="manager" containerID="cri-o://983536a4c70dcaaea6e387d8a8f194be9afa341ad1d73db65ac8a2b4cdf78035" gracePeriod=10
Jul 17 16:45:39.437136 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.437111    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"
Jul 17 16:45:39.499593 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.499509    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76v9b\" (UniqueName: \"kubernetes.io/projected/d42dee2f-72ba-4991-a954-3e716e2c1533-kube-api-access-76v9b\") pod \"d42dee2f-72ba-4991-a954-3e716e2c1533\" (UID: \"d42dee2f-72ba-4991-a954-3e716e2c1533\") "
Jul 17 16:45:39.499745 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.499632    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d42dee2f-72ba-4991-a954-3e716e2c1533-extensions-socket-volume\") pod \"d42dee2f-72ba-4991-a954-3e716e2c1533\" (UID: \"d42dee2f-72ba-4991-a954-3e716e2c1533\") "
Jul 17 16:45:39.500070 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.500041    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d42dee2f-72ba-4991-a954-3e716e2c1533-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d42dee2f-72ba-4991-a954-3e716e2c1533" (UID: "d42dee2f-72ba-4991-a954-3e716e2c1533"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:45:39.501919 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.501893    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42dee2f-72ba-4991-a954-3e716e2c1533-kube-api-access-76v9b" (OuterVolumeSpecName: "kube-api-access-76v9b") pod "d42dee2f-72ba-4991-a954-3e716e2c1533" (UID: "d42dee2f-72ba-4991-a954-3e716e2c1533"). InnerVolumeSpecName "kube-api-access-76v9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:45:39.600532 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.600496    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d42dee2f-72ba-4991-a954-3e716e2c1533-extensions-socket-volume\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:45:39.600532 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.600526    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76v9b\" (UniqueName: \"kubernetes.io/projected/d42dee2f-72ba-4991-a954-3e716e2c1533-kube-api-access-76v9b\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 16:45:39.766529 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.766438    2566 generic.go:356] "Generic (PLEG): container finished" podID="d42dee2f-72ba-4991-a954-3e716e2c1533" containerID="983536a4c70dcaaea6e387d8a8f194be9afa341ad1d73db65ac8a2b4cdf78035" exitCode=0
Jul 17 16:45:39.766529 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.766488    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"
Jul 17 16:45:39.766529 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.766503    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h" event={"ID":"d42dee2f-72ba-4991-a954-3e716e2c1533","Type":"ContainerDied","Data":"983536a4c70dcaaea6e387d8a8f194be9afa341ad1d73db65ac8a2b4cdf78035"}
Jul 17 16:45:39.766779 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.766555    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h" event={"ID":"d42dee2f-72ba-4991-a954-3e716e2c1533","Type":"ContainerDied","Data":"a4909281d54c42e0a47b682aece97a1a93c7b1079335289bc4c9bf9938b23fe5"}
Jul 17 16:45:39.766779 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.766587    2566 scope.go:117] "RemoveContainer" containerID="983536a4c70dcaaea6e387d8a8f194be9afa341ad1d73db65ac8a2b4cdf78035"
Jul 17 16:45:39.776518 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.776500    2566 scope.go:117] "RemoveContainer" containerID="983536a4c70dcaaea6e387d8a8f194be9afa341ad1d73db65ac8a2b4cdf78035"
Jul 17 16:45:39.776787 ip-10-0-130-95 kubenswrapper[2566]: E0717 16:45:39.776764    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"983536a4c70dcaaea6e387d8a8f194be9afa341ad1d73db65ac8a2b4cdf78035\": container with ID starting with 983536a4c70dcaaea6e387d8a8f194be9afa341ad1d73db65ac8a2b4cdf78035 not found: ID does not exist" containerID="983536a4c70dcaaea6e387d8a8f194be9afa341ad1d73db65ac8a2b4cdf78035"
Jul 17 16:45:39.776862 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.776801    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"983536a4c70dcaaea6e387d8a8f194be9afa341ad1d73db65ac8a2b4cdf78035"} err="failed to get container status \"983536a4c70dcaaea6e387d8a8f194be9afa341ad1d73db65ac8a2b4cdf78035\": rpc error: code = NotFound desc = could not find container \"983536a4c70dcaaea6e387d8a8f194be9afa341ad1d73db65ac8a2b4cdf78035\": container with ID starting with 983536a4c70dcaaea6e387d8a8f194be9afa341ad1d73db65ac8a2b4cdf78035 not found: ID does not exist"
Jul 17 16:45:39.788024 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.787993    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"]
Jul 17 16:45:39.792197 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:39.792173    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nmn9h"]
Jul 17 16:45:41.032133 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:41.032097    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d42dee2f-72ba-4991-a954-3e716e2c1533" path="/var/lib/kubelet/pods/d42dee2f-72ba-4991-a954-3e716e2c1533/volumes"
Jul 17 16:45:52.911216 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:52.911182    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:45:52.912250 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:45:52.912229    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:46:37.443447 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.443410    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6"]
Jul 17 16:46:37.445646 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.443780    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d42dee2f-72ba-4991-a954-3e716e2c1533" containerName="manager"
Jul 17 16:46:37.445646 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.443790    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d42dee2f-72ba-4991-a954-3e716e2c1533" containerName="manager"
Jul 17 16:46:37.445646 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.443851    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d42dee2f-72ba-4991-a954-3e716e2c1533" containerName="manager"
Jul 17 16:46:37.446753 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.446737    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6"
Jul 17 16:46:37.449478 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.449457    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-st7cb\""
Jul 17 16:46:37.462794 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.462768    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6"]
Jul 17 16:46:37.519133 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.519099    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96778d09-76db-49ca-adcf-9a37fe3c9e05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nwfl6\" (UID: \"96778d09-76db-49ca-adcf-9a37fe3c9e05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6"
Jul 17 16:46:37.519278 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.519152    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcvl2\" (UniqueName: \"kubernetes.io/projected/96778d09-76db-49ca-adcf-9a37fe3c9e05-kube-api-access-bcvl2\") pod \"kuadrant-operator-controller-manager-86878c769f-nwfl6\" (UID: \"96778d09-76db-49ca-adcf-9a37fe3c9e05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6"
Jul 17 16:46:37.619752 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.619719    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcvl2\" (UniqueName: \"kubernetes.io/projected/96778d09-76db-49ca-adcf-9a37fe3c9e05-kube-api-access-bcvl2\") pod \"kuadrant-operator-controller-manager-86878c769f-nwfl6\" (UID: \"96778d09-76db-49ca-adcf-9a37fe3c9e05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6"
Jul 17 16:46:37.619915 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.619815    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96778d09-76db-49ca-adcf-9a37fe3c9e05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nwfl6\" (UID: \"96778d09-76db-49ca-adcf-9a37fe3c9e05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6"
Jul 17 16:46:37.620163 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.620143    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96778d09-76db-49ca-adcf-9a37fe3c9e05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nwfl6\" (UID: \"96778d09-76db-49ca-adcf-9a37fe3c9e05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6"
Jul 17 16:46:37.630199 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.630178    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcvl2\" (UniqueName: \"kubernetes.io/projected/96778d09-76db-49ca-adcf-9a37fe3c9e05-kube-api-access-bcvl2\") pod \"kuadrant-operator-controller-manager-86878c769f-nwfl6\" (UID: \"96778d09-76db-49ca-adcf-9a37fe3c9e05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6"
Jul 17 16:46:37.757181 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.757102    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6"
Jul 17 16:46:37.907824 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:37.907801    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6"]
Jul 17 16:46:37.910565 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:46:37.910533    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96778d09_76db_49ca_adcf_9a37fe3c9e05.slice/crio-f5133a5f30903c45e98828a4ccafebdaa68b9e7833e10cfa149e42c940a9449d WatchSource:0}: Error finding container f5133a5f30903c45e98828a4ccafebdaa68b9e7833e10cfa149e42c940a9449d: Status 404 returned error can't find the container with id f5133a5f30903c45e98828a4ccafebdaa68b9e7833e10cfa149e42c940a9449d
Jul 17 16:46:38.056658 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:38.056631    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6" event={"ID":"96778d09-76db-49ca-adcf-9a37fe3c9e05","Type":"ContainerStarted","Data":"966813f3c1ce4213a08ca6f94f5eeb2c081033d1758d3a22a1d420b99dcc5218"}
Jul 17 16:46:38.056805 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:38.056682    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6" event={"ID":"96778d09-76db-49ca-adcf-9a37fe3c9e05","Type":"ContainerStarted","Data":"f5133a5f30903c45e98828a4ccafebdaa68b9e7833e10cfa149e42c940a9449d"}
Jul 17 16:46:38.056805 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:38.056706    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6"
Jul 17 16:46:38.083829 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:38.083786    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6" podStartSLOduration=1.083771726 podStartE2EDuration="1.083771726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:46:38.081965014 +0000 UTC m=+1246.941093573" watchObservedRunningTime="2026-07-17 16:46:38.083771726 +0000 UTC m=+1246.942900283"
Jul 17 16:46:49.063877 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:46:49.063800    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nwfl6"
Jul 17 16:50:52.952871 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:50:52.952839    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:50:52.953587 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:50:52.953568    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:52:56.182860 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.181776    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"]
Jul 17 16:52:56.185153 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.185129    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.187872 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.187851    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8c607776-openshift-default-dockercfg-tn558\""
Jul 17 16:52:56.211233 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.211210    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"]
Jul 17 16:52:56.253997 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.253961    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-podinfo\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.254158 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.254013    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-envoy\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.254158 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.254038    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/880fb2f2-ab80-44a3-b139-296de7a93a14-istiod-ca-cert\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.254158 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.254091    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-workload-socket\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.254271 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.254157    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-data\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.254271 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.254202    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-token\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.254271 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.254232    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-workload-certs\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.254271 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.254264    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwfjt\" (UniqueName: \"kubernetes.io/projected/880fb2f2-ab80-44a3-b139-296de7a93a14-kube-api-access-dwfjt\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.254484 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.254288    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-credential-socket\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.355413 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.355374    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-token\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.355413 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.355418    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-workload-certs\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.355637 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.355449    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwfjt\" (UniqueName: \"kubernetes.io/projected/880fb2f2-ab80-44a3-b139-296de7a93a14-kube-api-access-dwfjt\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.355637 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.355466    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-credential-socket\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.355637 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.355484    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-podinfo\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.355637 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.355521    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-envoy\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.355637 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.355605    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/880fb2f2-ab80-44a3-b139-296de7a93a14-istiod-ca-cert\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.355914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.355691    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-workload-socket\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.355914 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.355734    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-data\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.356030 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.355962    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-workload-certs\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.356030 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.355979    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-credential-socket\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.356125 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.356061    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-workload-socket\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.356125 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.356094    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-data\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.356421 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.356404    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/880fb2f2-ab80-44a3-b139-296de7a93a14-istiod-ca-cert\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.357578 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.357560    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-envoy\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.357961 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.357942    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-podinfo\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.364442 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.364415    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-token\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.364564 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.364547    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwfjt\" (UniqueName: \"kubernetes.io/projected/880fb2f2-ab80-44a3-b139-296de7a93a14-kube-api-access-dwfjt\") pod \"e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") " pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.495343 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.495259    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:56.633957 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.633926    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"]
Jul 17 16:52:56.635542 ip-10-0-130-95 kubenswrapper[2566]: W0717 16:52:56.635514    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod880fb2f2_ab80_44a3_b139_296de7a93a14.slice/crio-0a2c9d1ea1c140208762746f6f2c98ee9641c528db4aab71edb38ead2a8e4806 WatchSource:0}: Error finding container 0a2c9d1ea1c140208762746f6f2c98ee9641c528db4aab71edb38ead2a8e4806: Status 404 returned error can't find the container with id 0a2c9d1ea1c140208762746f6f2c98ee9641c528db4aab71edb38ead2a8e4806
Jul 17 16:52:56.637503 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.637474    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:52:56.637611 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.637533    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:52:56.637611 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.637571    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:52:56.969565 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.969528    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs" event={"ID":"880fb2f2-ab80-44a3-b139-296de7a93a14","Type":"ContainerStarted","Data":"7043983cb5e1cb91c20325fe0d8a81cfb745c9ad9eef99c95e54dfd112adf78b"}
Jul 17 16:52:56.969747 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.969582    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs" event={"ID":"880fb2f2-ab80-44a3-b139-296de7a93a14","Type":"ContainerStarted","Data":"0a2c9d1ea1c140208762746f6f2c98ee9641c528db4aab71edb38ead2a8e4806"}
Jul 17 16:52:56.991939 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:56.991878    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs" podStartSLOduration=0.991857182 podStartE2EDuration="991.857182ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:52:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:52:56.990840014 +0000 UTC m=+1625.849968572" watchObservedRunningTime="2026-07-17 16:52:56.991857182 +0000 UTC m=+1625.850985740"
Jul 17 16:52:57.495639 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:57.495606    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:57.501428 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:57.501382    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:57.976758 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:57.976724    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:52:57.977679 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:52:57.977656    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:53:10.047732 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:10.047696    2566 generic.go:356] "Generic (PLEG): container finished" podID="880fb2f2-ab80-44a3-b139-296de7a93a14" containerID="7043983cb5e1cb91c20325fe0d8a81cfb745c9ad9eef99c95e54dfd112adf78b" exitCode=0
Jul 17 16:53:10.048146 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:10.047769    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs" event={"ID":"880fb2f2-ab80-44a3-b139-296de7a93a14","Type":"ContainerDied","Data":"7043983cb5e1cb91c20325fe0d8a81cfb745c9ad9eef99c95e54dfd112adf78b"}
Jul 17 16:53:10.048187 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:10.048153    2566 scope.go:117] "RemoveContainer" containerID="7043983cb5e1cb91c20325fe0d8a81cfb745c9ad9eef99c95e54dfd112adf78b"
Jul 17 16:53:10.049191 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:10.049166    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:53:10.049275 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:10.049231    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:53:10.049275 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:10.049268    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 16:53:11.054065 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:11.054036    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs" event={"ID":"880fb2f2-ab80-44a3-b139-296de7a93a14","Type":"ContainerStarted","Data":"00f6bc622bee1fde5058cf01579d73c47cf669fac2e92df041ca2f7b2c44f4c2"}
Jul 17 16:53:11.496457 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:11.496374    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:53:11.497426 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:11.497403    2566 patch_prober.go:28] interesting pod/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 17 16:53:11.497524 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:11.497459    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs" podUID="880fb2f2-ab80-44a3-b139-296de7a93a14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 17 16:53:12.495773 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:12.495722    2566 patch_prober.go:28] interesting pod/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 17 16:53:12.496158 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:12.495788    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs" podUID="880fb2f2-ab80-44a3-b139-296de7a93a14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 17 16:53:12.977569 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:12.977533    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:53:13.496113 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:13.496078    2566 patch_prober.go:28] interesting pod/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 17 16:53:13.496724 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:13.496137    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs" podUID="880fb2f2-ab80-44a3-b139-296de7a93a14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 17 16:53:14.496074 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:14.496040    2566 patch_prober.go:28] interesting pod/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 17 16:53:14.496238 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:14.496096    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs" podUID="880fb2f2-ab80-44a3-b139-296de7a93a14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 17 16:53:15.499543 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:15.499509    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:53:15.500535 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:53:15.500513    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 16:55:52.983266 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:55:52.983239    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 16:55:52.984788 ip-10-0-130-95 kubenswrapper[2566]: I0717 16:55:52.984766    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:00:53.012116 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:00:53.012089    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:00:53.014531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:00:53.014511    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:01:04.418340 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:04.418292    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"]
Jul 17 17:01:04.418820 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:04.418492    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs" podUID="880fb2f2-ab80-44a3-b139-296de7a93a14" containerName="istio-proxy" containerID="cri-o://00f6bc622bee1fde5058cf01579d73c47cf669fac2e92df041ca2f7b2c44f4c2" gracePeriod=30
Jul 17 17:01:04.899621 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:04.899585    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"]
Jul 17 17:01:04.903206 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:04.903181    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:04.906342 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:04.906309    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-a8e6750e-gw-openshift-default-dockercfg-fnr24\""
Jul 17 17:01:04.920380 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:04.920352    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"]
Jul 17 17:01:05.031035 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.030986    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-credential-socket\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.031237 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.031070    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-envoy\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.031237 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.031095    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-token\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.031237 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.031120    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-workload-certs\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.031237 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.031167    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-data\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.031237 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.031199    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rfxw\" (UniqueName: \"kubernetes.io/projected/08e01ee6-4495-4625-9800-f33fc18df3fe-kube-api-access-8rfxw\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.031481 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.031397    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08e01ee6-4495-4625-9800-f33fc18df3fe-istiod-ca-cert\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.031481 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.031441    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-workload-socket\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.031481 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.031464    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-podinfo\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.132942 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.132908    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08e01ee6-4495-4625-9800-f33fc18df3fe-istiod-ca-cert\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.132942 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.132950    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-workload-socket\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.133278 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.132971    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-podinfo\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.133278 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.133003    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-credential-socket\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.133278 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.133059    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-envoy\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.133278 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.133084    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-token\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.133278 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.133110    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-workload-certs\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.133278 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.133158    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-data\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.133278 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.133192    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rfxw\" (UniqueName: \"kubernetes.io/projected/08e01ee6-4495-4625-9800-f33fc18df3fe-kube-api-access-8rfxw\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.133720 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.133429    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-workload-socket\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.133720 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.133675    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-workload-certs\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.133720 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.133703    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-data\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.133891 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.133734    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-credential-socket\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.134127 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.134106    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08e01ee6-4495-4625-9800-f33fc18df3fe-istiod-ca-cert\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.135704 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.135680    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-envoy\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.135801 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.135760    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-podinfo\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.142047 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.142025    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-token\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.142246 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.142226    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rfxw\" (UniqueName: \"kubernetes.io/projected/08e01ee6-4495-4625-9800-f33fc18df3fe-kube-api-access-8rfxw\") pod \"e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") " pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.217381 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.217300    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:05.391885 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:01:05.391858    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e01ee6_4495_4625_9800_f33fc18df3fe.slice/crio-5a57273f66de9b0d8ec8a757900506883e79823584c7331e86df257679d85ff6 WatchSource:0}: Error finding container 5a57273f66de9b0d8ec8a757900506883e79823584c7331e86df257679d85ff6: Status 404 returned error can't find the container with id 5a57273f66de9b0d8ec8a757900506883e79823584c7331e86df257679d85ff6
Jul 17 17:01:05.393973 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.393939    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:01:05.394094 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.394014    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:01:05.394094 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.394046    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:01:05.401224 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:05.401203    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"]
Jul 17 17:01:06.390162 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:06.390124    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws" event={"ID":"08e01ee6-4495-4625-9800-f33fc18df3fe","Type":"ContainerStarted","Data":"d24e096ae5b24d4e114751d70765b67364a2a43108a2293c8f7f956f1e66beab"}
Jul 17 17:01:06.390609 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:06.390216    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws" event={"ID":"08e01ee6-4495-4625-9800-f33fc18df3fe","Type":"ContainerStarted","Data":"5a57273f66de9b0d8ec8a757900506883e79823584c7331e86df257679d85ff6"}
Jul 17 17:01:06.420870 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:06.420827    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws" podStartSLOduration=2.420811904 podStartE2EDuration="2.420811904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:01:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:01:06.418928154 +0000 UTC m=+2115.278056714" watchObservedRunningTime="2026-07-17 17:01:06.420811904 +0000 UTC m=+2115.279940463"
Jul 17 17:01:07.217657 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:07.217616    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:07.222926 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:07.222896    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:07.395223 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:07.395176    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:07.396105 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:07.396086    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:09.667808 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.667785    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 17:01:09.780178 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780147    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-token\") pod \"880fb2f2-ab80-44a3-b139-296de7a93a14\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") "
Jul 17 17:01:09.780392 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780228    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-workload-socket\") pod \"880fb2f2-ab80-44a3-b139-296de7a93a14\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") "
Jul 17 17:01:09.780392 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780258    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-credential-socket\") pod \"880fb2f2-ab80-44a3-b139-296de7a93a14\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") "
Jul 17 17:01:09.780392 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780283    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-podinfo\") pod \"880fb2f2-ab80-44a3-b139-296de7a93a14\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") "
Jul 17 17:01:09.780392 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780313    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/880fb2f2-ab80-44a3-b139-296de7a93a14-istiod-ca-cert\") pod \"880fb2f2-ab80-44a3-b139-296de7a93a14\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") "
Jul 17 17:01:09.780392 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780379    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-envoy\") pod \"880fb2f2-ab80-44a3-b139-296de7a93a14\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") "
Jul 17 17:01:09.780664 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780410    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-workload-certs\") pod \"880fb2f2-ab80-44a3-b139-296de7a93a14\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") "
Jul 17 17:01:09.780664 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780485    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-data\") pod \"880fb2f2-ab80-44a3-b139-296de7a93a14\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") "
Jul 17 17:01:09.780664 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780518    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwfjt\" (UniqueName: \"kubernetes.io/projected/880fb2f2-ab80-44a3-b139-296de7a93a14-kube-api-access-dwfjt\") pod \"880fb2f2-ab80-44a3-b139-296de7a93a14\" (UID: \"880fb2f2-ab80-44a3-b139-296de7a93a14\") "
Jul 17 17:01:09.780664 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780570    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "880fb2f2-ab80-44a3-b139-296de7a93a14" (UID: "880fb2f2-ab80-44a3-b139-296de7a93a14"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:01:09.780664 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780585    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "880fb2f2-ab80-44a3-b139-296de7a93a14" (UID: "880fb2f2-ab80-44a3-b139-296de7a93a14"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:01:09.780888 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780773    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "880fb2f2-ab80-44a3-b139-296de7a93a14" (UID: "880fb2f2-ab80-44a3-b139-296de7a93a14"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:01:09.780888 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780858    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-credential-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:01:09.780888 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780876    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-workload-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:01:09.781031 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.780940    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/880fb2f2-ab80-44a3-b139-296de7a93a14-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "880fb2f2-ab80-44a3-b139-296de7a93a14" (UID: "880fb2f2-ab80-44a3-b139-296de7a93a14"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:01:09.781533 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.781503    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-data" (OuterVolumeSpecName: "istio-data") pod "880fb2f2-ab80-44a3-b139-296de7a93a14" (UID: "880fb2f2-ab80-44a3-b139-296de7a93a14"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:01:09.782683 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.782657    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "880fb2f2-ab80-44a3-b139-296de7a93a14" (UID: "880fb2f2-ab80-44a3-b139-296de7a93a14"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 17:01:09.782683 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.782667    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-token" (OuterVolumeSpecName: "istio-token") pod "880fb2f2-ab80-44a3-b139-296de7a93a14" (UID: "880fb2f2-ab80-44a3-b139-296de7a93a14"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:01:09.782810 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.782692    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "880fb2f2-ab80-44a3-b139-296de7a93a14" (UID: "880fb2f2-ab80-44a3-b139-296de7a93a14"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:01:09.782810 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.782772    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/880fb2f2-ab80-44a3-b139-296de7a93a14-kube-api-access-dwfjt" (OuterVolumeSpecName: "kube-api-access-dwfjt") pod "880fb2f2-ab80-44a3-b139-296de7a93a14" (UID: "880fb2f2-ab80-44a3-b139-296de7a93a14"). InnerVolumeSpecName "kube-api-access-dwfjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:01:09.881706 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.881658    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-podinfo\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:01:09.881706 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.881701    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/880fb2f2-ab80-44a3-b139-296de7a93a14-istiod-ca-cert\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:01:09.881706 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.881711    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-envoy\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:01:09.881706 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.881718    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-workload-certs\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:01:09.881706 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.881726    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-data\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:01:09.882025 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.881734    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwfjt\" (UniqueName: \"kubernetes.io/projected/880fb2f2-ab80-44a3-b139-296de7a93a14-kube-api-access-dwfjt\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:01:09.882025 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:09.881743    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/880fb2f2-ab80-44a3-b139-296de7a93a14-istio-token\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:01:10.413004 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:10.412969    2566 generic.go:356] "Generic (PLEG): container finished" podID="880fb2f2-ab80-44a3-b139-296de7a93a14" containerID="00f6bc622bee1fde5058cf01579d73c47cf669fac2e92df041ca2f7b2c44f4c2" exitCode=0
Jul 17 17:01:10.413200 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:10.413018    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"
Jul 17 17:01:10.413200 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:10.413022    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs" event={"ID":"880fb2f2-ab80-44a3-b139-296de7a93a14","Type":"ContainerDied","Data":"00f6bc622bee1fde5058cf01579d73c47cf669fac2e92df041ca2f7b2c44f4c2"}
Jul 17 17:01:10.413200 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:10.413075    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs" event={"ID":"880fb2f2-ab80-44a3-b139-296de7a93a14","Type":"ContainerDied","Data":"0a2c9d1ea1c140208762746f6f2c98ee9641c528db4aab71edb38ead2a8e4806"}
Jul 17 17:01:10.413200 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:10.413105    2566 scope.go:117] "RemoveContainer" containerID="00f6bc622bee1fde5058cf01579d73c47cf669fac2e92df041ca2f7b2c44f4c2"
Jul 17 17:01:10.422435 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:10.422419    2566 scope.go:117] "RemoveContainer" containerID="7043983cb5e1cb91c20325fe0d8a81cfb745c9ad9eef99c95e54dfd112adf78b"
Jul 17 17:01:10.430148 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:10.430129    2566 scope.go:117] "RemoveContainer" containerID="00f6bc622bee1fde5058cf01579d73c47cf669fac2e92df041ca2f7b2c44f4c2"
Jul 17 17:01:10.430400 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:01:10.430380    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00f6bc622bee1fde5058cf01579d73c47cf669fac2e92df041ca2f7b2c44f4c2\": container with ID starting with 00f6bc622bee1fde5058cf01579d73c47cf669fac2e92df041ca2f7b2c44f4c2 not found: ID does not exist" containerID="00f6bc622bee1fde5058cf01579d73c47cf669fac2e92df041ca2f7b2c44f4c2"
Jul 17 17:01:10.430460 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:10.430410    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00f6bc622bee1fde5058cf01579d73c47cf669fac2e92df041ca2f7b2c44f4c2"} err="failed to get container status \"00f6bc622bee1fde5058cf01579d73c47cf669fac2e92df041ca2f7b2c44f4c2\": rpc error: code = NotFound desc = could not find container \"00f6bc622bee1fde5058cf01579d73c47cf669fac2e92df041ca2f7b2c44f4c2\": container with ID starting with 00f6bc622bee1fde5058cf01579d73c47cf669fac2e92df041ca2f7b2c44f4c2 not found: ID does not exist"
Jul 17 17:01:10.430460 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:10.430428    2566 scope.go:117] "RemoveContainer" containerID="7043983cb5e1cb91c20325fe0d8a81cfb745c9ad9eef99c95e54dfd112adf78b"
Jul 17 17:01:10.430707 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:01:10.430685    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7043983cb5e1cb91c20325fe0d8a81cfb745c9ad9eef99c95e54dfd112adf78b\": container with ID starting with 7043983cb5e1cb91c20325fe0d8a81cfb745c9ad9eef99c95e54dfd112adf78b not found: ID does not exist" containerID="7043983cb5e1cb91c20325fe0d8a81cfb745c9ad9eef99c95e54dfd112adf78b"
Jul 17 17:01:10.430760 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:10.430718    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7043983cb5e1cb91c20325fe0d8a81cfb745c9ad9eef99c95e54dfd112adf78b"} err="failed to get container status \"7043983cb5e1cb91c20325fe0d8a81cfb745c9ad9eef99c95e54dfd112adf78b\": rpc error: code = NotFound desc = could not find container \"7043983cb5e1cb91c20325fe0d8a81cfb745c9ad9eef99c95e54dfd112adf78b\": container with ID starting with 7043983cb5e1cb91c20325fe0d8a81cfb745c9ad9eef99c95e54dfd112adf78b not found: ID does not exist"
Jul 17 17:01:10.434735 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:10.434712    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"]
Jul 17 17:01:10.439361 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:10.439342    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8c607776-openshift-default-68ff6bb55f-l8lgs"]
Jul 17 17:01:11.032223 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:11.032180    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="880fb2f2-ab80-44a3-b139-296de7a93a14" path="/var/lib/kubelet/pods/880fb2f2-ab80-44a3-b139-296de7a93a14/volumes"
Jul 17 17:01:21.475520 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:21.475488    2566 generic.go:356] "Generic (PLEG): container finished" podID="08e01ee6-4495-4625-9800-f33fc18df3fe" containerID="d24e096ae5b24d4e114751d70765b67364a2a43108a2293c8f7f956f1e66beab" exitCode=0
Jul 17 17:01:21.475887 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:21.475563    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws" event={"ID":"08e01ee6-4495-4625-9800-f33fc18df3fe","Type":"ContainerDied","Data":"d24e096ae5b24d4e114751d70765b67364a2a43108a2293c8f7f956f1e66beab"}
Jul 17 17:01:21.475964 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:21.475950    2566 scope.go:117] "RemoveContainer" containerID="d24e096ae5b24d4e114751d70765b67364a2a43108a2293c8f7f956f1e66beab"
Jul 17 17:01:21.476918 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:21.476894    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:01:21.476968 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:21.476960    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:01:21.477015 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:21.477003    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:01:22.395211 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:22.395172    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:22.481897 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:22.481864    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws" event={"ID":"08e01ee6-4495-4625-9800-f33fc18df3fe","Type":"ContainerStarted","Data":"8120b6afb869b6c494866ca4e3e5071f0486840e3d30b1f053e80abf4a9e93c9"}
Jul 17 17:01:23.217667 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:23.217625    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:23.219062 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:23.219034    2566 patch_prober.go:28] interesting pod/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 17 17:01:23.219287 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:23.219260    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws" podUID="08e01ee6-4495-4625-9800-f33fc18df3fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 17 17:01:24.218804 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:24.218772    2566 patch_prober.go:28] interesting pod/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 17 17:01:24.219397 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:24.219367    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws" podUID="08e01ee6-4495-4625-9800-f33fc18df3fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 17 17:01:25.217737 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:25.217693    2566 patch_prober.go:28] interesting pod/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 17 17:01:25.217942 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:25.217761    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws" podUID="08e01ee6-4495-4625-9800-f33fc18df3fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 17 17:01:26.218532 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:26.218430    2566 patch_prober.go:28] interesting pod/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 17 17:01:26.218532 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:26.218501    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws" podUID="08e01ee6-4495-4625-9800-f33fc18df3fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 17 17:01:27.221166 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:27.221136    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:27.221547 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:27.221500    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:01:27.222258 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:01:27.222236    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:05:53.050693 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:05:53.050666    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:05:53.057494 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:05:53.057471    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:07:14.918637 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:14.918592    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"]
Jul 17 17:07:14.919130 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:14.918916    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws" podUID="08e01ee6-4495-4625-9800-f33fc18df3fe" containerName="istio-proxy" containerID="cri-o://8120b6afb869b6c494866ca4e3e5071f0486840e3d30b1f053e80abf4a9e93c9" gracePeriod=30
Jul 17 17:07:15.107681 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.107647    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"]
Jul 17 17:07:15.108261 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.108246    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="880fb2f2-ab80-44a3-b139-296de7a93a14" containerName="istio-proxy"
Jul 17 17:07:15.108313 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.108264    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="880fb2f2-ab80-44a3-b139-296de7a93a14" containerName="istio-proxy"
Jul 17 17:07:15.108313 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.108287    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="880fb2f2-ab80-44a3-b139-296de7a93a14" containerName="istio-proxy"
Jul 17 17:07:15.108313 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.108296    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="880fb2f2-ab80-44a3-b139-296de7a93a14" containerName="istio-proxy"
Jul 17 17:07:15.108443 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.108406    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="880fb2f2-ab80-44a3-b139-296de7a93a14" containerName="istio-proxy"
Jul 17 17:07:15.111778 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.111755    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.115137 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.115115    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4cb0f3bd-openshift-default-dockercfg-l7r6z\""
Jul 17 17:07:15.123616 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.123594    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"]
Jul 17 17:07:15.252374 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.252252    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-workload-socket\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.252374 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.252329    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-data\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.252629 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.252376    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h54mz\" (UniqueName: \"kubernetes.io/projected/174ead02-8eaf-45f6-b948-93cdbc62e8b0-kube-api-access-h54mz\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.252629 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.252423    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-envoy\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.252629 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.252516    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-token\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.252629 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.252618    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-workload-certs\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.252797 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.252657    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-podinfo\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.252797 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.252724    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istiod-ca-cert\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.252797 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.252763    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-credential-socket\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.354223 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.354190    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-workload-certs\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.354223 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.354227    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-podinfo\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.354496 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.354274    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istiod-ca-cert\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.354496 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.354304    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-credential-socket\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.354496 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.354344    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-workload-socket\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.354496 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.354402    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-data\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.354496 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.354432    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h54mz\" (UniqueName: \"kubernetes.io/projected/174ead02-8eaf-45f6-b948-93cdbc62e8b0-kube-api-access-h54mz\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.354747 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.354571    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-envoy\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.354747 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.354629    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-token\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.354857 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.354749    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-credential-socket\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.354857 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.354783    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-data\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.354969 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.354872    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-workload-socket\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.354969 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.354881    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-workload-certs\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.355086 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.355063    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istiod-ca-cert\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.356821 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.356792    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-envoy\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.356821 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.356816    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-podinfo\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.363555 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.363529    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-token\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.363714 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.363698    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h54mz\" (UniqueName: \"kubernetes.io/projected/174ead02-8eaf-45f6-b948-93cdbc62e8b0-kube-api-access-h54mz\") pod \"e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") " pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.423015 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.422989    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:15.561906 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.561875    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"]
Jul 17 17:07:15.563806 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:07:15.563777    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod174ead02_8eaf_45f6_b948_93cdbc62e8b0.slice/crio-339b521913bc4ba38cd4dff7cf4f4aeca415c507f22991e127faf7397f22d842 WatchSource:0}: Error finding container 339b521913bc4ba38cd4dff7cf4f4aeca415c507f22991e127faf7397f22d842: Status 404 returned error can't find the container with id 339b521913bc4ba38cd4dff7cf4f4aeca415c507f22991e127faf7397f22d842
Jul 17 17:07:15.565952 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.565920    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:07:15.566046 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.565985    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:07:15.566046 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:15.566014    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:07:16.244450 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:16.244410    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp" event={"ID":"174ead02-8eaf-45f6-b948-93cdbc62e8b0","Type":"ContainerStarted","Data":"bb7b283ee62a55c324708af289be394280d09105156039ef62f759083060af0e"}
Jul 17 17:07:16.244819 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:16.244472    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp" event={"ID":"174ead02-8eaf-45f6-b948-93cdbc62e8b0","Type":"ContainerStarted","Data":"339b521913bc4ba38cd4dff7cf4f4aeca415c507f22991e127faf7397f22d842"}
Jul 17 17:07:16.282168 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:16.282116    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp" podStartSLOduration=1.282099338 podStartE2EDuration="1.282099338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:07:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:07:16.279799927 +0000 UTC m=+2485.138928523" watchObservedRunningTime="2026-07-17 17:07:16.282099338 +0000 UTC m=+2485.141227896"
Jul 17 17:07:16.423173 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:16.423130    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:16.428436 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:16.428410    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:17.249866 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:17.249839    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:17.250870 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:17.250851    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:20.191442 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.191384    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:07:20.270108 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.270069    2566 generic.go:356] "Generic (PLEG): container finished" podID="08e01ee6-4495-4625-9800-f33fc18df3fe" containerID="8120b6afb869b6c494866ca4e3e5071f0486840e3d30b1f053e80abf4a9e93c9" exitCode=0
Jul 17 17:07:20.270277 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.270120    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"
Jul 17 17:07:20.270277 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.270146    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws" event={"ID":"08e01ee6-4495-4625-9800-f33fc18df3fe","Type":"ContainerDied","Data":"8120b6afb869b6c494866ca4e3e5071f0486840e3d30b1f053e80abf4a9e93c9"}
Jul 17 17:07:20.270277 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.270227    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws" event={"ID":"08e01ee6-4495-4625-9800-f33fc18df3fe","Type":"ContainerDied","Data":"5a57273f66de9b0d8ec8a757900506883e79823584c7331e86df257679d85ff6"}
Jul 17 17:07:20.270277 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.270251    2566 scope.go:117] "RemoveContainer" containerID="8120b6afb869b6c494866ca4e3e5071f0486840e3d30b1f053e80abf4a9e93c9"
Jul 17 17:07:20.282046 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.282023    2566 scope.go:117] "RemoveContainer" containerID="d24e096ae5b24d4e114751d70765b67364a2a43108a2293c8f7f956f1e66beab"
Jul 17 17:07:20.291865 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.291848    2566 scope.go:117] "RemoveContainer" containerID="8120b6afb869b6c494866ca4e3e5071f0486840e3d30b1f053e80abf4a9e93c9"
Jul 17 17:07:20.292110 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:07:20.292091    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8120b6afb869b6c494866ca4e3e5071f0486840e3d30b1f053e80abf4a9e93c9\": container with ID starting with 8120b6afb869b6c494866ca4e3e5071f0486840e3d30b1f053e80abf4a9e93c9 not found: ID does not exist" containerID="8120b6afb869b6c494866ca4e3e5071f0486840e3d30b1f053e80abf4a9e93c9"
Jul 17 17:07:20.292181 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.292124    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8120b6afb869b6c494866ca4e3e5071f0486840e3d30b1f053e80abf4a9e93c9"} err="failed to get container status \"8120b6afb869b6c494866ca4e3e5071f0486840e3d30b1f053e80abf4a9e93c9\": rpc error: code = NotFound desc = could not find container \"8120b6afb869b6c494866ca4e3e5071f0486840e3d30b1f053e80abf4a9e93c9\": container with ID starting with 8120b6afb869b6c494866ca4e3e5071f0486840e3d30b1f053e80abf4a9e93c9 not found: ID does not exist"
Jul 17 17:07:20.292181 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.292150    2566 scope.go:117] "RemoveContainer" containerID="d24e096ae5b24d4e114751d70765b67364a2a43108a2293c8f7f956f1e66beab"
Jul 17 17:07:20.292403 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:07:20.292384    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d24e096ae5b24d4e114751d70765b67364a2a43108a2293c8f7f956f1e66beab\": container with ID starting with d24e096ae5b24d4e114751d70765b67364a2a43108a2293c8f7f956f1e66beab not found: ID does not exist" containerID="d24e096ae5b24d4e114751d70765b67364a2a43108a2293c8f7f956f1e66beab"
Jul 17 17:07:20.292443 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.292410    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d24e096ae5b24d4e114751d70765b67364a2a43108a2293c8f7f956f1e66beab"} err="failed to get container status \"d24e096ae5b24d4e114751d70765b67364a2a43108a2293c8f7f956f1e66beab\": rpc error: code = NotFound desc = could not find container \"d24e096ae5b24d4e114751d70765b67364a2a43108a2293c8f7f956f1e66beab\": container with ID starting with d24e096ae5b24d4e114751d70765b67364a2a43108a2293c8f7f956f1e66beab not found: ID does not exist"
Jul 17 17:07:20.298727 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.298709    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-token\") pod \"08e01ee6-4495-4625-9800-f33fc18df3fe\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") "
Jul 17 17:07:20.298819 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.298752    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-data\") pod \"08e01ee6-4495-4625-9800-f33fc18df3fe\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") "
Jul 17 17:07:20.298819 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.298776    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-workload-socket\") pod \"08e01ee6-4495-4625-9800-f33fc18df3fe\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") "
Jul 17 17:07:20.298819 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.298814    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-credential-socket\") pod \"08e01ee6-4495-4625-9800-f33fc18df3fe\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") "
Jul 17 17:07:20.298967 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.298896    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-workload-certs\") pod \"08e01ee6-4495-4625-9800-f33fc18df3fe\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") "
Jul 17 17:07:20.298967 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.298931    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-envoy\") pod \"08e01ee6-4495-4625-9800-f33fc18df3fe\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") "
Jul 17 17:07:20.329345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.299090    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "08e01ee6-4495-4625-9800-f33fc18df3fe" (UID: "08e01ee6-4495-4625-9800-f33fc18df3fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:07:20.329345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.299122    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rfxw\" (UniqueName: \"kubernetes.io/projected/08e01ee6-4495-4625-9800-f33fc18df3fe-kube-api-access-8rfxw\") pod \"08e01ee6-4495-4625-9800-f33fc18df3fe\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") "
Jul 17 17:07:20.329345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.299143    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "08e01ee6-4495-4625-9800-f33fc18df3fe" (UID: "08e01ee6-4495-4625-9800-f33fc18df3fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:07:20.329345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.299180    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-podinfo\") pod \"08e01ee6-4495-4625-9800-f33fc18df3fe\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") "
Jul 17 17:07:20.329345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.299207    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "08e01ee6-4495-4625-9800-f33fc18df3fe" (UID: "08e01ee6-4495-4625-9800-f33fc18df3fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:07:20.329345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.299211    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08e01ee6-4495-4625-9800-f33fc18df3fe-istiod-ca-cert\") pod \"08e01ee6-4495-4625-9800-f33fc18df3fe\" (UID: \"08e01ee6-4495-4625-9800-f33fc18df3fe\") "
Jul 17 17:07:20.329345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.305864    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-workload-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:07:20.329345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.305889    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-credential-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:07:20.329345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.305904    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-workload-certs\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:07:20.329345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.311482    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "08e01ee6-4495-4625-9800-f33fc18df3fe" (UID: "08e01ee6-4495-4625-9800-f33fc18df3fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:07:20.329345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.315925    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "08e01ee6-4495-4625-9800-f33fc18df3fe" (UID: "08e01ee6-4495-4625-9800-f33fc18df3fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:07:20.329345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.326469    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08e01ee6-4495-4625-9800-f33fc18df3fe-kube-api-access-8rfxw" (OuterVolumeSpecName: "kube-api-access-8rfxw") pod "08e01ee6-4495-4625-9800-f33fc18df3fe" (UID: "08e01ee6-4495-4625-9800-f33fc18df3fe"). InnerVolumeSpecName "kube-api-access-8rfxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:07:20.329345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.327706    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "08e01ee6-4495-4625-9800-f33fc18df3fe" (UID: "08e01ee6-4495-4625-9800-f33fc18df3fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:07:20.330547 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.329921    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "08e01ee6-4495-4625-9800-f33fc18df3fe" (UID: "08e01ee6-4495-4625-9800-f33fc18df3fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 17:07:20.330809 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.330773    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08e01ee6-4495-4625-9800-f33fc18df3fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "08e01ee6-4495-4625-9800-f33fc18df3fe" (UID: "08e01ee6-4495-4625-9800-f33fc18df3fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:07:20.411342 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.407883    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-envoy\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:07:20.411342 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.407920    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rfxw\" (UniqueName: \"kubernetes.io/projected/08e01ee6-4495-4625-9800-f33fc18df3fe-kube-api-access-8rfxw\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:07:20.411342 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.407938    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-podinfo\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:07:20.411342 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.407954    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08e01ee6-4495-4625-9800-f33fc18df3fe-istiod-ca-cert\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:07:20.411342 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.407966    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-token\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:07:20.411342 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.407978    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08e01ee6-4495-4625-9800-f33fc18df3fe-istio-data\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:07:20.593180 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.593151    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"]
Jul 17 17:07:20.596853 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:20.596830    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-a8e6750e-gw-openshift-default-6b8bccb767-5k9ws"]
Jul 17 17:07:21.033110 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:21.033080    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08e01ee6-4495-4625-9800-f33fc18df3fe" path="/var/lib/kubelet/pods/08e01ee6-4495-4625-9800-f33fc18df3fe/volumes"
Jul 17 17:07:27.310296 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:27.310261    2566 generic.go:356] "Generic (PLEG): container finished" podID="174ead02-8eaf-45f6-b948-93cdbc62e8b0" containerID="bb7b283ee62a55c324708af289be394280d09105156039ef62f759083060af0e" exitCode=0
Jul 17 17:07:27.310747 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:27.310348    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp" event={"ID":"174ead02-8eaf-45f6-b948-93cdbc62e8b0","Type":"ContainerDied","Data":"bb7b283ee62a55c324708af289be394280d09105156039ef62f759083060af0e"}
Jul 17 17:07:27.310795 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:27.310748    2566 scope.go:117] "RemoveContainer" containerID="bb7b283ee62a55c324708af289be394280d09105156039ef62f759083060af0e"
Jul 17 17:07:27.311815 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:27.311785    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:07:27.311928 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:27.311866    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:07:27.311928 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:27.311916    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:07:28.321148 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:28.321103    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp" event={"ID":"174ead02-8eaf-45f6-b948-93cdbc62e8b0","Type":"ContainerStarted","Data":"0daa01977fa922d68f27fbe2d9848b55038d8a68603857b12bdc039c6313bfd0"}
Jul 17 17:07:28.424531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:28.424491    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:28.424869 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:28.424840    2566 patch_prober.go:28] interesting pod/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 17 17:07:28.424959 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:28.424900    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp" podUID="174ead02-8eaf-45f6-b948-93cdbc62e8b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 17 17:07:29.424257 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:29.424205    2566 patch_prober.go:28] interesting pod/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 17 17:07:29.424786 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:29.424270    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp" podUID="174ead02-8eaf-45f6-b948-93cdbc62e8b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 17 17:07:30.423751 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:30.423704    2566 patch_prober.go:28] interesting pod/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 17 17:07:30.423965 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:30.423774    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp" podUID="174ead02-8eaf-45f6-b948-93cdbc62e8b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 17 17:07:31.424396 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:31.424353    2566 patch_prober.go:28] interesting pod/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 17 17:07:31.424896 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:31.424421    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp" podUID="174ead02-8eaf-45f6-b948-93cdbc62e8b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 17 17:07:32.250713 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:32.250681    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:32.427451 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:32.427421    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:07:32.428267 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:07:32.428250    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:10:53.083380 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:10:53.083292    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:10:53.089625 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:10:53.089605    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:15:23.125977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.125940    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"]
Jul 17 17:15:23.126689 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.126145    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp" podUID="174ead02-8eaf-45f6-b948-93cdbc62e8b0" containerName="istio-proxy" containerID="cri-o://0daa01977fa922d68f27fbe2d9848b55038d8a68603857b12bdc039c6313bfd0" gracePeriod=30
Jul 17 17:15:23.406697 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.406607    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"]
Jul 17 17:15:23.407027 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.407013    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08e01ee6-4495-4625-9800-f33fc18df3fe" containerName="istio-proxy"
Jul 17 17:15:23.407073 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.407028    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="08e01ee6-4495-4625-9800-f33fc18df3fe" containerName="istio-proxy"
Jul 17 17:15:23.407073 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.407037    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08e01ee6-4495-4625-9800-f33fc18df3fe" containerName="istio-proxy"
Jul 17 17:15:23.407073 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.407043    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="08e01ee6-4495-4625-9800-f33fc18df3fe" containerName="istio-proxy"
Jul 17 17:15:23.407165 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.407111    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="08e01ee6-4495-4625-9800-f33fc18df3fe" containerName="istio-proxy"
Jul 17 17:15:23.407165 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.407120    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="08e01ee6-4495-4625-9800-f33fc18df3fe" containerName="istio-proxy"
Jul 17 17:15:23.407165 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.407129    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="880fb2f2-ab80-44a3-b139-296de7a93a14" containerName="istio-proxy"
Jul 17 17:15:23.410066 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.410048    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.413051 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.413029    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0d4fd87f-openshift-default-dockercfg-m4bjq\""
Jul 17 17:15:23.427059 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.427035    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"]
Jul 17 17:15:23.502904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.502815    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-workload-certs\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.503109 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.502927    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-data\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.503109 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.502961    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-podinfo\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.503109 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.503031    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-envoy\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.503109 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.503062    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-workload-socket\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.503109 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.503094    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk54p\" (UniqueName: \"kubernetes.io/projected/be6540d6-4fb6-4721-bbd4-42100849b4d3-kube-api-access-hk54p\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.503460 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.503135    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-credential-socket\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.503460 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.503177    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be6540d6-4fb6-4721-bbd4-42100849b4d3-istiod-ca-cert\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.503460 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.503209    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-token\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.603905 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.603866    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-envoy\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.603905 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.603908    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-workload-socket\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.604159 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.604036    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk54p\" (UniqueName: \"kubernetes.io/projected/be6540d6-4fb6-4721-bbd4-42100849b4d3-kube-api-access-hk54p\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.604159 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.604088    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-credential-socket\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.604159 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.604131    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be6540d6-4fb6-4721-bbd4-42100849b4d3-istiod-ca-cert\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.604357 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.604165    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-token\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.604357 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.604203    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-workload-certs\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.604357 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.604267    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-data\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.604357 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.604295    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-podinfo\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.604572 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.604397    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-workload-socket\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.604572 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.604444    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-credential-socket\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.604789 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.604768    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-data\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.604957 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.604817    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-workload-certs\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.605078 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.604988    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be6540d6-4fb6-4721-bbd4-42100849b4d3-istiod-ca-cert\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.606436 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.606407    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-envoy\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.606772 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.606755    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-podinfo\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.612576 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.612552    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-token\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.612880 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.612856    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk54p\" (UniqueName: \"kubernetes.io/projected/be6540d6-4fb6-4721-bbd4-42100849b4d3-kube-api-access-hk54p\") pod \"e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") " pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.720427 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.720311    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:23.866856 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.866830    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"]
Jul 17 17:15:23.868760 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:15:23.868727    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe6540d6_4fb6_4721_bbd4_42100849b4d3.slice/crio-837420c21778f823eba5a34a3a3a0e87085e0f3795ec23d8289bd913079f4a87 WatchSource:0}: Error finding container 837420c21778f823eba5a34a3a3a0e87085e0f3795ec23d8289bd913079f4a87: Status 404 returned error can't find the container with id 837420c21778f823eba5a34a3a3a0e87085e0f3795ec23d8289bd913079f4a87
Jul 17 17:15:23.870800 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.870772    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:15:23.870889 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.870833    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:15:23.870889 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:23.870861    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:15:24.691330 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:24.691298    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f" event={"ID":"be6540d6-4fb6-4721-bbd4-42100849b4d3","Type":"ContainerStarted","Data":"ff1aebb657e4632d8a7c6fbfd843f59d40f9b20033d1e699b4e07c12422434f9"}
Jul 17 17:15:24.691699 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:24.691360    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f" event={"ID":"be6540d6-4fb6-4721-bbd4-42100849b4d3","Type":"ContainerStarted","Data":"837420c21778f823eba5a34a3a3a0e87085e0f3795ec23d8289bd913079f4a87"}
Jul 17 17:15:24.715881 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:24.715835    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f" podStartSLOduration=1.715820205 podStartE2EDuration="1.715820205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:15:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:15:24.71537188 +0000 UTC m=+2973.574500440" watchObservedRunningTime="2026-07-17 17:15:24.715820205 +0000 UTC m=+2973.574948764"
Jul 17 17:15:24.720942 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:24.720921    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:24.725620 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:24.725601    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:25.696732 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:25.696701    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:25.697741 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:25.697721    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:28.411938 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.411515    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:15:28.450069 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.450032    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-workload-socket\") pod \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") "
Jul 17 17:15:28.450243 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.450109    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h54mz\" (UniqueName: \"kubernetes.io/projected/174ead02-8eaf-45f6-b948-93cdbc62e8b0-kube-api-access-h54mz\") pod \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") "
Jul 17 17:15:28.450243 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.450149    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-token\") pod \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") "
Jul 17 17:15:28.450243 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.450179    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-podinfo\") pod \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") "
Jul 17 17:15:28.450430 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.450251    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-data\") pod \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") "
Jul 17 17:15:28.450430 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.450253    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "174ead02-8eaf-45f6-b948-93cdbc62e8b0" (UID: "174ead02-8eaf-45f6-b948-93cdbc62e8b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:15:28.450430 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.450287    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-envoy\") pod \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") "
Jul 17 17:15:28.450430 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.450314    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-workload-certs\") pod \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") "
Jul 17 17:15:28.450430 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.450354    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-credential-socket\") pod \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") "
Jul 17 17:15:28.450430 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.450420    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istiod-ca-cert\") pod \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\" (UID: \"174ead02-8eaf-45f6-b948-93cdbc62e8b0\") "
Jul 17 17:15:28.450773 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.450746    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "174ead02-8eaf-45f6-b948-93cdbc62e8b0" (UID: "174ead02-8eaf-45f6-b948-93cdbc62e8b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:15:28.450843 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.450775    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-workload-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:15:28.451197 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.451077    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "174ead02-8eaf-45f6-b948-93cdbc62e8b0" (UID: "174ead02-8eaf-45f6-b948-93cdbc62e8b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:15:28.451197 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.451083    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "174ead02-8eaf-45f6-b948-93cdbc62e8b0" (UID: "174ead02-8eaf-45f6-b948-93cdbc62e8b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:15:28.451197 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.451181    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "174ead02-8eaf-45f6-b948-93cdbc62e8b0" (UID: "174ead02-8eaf-45f6-b948-93cdbc62e8b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:15:28.452792 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.452769    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "174ead02-8eaf-45f6-b948-93cdbc62e8b0" (UID: "174ead02-8eaf-45f6-b948-93cdbc62e8b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 17:15:28.452792 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.452786    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/174ead02-8eaf-45f6-b948-93cdbc62e8b0-kube-api-access-h54mz" (OuterVolumeSpecName: "kube-api-access-h54mz") pod "174ead02-8eaf-45f6-b948-93cdbc62e8b0" (UID: "174ead02-8eaf-45f6-b948-93cdbc62e8b0"). InnerVolumeSpecName "kube-api-access-h54mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:15:28.452950 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.452875    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "174ead02-8eaf-45f6-b948-93cdbc62e8b0" (UID: "174ead02-8eaf-45f6-b948-93cdbc62e8b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:15:28.453036 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.453022    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "174ead02-8eaf-45f6-b948-93cdbc62e8b0" (UID: "174ead02-8eaf-45f6-b948-93cdbc62e8b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:15:28.552185 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.552151    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istiod-ca-cert\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:15:28.552185 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.552182    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h54mz\" (UniqueName: \"kubernetes.io/projected/174ead02-8eaf-45f6-b948-93cdbc62e8b0-kube-api-access-h54mz\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:15:28.552402 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.552193    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-token\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:15:28.552402 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.552202    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-podinfo\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:15:28.552402 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.552210    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-data\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:15:28.552402 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.552217    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-istio-envoy\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:15:28.552402 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.552224    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-workload-certs\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:15:28.552402 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.552231    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/174ead02-8eaf-45f6-b948-93cdbc62e8b0-credential-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:15:28.727720 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.716835    2566 generic.go:356] "Generic (PLEG): container finished" podID="174ead02-8eaf-45f6-b948-93cdbc62e8b0" containerID="0daa01977fa922d68f27fbe2d9848b55038d8a68603857b12bdc039c6313bfd0" exitCode=0
Jul 17 17:15:28.727720 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.716967    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp" event={"ID":"174ead02-8eaf-45f6-b948-93cdbc62e8b0","Type":"ContainerDied","Data":"0daa01977fa922d68f27fbe2d9848b55038d8a68603857b12bdc039c6313bfd0"}
Jul 17 17:15:28.727720 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.717020    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp" event={"ID":"174ead02-8eaf-45f6-b948-93cdbc62e8b0","Type":"ContainerDied","Data":"339b521913bc4ba38cd4dff7cf4f4aeca415c507f22991e127faf7397f22d842"}
Jul 17 17:15:28.727720 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.717050    2566 scope.go:117] "RemoveContainer" containerID="0daa01977fa922d68f27fbe2d9848b55038d8a68603857b12bdc039c6313bfd0"
Jul 17 17:15:28.727720 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.717232    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"
Jul 17 17:15:28.737693 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.737674    2566 scope.go:117] "RemoveContainer" containerID="bb7b283ee62a55c324708af289be394280d09105156039ef62f759083060af0e"
Jul 17 17:15:28.745486 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.745467    2566 scope.go:117] "RemoveContainer" containerID="0daa01977fa922d68f27fbe2d9848b55038d8a68603857b12bdc039c6313bfd0"
Jul 17 17:15:28.745743 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:15:28.745719    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0daa01977fa922d68f27fbe2d9848b55038d8a68603857b12bdc039c6313bfd0\": container with ID starting with 0daa01977fa922d68f27fbe2d9848b55038d8a68603857b12bdc039c6313bfd0 not found: ID does not exist" containerID="0daa01977fa922d68f27fbe2d9848b55038d8a68603857b12bdc039c6313bfd0"
Jul 17 17:15:28.745833 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.745754    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0daa01977fa922d68f27fbe2d9848b55038d8a68603857b12bdc039c6313bfd0"} err="failed to get container status \"0daa01977fa922d68f27fbe2d9848b55038d8a68603857b12bdc039c6313bfd0\": rpc error: code = NotFound desc = could not find container \"0daa01977fa922d68f27fbe2d9848b55038d8a68603857b12bdc039c6313bfd0\": container with ID starting with 0daa01977fa922d68f27fbe2d9848b55038d8a68603857b12bdc039c6313bfd0 not found: ID does not exist"
Jul 17 17:15:28.745833 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.745779    2566 scope.go:117] "RemoveContainer" containerID="bb7b283ee62a55c324708af289be394280d09105156039ef62f759083060af0e"
Jul 17 17:15:28.746014 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:15:28.745997    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb7b283ee62a55c324708af289be394280d09105156039ef62f759083060af0e\": container with ID starting with bb7b283ee62a55c324708af289be394280d09105156039ef62f759083060af0e not found: ID does not exist" containerID="bb7b283ee62a55c324708af289be394280d09105156039ef62f759083060af0e"
Jul 17 17:15:28.746053 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.746020    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb7b283ee62a55c324708af289be394280d09105156039ef62f759083060af0e"} err="failed to get container status \"bb7b283ee62a55c324708af289be394280d09105156039ef62f759083060af0e\": rpc error: code = NotFound desc = could not find container \"bb7b283ee62a55c324708af289be394280d09105156039ef62f759083060af0e\": container with ID starting with bb7b283ee62a55c324708af289be394280d09105156039ef62f759083060af0e not found: ID does not exist"
Jul 17 17:15:28.752688 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.752668    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"]
Jul 17 17:15:28.763140 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:28.763121    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4cb0f3bd-openshift-default-d4ccf6599-w8mmp"]
Jul 17 17:15:29.033281 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:29.033249    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="174ead02-8eaf-45f6-b948-93cdbc62e8b0" path="/var/lib/kubelet/pods/174ead02-8eaf-45f6-b948-93cdbc62e8b0/volumes"
Jul 17 17:15:35.761527 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:35.761491    2566 generic.go:356] "Generic (PLEG): container finished" podID="be6540d6-4fb6-4721-bbd4-42100849b4d3" containerID="ff1aebb657e4632d8a7c6fbfd843f59d40f9b20033d1e699b4e07c12422434f9" exitCode=0
Jul 17 17:15:35.761954 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:35.761563    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f" event={"ID":"be6540d6-4fb6-4721-bbd4-42100849b4d3","Type":"ContainerDied","Data":"ff1aebb657e4632d8a7c6fbfd843f59d40f9b20033d1e699b4e07c12422434f9"}
Jul 17 17:15:35.762003 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:35.761985    2566 scope.go:117] "RemoveContainer" containerID="ff1aebb657e4632d8a7c6fbfd843f59d40f9b20033d1e699b4e07c12422434f9"
Jul 17 17:15:35.763011 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:35.762978    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:15:35.763116 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:35.763049    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:15:35.763116 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:35.763084    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:15:36.767697 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:36.767658    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f" event={"ID":"be6540d6-4fb6-4721-bbd4-42100849b4d3","Type":"ContainerStarted","Data":"ab8a82caddc51990f253db5f7b83ca973f764edd907c4051a3a239873e348d6d"}
Jul 17 17:15:37.722587 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:37.722550    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:37.722995 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:37.722971    2566 patch_prober.go:28] interesting pod/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 17 17:15:37.723159 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:37.723136    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f" podUID="be6540d6-4fb6-4721-bbd4-42100849b4d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 17 17:15:38.721573 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:38.721528    2566 patch_prober.go:28] interesting pod/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 17 17:15:38.722104 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:38.721599    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f" podUID="be6540d6-4fb6-4721-bbd4-42100849b4d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 17 17:15:39.721175 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:39.721127    2566 patch_prober.go:28] interesting pod/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 17 17:15:39.721415 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:39.721207    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f" podUID="be6540d6-4fb6-4721-bbd4-42100849b4d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 17 17:15:40.697286 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:40.697247    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:40.721228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:40.721186    2566 patch_prober.go:28] interesting pod/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 17 17:15:40.721447 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:40.721265    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f" podUID="be6540d6-4fb6-4721-bbd4-42100849b4d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 17 17:15:41.725403 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:41.725375    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:41.726169 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:41.726150    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:15:53.113450 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:53.113424    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:15:53.127837 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:15:53.127799    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:20:53.153931 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:20:53.153900    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:20:53.161184 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:20:53.161157    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:23:31.011643 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:31.011607    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"]
Jul 17 17:23:31.012103 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:31.011867    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f" podUID="be6540d6-4fb6-4721-bbd4-42100849b4d3" containerName="istio-proxy" containerID="cri-o://ab8a82caddc51990f253db5f7b83ca973f764edd907c4051a3a239873e348d6d" gracePeriod=30
Jul 17 17:23:36.269367 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.269343    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:23:36.344747 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.344719    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-workload-certs\") pod \"be6540d6-4fb6-4721-bbd4-42100849b4d3\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") "
Jul 17 17:23:36.344904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.344771    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-workload-socket\") pod \"be6540d6-4fb6-4721-bbd4-42100849b4d3\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") "
Jul 17 17:23:36.344904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.344817    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-data\") pod \"be6540d6-4fb6-4721-bbd4-42100849b4d3\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") "
Jul 17 17:23:36.344904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.344831    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-envoy\") pod \"be6540d6-4fb6-4721-bbd4-42100849b4d3\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") "
Jul 17 17:23:36.344904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.344876    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk54p\" (UniqueName: \"kubernetes.io/projected/be6540d6-4fb6-4721-bbd4-42100849b4d3-kube-api-access-hk54p\") pod \"be6540d6-4fb6-4721-bbd4-42100849b4d3\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") "
Jul 17 17:23:36.345129 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.344919    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-credential-socket\") pod \"be6540d6-4fb6-4721-bbd4-42100849b4d3\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") "
Jul 17 17:23:36.345129 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.344968    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-token\") pod \"be6540d6-4fb6-4721-bbd4-42100849b4d3\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") "
Jul 17 17:23:36.345129 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.344984    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-podinfo\") pod \"be6540d6-4fb6-4721-bbd4-42100849b4d3\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") "
Jul 17 17:23:36.345129 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.344987    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "be6540d6-4fb6-4721-bbd4-42100849b4d3" (UID: "be6540d6-4fb6-4721-bbd4-42100849b4d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:23:36.345129 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.345075    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "be6540d6-4fb6-4721-bbd4-42100849b4d3" (UID: "be6540d6-4fb6-4721-bbd4-42100849b4d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:23:36.345922 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.345443    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "be6540d6-4fb6-4721-bbd4-42100849b4d3" (UID: "be6540d6-4fb6-4721-bbd4-42100849b4d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:23:36.345922 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.345510    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be6540d6-4fb6-4721-bbd4-42100849b4d3-istiod-ca-cert\") pod \"be6540d6-4fb6-4721-bbd4-42100849b4d3\" (UID: \"be6540d6-4fb6-4721-bbd4-42100849b4d3\") "
Jul 17 17:23:36.345922 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.345877    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "be6540d6-4fb6-4721-bbd4-42100849b4d3" (UID: "be6540d6-4fb6-4721-bbd4-42100849b4d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:23:36.346128 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.345929    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be6540d6-4fb6-4721-bbd4-42100849b4d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "be6540d6-4fb6-4721-bbd4-42100849b4d3" (UID: "be6540d6-4fb6-4721-bbd4-42100849b4d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:23:36.346128 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.346032    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-workload-certs\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:23:36.346128 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.346051    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-workload-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:23:36.346128 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.346065    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-data\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:23:36.346128 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.346078    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-credential-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:23:36.346128 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.346093    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be6540d6-4fb6-4721-bbd4-42100849b4d3-istiod-ca-cert\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:23:36.347276 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.347251    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "be6540d6-4fb6-4721-bbd4-42100849b4d3" (UID: "be6540d6-4fb6-4721-bbd4-42100849b4d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 17:23:36.347518 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.347491    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "be6540d6-4fb6-4721-bbd4-42100849b4d3" (UID: "be6540d6-4fb6-4721-bbd4-42100849b4d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:23:36.347591 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.347572    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "be6540d6-4fb6-4721-bbd4-42100849b4d3" (UID: "be6540d6-4fb6-4721-bbd4-42100849b4d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:23:36.348053 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.348033    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be6540d6-4fb6-4721-bbd4-42100849b4d3-kube-api-access-hk54p" (OuterVolumeSpecName: "kube-api-access-hk54p") pod "be6540d6-4fb6-4721-bbd4-42100849b4d3" (UID: "be6540d6-4fb6-4721-bbd4-42100849b4d3"). InnerVolumeSpecName "kube-api-access-hk54p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:23:36.447082 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.447051    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk54p\" (UniqueName: \"kubernetes.io/projected/be6540d6-4fb6-4721-bbd4-42100849b4d3-kube-api-access-hk54p\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:23:36.447082 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.447074    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-token\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:23:36.447082 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.447084    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-podinfo\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:23:36.447284 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:36.447092    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be6540d6-4fb6-4721-bbd4-42100849b4d3-istio-envoy\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:23:37.119847 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:37.119816    2566 generic.go:356] "Generic (PLEG): container finished" podID="be6540d6-4fb6-4721-bbd4-42100849b4d3" containerID="ab8a82caddc51990f253db5f7b83ca973f764edd907c4051a3a239873e348d6d" exitCode=0
Jul 17 17:23:37.119993 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:37.119869    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"
Jul 17 17:23:37.119993 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:37.119895    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f" event={"ID":"be6540d6-4fb6-4721-bbd4-42100849b4d3","Type":"ContainerDied","Data":"ab8a82caddc51990f253db5f7b83ca973f764edd907c4051a3a239873e348d6d"}
Jul 17 17:23:37.119993 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:37.119955    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f" event={"ID":"be6540d6-4fb6-4721-bbd4-42100849b4d3","Type":"ContainerDied","Data":"837420c21778f823eba5a34a3a3a0e87085e0f3795ec23d8289bd913079f4a87"}
Jul 17 17:23:37.119993 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:37.119985    2566 scope.go:117] "RemoveContainer" containerID="ab8a82caddc51990f253db5f7b83ca973f764edd907c4051a3a239873e348d6d"
Jul 17 17:23:37.128825 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:37.128633    2566 scope.go:117] "RemoveContainer" containerID="ff1aebb657e4632d8a7c6fbfd843f59d40f9b20033d1e699b4e07c12422434f9"
Jul 17 17:23:37.137370 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:37.137229    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"]
Jul 17 17:23:37.137445 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:37.137393    2566 scope.go:117] "RemoveContainer" containerID="ab8a82caddc51990f253db5f7b83ca973f764edd907c4051a3a239873e348d6d"
Jul 17 17:23:37.137733 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:23:37.137707    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab8a82caddc51990f253db5f7b83ca973f764edd907c4051a3a239873e348d6d\": container with ID starting with ab8a82caddc51990f253db5f7b83ca973f764edd907c4051a3a239873e348d6d not found: ID does not exist" containerID="ab8a82caddc51990f253db5f7b83ca973f764edd907c4051a3a239873e348d6d"
Jul 17 17:23:37.137822 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:37.137741    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab8a82caddc51990f253db5f7b83ca973f764edd907c4051a3a239873e348d6d"} err="failed to get container status \"ab8a82caddc51990f253db5f7b83ca973f764edd907c4051a3a239873e348d6d\": rpc error: code = NotFound desc = could not find container \"ab8a82caddc51990f253db5f7b83ca973f764edd907c4051a3a239873e348d6d\": container with ID starting with ab8a82caddc51990f253db5f7b83ca973f764edd907c4051a3a239873e348d6d not found: ID does not exist"
Jul 17 17:23:37.137822 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:37.137760    2566 scope.go:117] "RemoveContainer" containerID="ff1aebb657e4632d8a7c6fbfd843f59d40f9b20033d1e699b4e07c12422434f9"
Jul 17 17:23:37.138105 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:23:37.138071    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff1aebb657e4632d8a7c6fbfd843f59d40f9b20033d1e699b4e07c12422434f9\": container with ID starting with ff1aebb657e4632d8a7c6fbfd843f59d40f9b20033d1e699b4e07c12422434f9 not found: ID does not exist" containerID="ff1aebb657e4632d8a7c6fbfd843f59d40f9b20033d1e699b4e07c12422434f9"
Jul 17 17:23:37.138279 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:37.138106    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1aebb657e4632d8a7c6fbfd843f59d40f9b20033d1e699b4e07c12422434f9"} err="failed to get container status \"ff1aebb657e4632d8a7c6fbfd843f59d40f9b20033d1e699b4e07c12422434f9\": rpc error: code = NotFound desc = could not find container \"ff1aebb657e4632d8a7c6fbfd843f59d40f9b20033d1e699b4e07c12422434f9\": container with ID starting with ff1aebb657e4632d8a7c6fbfd843f59d40f9b20033d1e699b4e07c12422434f9 not found: ID does not exist"
Jul 17 17:23:37.140482 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:37.140459    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0d4fd87f-openshift-default-67b9984cf5-csl5f"]
Jul 17 17:23:39.034264 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:39.034226    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be6540d6-4fb6-4721-bbd4-42100849b4d3" path="/var/lib/kubelet/pods/be6540d6-4fb6-4721-bbd4-42100849b4d3/volumes"
Jul 17 17:23:55.833793 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.833755    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf"]
Jul 17 17:23:55.834213 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.834133    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="174ead02-8eaf-45f6-b948-93cdbc62e8b0" containerName="istio-proxy"
Jul 17 17:23:55.834213 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.834144    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="174ead02-8eaf-45f6-b948-93cdbc62e8b0" containerName="istio-proxy"
Jul 17 17:23:55.834213 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.834157    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="174ead02-8eaf-45f6-b948-93cdbc62e8b0" containerName="istio-proxy"
Jul 17 17:23:55.834213 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.834162    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="174ead02-8eaf-45f6-b948-93cdbc62e8b0" containerName="istio-proxy"
Jul 17 17:23:55.834213 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.834170    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be6540d6-4fb6-4721-bbd4-42100849b4d3" containerName="istio-proxy"
Jul 17 17:23:55.834213 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.834177    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="be6540d6-4fb6-4721-bbd4-42100849b4d3" containerName="istio-proxy"
Jul 17 17:23:55.834213 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.834185    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be6540d6-4fb6-4721-bbd4-42100849b4d3" containerName="istio-proxy"
Jul 17 17:23:55.834213 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.834190    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="be6540d6-4fb6-4721-bbd4-42100849b4d3" containerName="istio-proxy"
Jul 17 17:23:55.834498 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.834262    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="be6540d6-4fb6-4721-bbd4-42100849b4d3" containerName="istio-proxy"
Jul 17 17:23:55.834498 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.834269    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="174ead02-8eaf-45f6-b948-93cdbc62e8b0" containerName="istio-proxy"
Jul 17 17:23:55.834498 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.834274    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="be6540d6-4fb6-4721-bbd4-42100849b4d3" containerName="istio-proxy"
Jul 17 17:23:55.834498 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.834281    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="174ead02-8eaf-45f6-b948-93cdbc62e8b0" containerName="istio-proxy"
Jul 17 17:23:55.837571 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.837543    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf"
Jul 17 17:23:55.840060 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.840041    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:23:55.840159 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.840044    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:23:55.843586 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.843551    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf"]
Jul 17 17:23:55.933882 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:55.933840    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cab876f-e3ed-4b5f-a1f7-85f97022ec9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf\" (UID: \"3cab876f-e3ed-4b5f-a1f7-85f97022ec9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf"
Jul 17 17:23:56.034511 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:56.034475    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cab876f-e3ed-4b5f-a1f7-85f97022ec9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf\" (UID: \"3cab876f-e3ed-4b5f-a1f7-85f97022ec9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf"
Jul 17 17:23:56.035072 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:56.035054    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cab876f-e3ed-4b5f-a1f7-85f97022ec9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf\" (UID: \"3cab876f-e3ed-4b5f-a1f7-85f97022ec9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf"
Jul 17 17:23:56.149387 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:56.149290    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf"
Jul 17 17:23:56.282663 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:56.282636    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf"]
Jul 17 17:23:56.285441 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:23:56.285413    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cab876f_e3ed_4b5f_a1f7_85f97022ec9f.slice/crio-9f829d9f0d3770883ce97e5ea9bbe31b67997c028095a8628f91f81edc7d0526 WatchSource:0}: Error finding container 9f829d9f0d3770883ce97e5ea9bbe31b67997c028095a8628f91f81edc7d0526: Status 404 returned error can't find the container with id 9f829d9f0d3770883ce97e5ea9bbe31b67997c028095a8628f91f81edc7d0526
Jul 17 17:23:56.287824 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:56.287808    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 17:23:57.235737 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:57.235702    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf" event={"ID":"3cab876f-e3ed-4b5f-a1f7-85f97022ec9f","Type":"ContainerStarted","Data":"9f829d9f0d3770883ce97e5ea9bbe31b67997c028095a8628f91f81edc7d0526"}
Jul 17 17:23:59.247222 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:59.247190    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf" event={"ID":"3cab876f-e3ed-4b5f-a1f7-85f97022ec9f","Type":"ContainerStarted","Data":"063fcbaaad10beb560e92f00f91759c0d2de137d6c936f8043312c2840cef740"}
Jul 17 17:23:59.265935 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:23:59.265883    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf" podStartSLOduration=1.68131461 podStartE2EDuration="4.265867675s" totalImagesPullingTime="2.584553065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:23:59.264528406 +0000 UTC m=+3488.123656964" watchObservedRunningTime="2026-07-17 17:23:59.265867675 +0000 UTC m=+3488.124996271"
Jul 17 17:24:00.254103 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:00.254063    2566 generic.go:356] "Generic (PLEG): container finished" podID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f" containerID="063fcbaaad10beb560e92f00f91759c0d2de137d6c936f8043312c2840cef740" exitCode=7
Jul 17 17:24:00.254511 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:00.254126    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf" event={"ID":"3cab876f-e3ed-4b5f-a1f7-85f97022ec9f","Type":"ContainerDied","Data":"063fcbaaad10beb560e92f00f91759c0d2de137d6c936f8043312c2840cef740"}
Jul 17 17:24:00.254511 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:00.254436    2566 scope.go:117] "RemoveContainer" containerID="063fcbaaad10beb560e92f00f91759c0d2de137d6c936f8043312c2840cef740"
Jul 17 17:24:01.262117 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:01.262024    2566 generic.go:356] "Generic (PLEG): container finished" podID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f" containerID="1dbb948b2bbfe7064fa5d8bc28117683cc734d51a14166df9d823c78a6285068" exitCode=7
Jul 17 17:24:01.262606 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:01.262133    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf" event={"ID":"3cab876f-e3ed-4b5f-a1f7-85f97022ec9f","Type":"ContainerDied","Data":"1dbb948b2bbfe7064fa5d8bc28117683cc734d51a14166df9d823c78a6285068"}
Jul 17 17:24:01.262606 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:01.262192    2566 scope.go:117] "RemoveContainer" containerID="063fcbaaad10beb560e92f00f91759c0d2de137d6c936f8043312c2840cef740"
Jul 17 17:24:01.262606 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:01.262282    2566 scope.go:117] "RemoveContainer" containerID="1dbb948b2bbfe7064fa5d8bc28117683cc734d51a14166df9d823c78a6285068"
Jul 17 17:24:01.262760 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:24:01.262605    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf_odh-ai-gateway-infra(3cab876f-e3ed-4b5f-a1f7-85f97022ec9f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf" podUID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f"
Jul 17 17:24:02.269547 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:02.269514    2566 scope.go:117] "RemoveContainer" containerID="1dbb948b2bbfe7064fa5d8bc28117683cc734d51a14166df9d823c78a6285068"
Jul 17 17:24:02.270007 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:24:02.269839    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf_odh-ai-gateway-infra(3cab876f-e3ed-4b5f-a1f7-85f97022ec9f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf" podUID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f"
Jul 17 17:24:11.113809 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:11.113774    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr"]
Jul 17 17:24:11.116990 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:11.116970    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr"
Jul 17 17:24:11.131643 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:11.131615    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr"]
Jul 17 17:24:11.273663 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:11.273633    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c5db96-f1f0-40d6-9089-793d69b5dd70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr\" (UID: \"34c5db96-f1f0-40d6-9089-793d69b5dd70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr"
Jul 17 17:24:11.375145 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:11.375053    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c5db96-f1f0-40d6-9089-793d69b5dd70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr\" (UID: \"34c5db96-f1f0-40d6-9089-793d69b5dd70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr"
Jul 17 17:24:11.375707 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:11.375689    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c5db96-f1f0-40d6-9089-793d69b5dd70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr\" (UID: \"34c5db96-f1f0-40d6-9089-793d69b5dd70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr"
Jul 17 17:24:11.428567 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:11.428531    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr"
Jul 17 17:24:11.573562 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:11.573027    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr"]
Jul 17 17:24:11.582477 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:24:11.582446    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c5db96_f1f0_40d6_9089_793d69b5dd70.slice/crio-58fdfaeca6c9605924d16966d3cd95a432709e0ccb84ccf7eff849fab1bdcf57 WatchSource:0}: Error finding container 58fdfaeca6c9605924d16966d3cd95a432709e0ccb84ccf7eff849fab1bdcf57: Status 404 returned error can't find the container with id 58fdfaeca6c9605924d16966d3cd95a432709e0ccb84ccf7eff849fab1bdcf57
Jul 17 17:24:12.324360 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:12.324305    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr" event={"ID":"34c5db96-f1f0-40d6-9089-793d69b5dd70","Type":"ContainerStarted","Data":"b7426b45b1baced574960c6f7712da4fa77c79fdf55c45c3116efe2ceea79f7b"}
Jul 17 17:24:12.324720 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:12.324395    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr" event={"ID":"34c5db96-f1f0-40d6-9089-793d69b5dd70","Type":"ContainerStarted","Data":"58fdfaeca6c9605924d16966d3cd95a432709e0ccb84ccf7eff849fab1bdcf57"}
Jul 17 17:24:12.343418 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:12.343371    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr" podStartSLOduration=1.343355766 podStartE2EDuration="1.343355766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:12.341918336 +0000 UTC m=+3501.201046894" watchObservedRunningTime="2026-07-17 17:24:12.343355766 +0000 UTC m=+3501.202484325"
Jul 17 17:24:13.330306 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:13.330265    2566 generic.go:356] "Generic (PLEG): container finished" podID="34c5db96-f1f0-40d6-9089-793d69b5dd70" containerID="b7426b45b1baced574960c6f7712da4fa77c79fdf55c45c3116efe2ceea79f7b" exitCode=7
Jul 17 17:24:13.330694 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:13.330357    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr" event={"ID":"34c5db96-f1f0-40d6-9089-793d69b5dd70","Type":"ContainerDied","Data":"b7426b45b1baced574960c6f7712da4fa77c79fdf55c45c3116efe2ceea79f7b"}
Jul 17 17:24:13.330694 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:13.330526    2566 scope.go:117] "RemoveContainer" containerID="b7426b45b1baced574960c6f7712da4fa77c79fdf55c45c3116efe2ceea79f7b"
Jul 17 17:24:13.566984 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:13.566954    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq"]
Jul 17 17:24:13.570075 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:13.570058    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq"
Jul 17 17:24:13.577916 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:13.577893    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq"]
Jul 17 17:24:13.594363 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:13.594271    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq\" (UID: \"0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq"
Jul 17 17:24:13.694869 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:13.694842    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq\" (UID: \"0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq"
Jul 17 17:24:13.695457 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:13.695441    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq\" (UID: \"0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq"
Jul 17 17:24:13.881444 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:13.881374    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq"
Jul 17 17:24:14.007034 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:14.007003    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq"]
Jul 17 17:24:14.010061 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:24:14.010029    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0651efc1_84d4_4e76_91fe_fb8fc7d0e3dd.slice/crio-67a9315496140f176b50cf6d340de75b26df64db21884df8134a44ec66165bb6 WatchSource:0}: Error finding container 67a9315496140f176b50cf6d340de75b26df64db21884df8134a44ec66165bb6: Status 404 returned error can't find the container with id 67a9315496140f176b50cf6d340de75b26df64db21884df8134a44ec66165bb6
Jul 17 17:24:14.337149 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:14.337121    2566 generic.go:356] "Generic (PLEG): container finished" podID="34c5db96-f1f0-40d6-9089-793d69b5dd70" containerID="6d260b88ceff3fecd66a4124b70af908280dcbdb289de1885a444b7c768ee93d" exitCode=7
Jul 17 17:24:14.337554 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:14.337208    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr" event={"ID":"34c5db96-f1f0-40d6-9089-793d69b5dd70","Type":"ContainerDied","Data":"6d260b88ceff3fecd66a4124b70af908280dcbdb289de1885a444b7c768ee93d"}
Jul 17 17:24:14.337554 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:14.337284    2566 scope.go:117] "RemoveContainer" containerID="b7426b45b1baced574960c6f7712da4fa77c79fdf55c45c3116efe2ceea79f7b"
Jul 17 17:24:14.337554 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:14.337457    2566 scope.go:117] "RemoveContainer" containerID="6d260b88ceff3fecd66a4124b70af908280dcbdb289de1885a444b7c768ee93d"
Jul 17 17:24:14.337711 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:24:14.337644    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr_odh-ai-gateway-infra(34c5db96-f1f0-40d6-9089-793d69b5dd70)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr" podUID="34c5db96-f1f0-40d6-9089-793d69b5dd70"
Jul 17 17:24:14.338816 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:14.338790    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq" event={"ID":"0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd","Type":"ContainerStarted","Data":"61522d507440baea687e1cc4de9f6a66435a669ff74c4c004d05ebee0e80ef75"}
Jul 17 17:24:14.338914 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:14.338835    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq" event={"ID":"0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd","Type":"ContainerStarted","Data":"67a9315496140f176b50cf6d340de75b26df64db21884df8134a44ec66165bb6"}
Jul 17 17:24:14.368142 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:14.368099    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq" podStartSLOduration=1.368086548 podStartE2EDuration="1.368086548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:14.366635202 +0000 UTC m=+3503.225763763" watchObservedRunningTime="2026-07-17 17:24:14.368086548 +0000 UTC m=+3503.227215106"
Jul 17 17:24:15.025856 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:15.025821    2566 scope.go:117] "RemoveContainer" containerID="1dbb948b2bbfe7064fa5d8bc28117683cc734d51a14166df9d823c78a6285068"
Jul 17 17:24:15.345073 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:15.345050    2566 scope.go:117] "RemoveContainer" containerID="6d260b88ceff3fecd66a4124b70af908280dcbdb289de1885a444b7c768ee93d"
Jul 17 17:24:15.345484 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:24:15.345230    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr_odh-ai-gateway-infra(34c5db96-f1f0-40d6-9089-793d69b5dd70)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr" podUID="34c5db96-f1f0-40d6-9089-793d69b5dd70"
Jul 17 17:24:15.346747 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:15.346725    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf" event={"ID":"3cab876f-e3ed-4b5f-a1f7-85f97022ec9f","Type":"ContainerStarted","Data":"49287384e8c64755cc33b4df03c54775ff70ad4878da9af817bcd3a4de3f97c3"}
Jul 17 17:24:15.348185 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:15.348161    2566 generic.go:356] "Generic (PLEG): container finished" podID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd" containerID="61522d507440baea687e1cc4de9f6a66435a669ff74c4c004d05ebee0e80ef75" exitCode=7
Jul 17 17:24:15.348275 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:15.348216    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq" event={"ID":"0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd","Type":"ContainerDied","Data":"61522d507440baea687e1cc4de9f6a66435a669ff74c4c004d05ebee0e80ef75"}
Jul 17 17:24:15.348367 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:15.348351    2566 scope.go:117] "RemoveContainer" containerID="61522d507440baea687e1cc4de9f6a66435a669ff74c4c004d05ebee0e80ef75"
Jul 17 17:24:16.355376 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:16.355344    2566 generic.go:356] "Generic (PLEG): container finished" podID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd" containerID="9a47be181546dbbf0b459b0a6452c7e107ad60e87bfc921661e73f703b4cb74c" exitCode=7
Jul 17 17:24:16.355806 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:16.355418    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq" event={"ID":"0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd","Type":"ContainerDied","Data":"9a47be181546dbbf0b459b0a6452c7e107ad60e87bfc921661e73f703b4cb74c"}
Jul 17 17:24:16.355806 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:16.355524    2566 scope.go:117] "RemoveContainer" containerID="61522d507440baea687e1cc4de9f6a66435a669ff74c4c004d05ebee0e80ef75"
Jul 17 17:24:16.355806 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:16.355625    2566 scope.go:117] "RemoveContainer" containerID="9a47be181546dbbf0b459b0a6452c7e107ad60e87bfc921661e73f703b4cb74c"
Jul 17 17:24:16.355989 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:24:16.355839    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq_odh-ai-gateway-infra(0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq" podUID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd"
Jul 17 17:24:16.357368 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:16.357346    2566 generic.go:356] "Generic (PLEG): container finished" podID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f" containerID="49287384e8c64755cc33b4df03c54775ff70ad4878da9af817bcd3a4de3f97c3" exitCode=7
Jul 17 17:24:16.357464 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:16.357401    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf" event={"ID":"3cab876f-e3ed-4b5f-a1f7-85f97022ec9f","Type":"ContainerDied","Data":"49287384e8c64755cc33b4df03c54775ff70ad4878da9af817bcd3a4de3f97c3"}
Jul 17 17:24:16.357637 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:16.357625    2566 scope.go:117] "RemoveContainer" containerID="49287384e8c64755cc33b4df03c54775ff70ad4878da9af817bcd3a4de3f97c3"
Jul 17 17:24:16.357810 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:24:16.357794    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf_odh-ai-gateway-infra(3cab876f-e3ed-4b5f-a1f7-85f97022ec9f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf" podUID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f"
Jul 17 17:24:16.365147 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:16.365133    2566 scope.go:117] "RemoveContainer" containerID="1dbb948b2bbfe7064fa5d8bc28117683cc734d51a14166df9d823c78a6285068"
Jul 17 17:24:16.391005 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:16.390982    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf"]
Jul 17 17:24:17.368236 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:17.366913    2566 scope.go:117] "RemoveContainer" containerID="9a47be181546dbbf0b459b0a6452c7e107ad60e87bfc921661e73f703b4cb74c"
Jul 17 17:24:17.368236 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:24:17.367162    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq_odh-ai-gateway-infra(0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq" podUID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd"
Jul 17 17:24:17.499850 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:17.499823    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf"
Jul 17 17:24:17.525607 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:17.525581    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cab876f-e3ed-4b5f-a1f7-85f97022ec9f-maas-api-service-ca\") pod \"3cab876f-e3ed-4b5f-a1f7-85f97022ec9f\" (UID: \"3cab876f-e3ed-4b5f-a1f7-85f97022ec9f\") "
Jul 17 17:24:17.525941 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:17.525915    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cab876f-e3ed-4b5f-a1f7-85f97022ec9f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3cab876f-e3ed-4b5f-a1f7-85f97022ec9f" (UID: "3cab876f-e3ed-4b5f-a1f7-85f97022ec9f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:24:17.627162 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:17.627079    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cab876f-e3ed-4b5f-a1f7-85f97022ec9f-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:24:18.372932 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:18.372904    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf"
Jul 17 17:24:18.373366 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:18.372905    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf" event={"ID":"3cab876f-e3ed-4b5f-a1f7-85f97022ec9f","Type":"ContainerDied","Data":"9f829d9f0d3770883ce97e5ea9bbe31b67997c028095a8628f91f81edc7d0526"}
Jul 17 17:24:18.373366 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:18.373035    2566 scope.go:117] "RemoveContainer" containerID="49287384e8c64755cc33b4df03c54775ff70ad4878da9af817bcd3a4de3f97c3"
Jul 17 17:24:18.393100 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:18.393074    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf"]
Jul 17 17:24:18.396802 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:18.396780    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-wdcqf"]
Jul 17 17:24:19.031504 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:19.031462    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f" path="/var/lib/kubelet/pods/3cab876f-e3ed-4b5f-a1f7-85f97022ec9f/volumes"
Jul 17 17:24:28.026387 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:28.026349    2566 scope.go:117] "RemoveContainer" containerID="6d260b88ceff3fecd66a4124b70af908280dcbdb289de1885a444b7c768ee93d"
Jul 17 17:24:28.430847 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:28.430814    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr" event={"ID":"34c5db96-f1f0-40d6-9089-793d69b5dd70","Type":"ContainerStarted","Data":"904b558a0e78c7d4a7cd12128f20d51eb5480350d6b26a70e02d1127ee7adeac"}
Jul 17 17:24:29.025926 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:29.025841    2566 scope.go:117] "RemoveContainer" containerID="9a47be181546dbbf0b459b0a6452c7e107ad60e87bfc921661e73f703b4cb74c"
Jul 17 17:24:29.438234 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:29.438199    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq" event={"ID":"0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd","Type":"ContainerStarted","Data":"e60612a9b4b770faef37aa7cc41ad2f39ddf17a34b4a576c625883da42414503"}
Jul 17 17:24:29.440126 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:29.440097    2566 generic.go:356] "Generic (PLEG): container finished" podID="34c5db96-f1f0-40d6-9089-793d69b5dd70" containerID="904b558a0e78c7d4a7cd12128f20d51eb5480350d6b26a70e02d1127ee7adeac" exitCode=7
Jul 17 17:24:29.440243 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:29.440161    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr" event={"ID":"34c5db96-f1f0-40d6-9089-793d69b5dd70","Type":"ContainerDied","Data":"904b558a0e78c7d4a7cd12128f20d51eb5480350d6b26a70e02d1127ee7adeac"}
Jul 17 17:24:29.440243 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:29.440218    2566 scope.go:117] "RemoveContainer" containerID="6d260b88ceff3fecd66a4124b70af908280dcbdb289de1885a444b7c768ee93d"
Jul 17 17:24:29.440476 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:29.440462    2566 scope.go:117] "RemoveContainer" containerID="904b558a0e78c7d4a7cd12128f20d51eb5480350d6b26a70e02d1127ee7adeac"
Jul 17 17:24:29.440670 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:24:29.440652    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr_odh-ai-gateway-infra(34c5db96-f1f0-40d6-9089-793d69b5dd70)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr" podUID="34c5db96-f1f0-40d6-9089-793d69b5dd70"
Jul 17 17:24:29.460627 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:29.460604    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr"]
Jul 17 17:24:30.446866 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:30.446835    2566 generic.go:356] "Generic (PLEG): container finished" podID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd" containerID="e60612a9b4b770faef37aa7cc41ad2f39ddf17a34b4a576c625883da42414503" exitCode=7
Jul 17 17:24:30.447375 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:30.446916    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq" event={"ID":"0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd","Type":"ContainerDied","Data":"e60612a9b4b770faef37aa7cc41ad2f39ddf17a34b4a576c625883da42414503"}
Jul 17 17:24:30.447375 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:30.446981    2566 scope.go:117] "RemoveContainer" containerID="9a47be181546dbbf0b459b0a6452c7e107ad60e87bfc921661e73f703b4cb74c"
Jul 17 17:24:30.447375 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:30.447285    2566 scope.go:117] "RemoveContainer" containerID="e60612a9b4b770faef37aa7cc41ad2f39ddf17a34b4a576c625883da42414503"
Jul 17 17:24:30.447558 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:24:30.447535    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq_odh-ai-gateway-infra(0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq" podUID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd"
Jul 17 17:24:30.471331 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:30.471297    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq"]
Jul 17 17:24:30.589805 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:30.589776    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr"
Jul 17 17:24:30.647491 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:30.647458    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c5db96-f1f0-40d6-9089-793d69b5dd70-maas-api-service-ca\") pod \"34c5db96-f1f0-40d6-9089-793d69b5dd70\" (UID: \"34c5db96-f1f0-40d6-9089-793d69b5dd70\") "
Jul 17 17:24:30.647787 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:30.647763    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34c5db96-f1f0-40d6-9089-793d69b5dd70-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "34c5db96-f1f0-40d6-9089-793d69b5dd70" (UID: "34c5db96-f1f0-40d6-9089-793d69b5dd70"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:24:30.748111 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:30.748024    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c5db96-f1f0-40d6-9089-793d69b5dd70-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:24:31.456509 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:31.456484    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr"
Jul 17 17:24:31.456910 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:31.456482    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr" event={"ID":"34c5db96-f1f0-40d6-9089-793d69b5dd70","Type":"ContainerDied","Data":"58fdfaeca6c9605924d16966d3cd95a432709e0ccb84ccf7eff849fab1bdcf57"}
Jul 17 17:24:31.456910 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:31.456636    2566 scope.go:117] "RemoveContainer" containerID="904b558a0e78c7d4a7cd12128f20d51eb5480350d6b26a70e02d1127ee7adeac"
Jul 17 17:24:31.482215 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:31.482181    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr"]
Jul 17 17:24:31.486547 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:31.486518    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-z5zfr"]
Jul 17 17:24:31.593886 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:31.593864    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq"
Jul 17 17:24:31.655818 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:31.655784    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd-maas-api-service-ca\") pod \"0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd\" (UID: \"0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd\") "
Jul 17 17:24:31.656141 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:31.656118    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd" (UID: "0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:24:31.756790 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:31.756698    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:24:32.462494 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:32.462464    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq"
Jul 17 17:24:32.462963 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:32.462511    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq" event={"ID":"0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd","Type":"ContainerDied","Data":"67a9315496140f176b50cf6d340de75b26df64db21884df8134a44ec66165bb6"}
Jul 17 17:24:32.462963 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:32.462580    2566 scope.go:117] "RemoveContainer" containerID="e60612a9b4b770faef37aa7cc41ad2f39ddf17a34b4a576c625883da42414503"
Jul 17 17:24:32.486124 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:32.486095    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq"]
Jul 17 17:24:32.493131 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:32.493109    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-g5ntq"]
Jul 17 17:24:33.031798 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:33.031768    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd" path="/var/lib/kubelet/pods/0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd/volumes"
Jul 17 17:24:33.032119 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:33.032106    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34c5db96-f1f0-40d6-9089-793d69b5dd70" path="/var/lib/kubelet/pods/34c5db96-f1f0-40d6-9089-793d69b5dd70/volumes"
Jul 17 17:24:55.671644 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.671612    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx"]
Jul 17 17:24:55.672035 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672019    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f" containerName="revoke-keys"
Jul 17 17:24:55.672093 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672036    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f" containerName="revoke-keys"
Jul 17 17:24:55.672093 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672044    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f" containerName="revoke-keys"
Jul 17 17:24:55.672093 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672050    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f" containerName="revoke-keys"
Jul 17 17:24:55.672093 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672061    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd" containerName="revoke-keys"
Jul 17 17:24:55.672093 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672066    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd" containerName="revoke-keys"
Jul 17 17:24:55.672093 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672076    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c5db96-f1f0-40d6-9089-793d69b5dd70" containerName="revoke-keys"
Jul 17 17:24:55.672093 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672081    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c5db96-f1f0-40d6-9089-793d69b5dd70" containerName="revoke-keys"
Jul 17 17:24:55.672093 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672089    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd" containerName="revoke-keys"
Jul 17 17:24:55.672348 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672097    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd" containerName="revoke-keys"
Jul 17 17:24:55.672348 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672115    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c5db96-f1f0-40d6-9089-793d69b5dd70" containerName="revoke-keys"
Jul 17 17:24:55.672348 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672120    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c5db96-f1f0-40d6-9089-793d69b5dd70" containerName="revoke-keys"
Jul 17 17:24:55.672348 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672195    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="34c5db96-f1f0-40d6-9089-793d69b5dd70" containerName="revoke-keys"
Jul 17 17:24:55.672348 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672203    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd" containerName="revoke-keys"
Jul 17 17:24:55.672348 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672210    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd" containerName="revoke-keys"
Jul 17 17:24:55.672348 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672216    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="34c5db96-f1f0-40d6-9089-793d69b5dd70" containerName="revoke-keys"
Jul 17 17:24:55.672348 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672221    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f" containerName="revoke-keys"
Jul 17 17:24:55.672348 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672228    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f" containerName="revoke-keys"
Jul 17 17:24:55.672348 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.672233    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f" containerName="revoke-keys"
Jul 17 17:24:55.676619 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.676603    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx"
Jul 17 17:24:55.679049 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.679025    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:24:55.679184 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.679076    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:24:55.683314 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.683291    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx"]
Jul 17 17:24:55.780447 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.780418    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a2347e1-a3ba-47c3-8fda-763c9b0a65c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-jjkgx\" (UID: \"6a2347e1-a3ba-47c3-8fda-763c9b0a65c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx"
Jul 17 17:24:55.873805 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.873771    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8"]
Jul 17 17:24:55.874155 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.874143    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f" containerName="revoke-keys"
Jul 17 17:24:55.874200 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.874157    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cab876f-e3ed-4b5f-a1f7-85f97022ec9f" containerName="revoke-keys"
Jul 17 17:24:55.874200 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.874168    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd" containerName="revoke-keys"
Jul 17 17:24:55.874200 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.874173    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd" containerName="revoke-keys"
Jul 17 17:24:55.874200 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.874183    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c5db96-f1f0-40d6-9089-793d69b5dd70" containerName="revoke-keys"
Jul 17 17:24:55.874200 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.874188    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c5db96-f1f0-40d6-9089-793d69b5dd70" containerName="revoke-keys"
Jul 17 17:24:55.874448 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.874250    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="34c5db96-f1f0-40d6-9089-793d69b5dd70" containerName="revoke-keys"
Jul 17 17:24:55.874448 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.874259    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0651efc1-84d4-4e76-91fe-fb8fc7d0e3dd" containerName="revoke-keys"
Jul 17 17:24:55.877159 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.877144    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8"
Jul 17 17:24:55.881288 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.881239    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a2347e1-a3ba-47c3-8fda-763c9b0a65c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-jjkgx\" (UID: \"6a2347e1-a3ba-47c3-8fda-763c9b0a65c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx"
Jul 17 17:24:55.881993 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.881958    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a2347e1-a3ba-47c3-8fda-763c9b0a65c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-jjkgx\" (UID: \"6a2347e1-a3ba-47c3-8fda-763c9b0a65c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx"
Jul 17 17:24:55.884166 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.884106    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8"]
Jul 17 17:24:55.982563 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.982494    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c91e562-d90e-463b-ade5-bd4eecb7e839-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8\" (UID: \"3c91e562-d90e-463b-ade5-bd4eecb7e839\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8"
Jul 17 17:24:55.988448 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:55.988427    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx"
Jul 17 17:24:56.083958 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:56.083927    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c91e562-d90e-463b-ade5-bd4eecb7e839-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8\" (UID: \"3c91e562-d90e-463b-ade5-bd4eecb7e839\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8"
Jul 17 17:24:56.084562 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:56.084542    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c91e562-d90e-463b-ade5-bd4eecb7e839-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8\" (UID: \"3c91e562-d90e-463b-ade5-bd4eecb7e839\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8"
Jul 17 17:24:56.122601 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:56.122568    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx"]
Jul 17 17:24:56.124608 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:24:56.124582    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2347e1_a3ba_47c3_8fda_763c9b0a65c8.slice/crio-6beabf0f93c2789e4c16c11cffd5ff3a321bb039fc8eb914462348e9d568ac20 WatchSource:0}: Error finding container 6beabf0f93c2789e4c16c11cffd5ff3a321bb039fc8eb914462348e9d568ac20: Status 404 returned error can't find the container with id 6beabf0f93c2789e4c16c11cffd5ff3a321bb039fc8eb914462348e9d568ac20
Jul 17 17:24:56.188211 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:56.188189    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8"
Jul 17 17:24:56.325064 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:56.325035    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8"]
Jul 17 17:24:56.326256 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:24:56.326224    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c91e562_d90e_463b_ade5_bd4eecb7e839.slice/crio-4f46178666cf2faa4ba19ab501a25b575802ab6375774cb58ea4b848e2c1a324 WatchSource:0}: Error finding container 4f46178666cf2faa4ba19ab501a25b575802ab6375774cb58ea4b848e2c1a324: Status 404 returned error can't find the container with id 4f46178666cf2faa4ba19ab501a25b575802ab6375774cb58ea4b848e2c1a324
Jul 17 17:24:56.580620 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:56.580587    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx" event={"ID":"6a2347e1-a3ba-47c3-8fda-763c9b0a65c8","Type":"ContainerStarted","Data":"0e5c5151856abb413ff88ee4c79b779159aa76c690b4669b2a65fc16a14a7102"}
Jul 17 17:24:56.580744 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:56.580645    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx" event={"ID":"6a2347e1-a3ba-47c3-8fda-763c9b0a65c8","Type":"ContainerStarted","Data":"6beabf0f93c2789e4c16c11cffd5ff3a321bb039fc8eb914462348e9d568ac20"}
Jul 17 17:24:56.581942 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:56.581922    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8" event={"ID":"3c91e562-d90e-463b-ade5-bd4eecb7e839","Type":"ContainerStarted","Data":"4f46178666cf2faa4ba19ab501a25b575802ab6375774cb58ea4b848e2c1a324"}
Jul 17 17:24:56.596755 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:56.596710    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx" podStartSLOduration=1.596696885 podStartE2EDuration="1.596696885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:56.594058111 +0000 UTC m=+3545.453186672" watchObservedRunningTime="2026-07-17 17:24:56.596696885 +0000 UTC m=+3545.455825444"
Jul 17 17:24:57.588592 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:57.588555    2566 generic.go:356] "Generic (PLEG): container finished" podID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8" containerID="0e5c5151856abb413ff88ee4c79b779159aa76c690b4669b2a65fc16a14a7102" exitCode=7
Jul 17 17:24:57.589020 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:57.588631    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx" event={"ID":"6a2347e1-a3ba-47c3-8fda-763c9b0a65c8","Type":"ContainerDied","Data":"0e5c5151856abb413ff88ee4c79b779159aa76c690b4669b2a65fc16a14a7102"}
Jul 17 17:24:57.589020 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:57.588826    2566 scope.go:117] "RemoveContainer" containerID="0e5c5151856abb413ff88ee4c79b779159aa76c690b4669b2a65fc16a14a7102"
Jul 17 17:24:57.596824 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:57.596802    2566 generic.go:356] "Generic (PLEG): container finished" podID="3c91e562-d90e-463b-ade5-bd4eecb7e839" containerID="b44ab71463e60ea02e081a3c33879e57c6338a54cce2e1f80994cbcb3325e307" exitCode=7
Jul 17 17:24:57.596996 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:57.596838    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8" event={"ID":"3c91e562-d90e-463b-ade5-bd4eecb7e839","Type":"ContainerDied","Data":"b44ab71463e60ea02e081a3c33879e57c6338a54cce2e1f80994cbcb3325e307"}
Jul 17 17:24:57.597068 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:57.597016    2566 scope.go:117] "RemoveContainer" containerID="b44ab71463e60ea02e081a3c33879e57c6338a54cce2e1f80994cbcb3325e307"
Jul 17 17:24:58.604389 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:58.604355    2566 generic.go:356] "Generic (PLEG): container finished" podID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8" containerID="ae1b74da3d6c955b47289a0ae4dfe4100fe4398e6e9e12554804b2440dde63e8" exitCode=7
Jul 17 17:24:58.604828 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:58.604461    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx" event={"ID":"6a2347e1-a3ba-47c3-8fda-763c9b0a65c8","Type":"ContainerDied","Data":"ae1b74da3d6c955b47289a0ae4dfe4100fe4398e6e9e12554804b2440dde63e8"}
Jul 17 17:24:58.604828 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:58.604530    2566 scope.go:117] "RemoveContainer" containerID="0e5c5151856abb413ff88ee4c79b779159aa76c690b4669b2a65fc16a14a7102"
Jul 17 17:24:58.604828 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:58.604723    2566 scope.go:117] "RemoveContainer" containerID="ae1b74da3d6c955b47289a0ae4dfe4100fe4398e6e9e12554804b2440dde63e8"
Jul 17 17:24:58.604980 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:24:58.604924    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-jjkgx_odh-ai-gateway-infra(6a2347e1-a3ba-47c3-8fda-763c9b0a65c8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx" podUID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8"
Jul 17 17:24:58.606693 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:58.606667    2566 generic.go:356] "Generic (PLEG): container finished" podID="3c91e562-d90e-463b-ade5-bd4eecb7e839" containerID="b6d5be6b0f060b0160a8fcd1be0d9777898f1d62be45f9cc74952e4f30373d57" exitCode=7
Jul 17 17:24:58.606815 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:58.606700    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8" event={"ID":"3c91e562-d90e-463b-ade5-bd4eecb7e839","Type":"ContainerDied","Data":"b6d5be6b0f060b0160a8fcd1be0d9777898f1d62be45f9cc74952e4f30373d57"}
Jul 17 17:24:58.606983 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:58.606966    2566 scope.go:117] "RemoveContainer" containerID="b6d5be6b0f060b0160a8fcd1be0d9777898f1d62be45f9cc74952e4f30373d57"
Jul 17 17:24:58.607175 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:24:58.607155    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8_odh-ai-gateway-infra(3c91e562-d90e-463b-ade5-bd4eecb7e839)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8" podUID="3c91e562-d90e-463b-ade5-bd4eecb7e839"
Jul 17 17:24:58.615921 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:58.615907    2566 scope.go:117] "RemoveContainer" containerID="b44ab71463e60ea02e081a3c33879e57c6338a54cce2e1f80994cbcb3325e307"
Jul 17 17:24:59.613556 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:59.613525    2566 scope.go:117] "RemoveContainer" containerID="ae1b74da3d6c955b47289a0ae4dfe4100fe4398e6e9e12554804b2440dde63e8"
Jul 17 17:24:59.614058 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:24:59.613736    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-jjkgx_odh-ai-gateway-infra(6a2347e1-a3ba-47c3-8fda-763c9b0a65c8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx" podUID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8"
Jul 17 17:24:59.615023 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:24:59.615004    2566 scope.go:117] "RemoveContainer" containerID="b6d5be6b0f060b0160a8fcd1be0d9777898f1d62be45f9cc74952e4f30373d57"
Jul 17 17:24:59.615177 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:24:59.615160    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8_odh-ai-gateway-infra(3c91e562-d90e-463b-ade5-bd4eecb7e839)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8" podUID="3c91e562-d90e-463b-ade5-bd4eecb7e839"
Jul 17 17:25:03.608908 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:03.608869    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf"]
Jul 17 17:25:03.619156 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:03.619113    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf"
Jul 17 17:25:03.623507 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:03.623475    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf"]
Jul 17 17:25:03.645049 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:03.645016    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c831176d-1499-4d5b-a5cd-f627716c1656-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf\" (UID: \"c831176d-1499-4d5b-a5cd-f627716c1656\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf"
Jul 17 17:25:03.746524 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:03.746475    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c831176d-1499-4d5b-a5cd-f627716c1656-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf\" (UID: \"c831176d-1499-4d5b-a5cd-f627716c1656\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf"
Jul 17 17:25:03.747341 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:03.747299    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c831176d-1499-4d5b-a5cd-f627716c1656-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf\" (UID: \"c831176d-1499-4d5b-a5cd-f627716c1656\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf"
Jul 17 17:25:03.933779 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:03.933689    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf"
Jul 17 17:25:04.074374 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:04.074349    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf"]
Jul 17 17:25:04.077083 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:25:04.077052    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc831176d_1499_4d5b_a5cd_f627716c1656.slice/crio-88b6dce6ac20eff3d52841cbab09fbaabd58176a744d1ebba823bc711355c7aa WatchSource:0}: Error finding container 88b6dce6ac20eff3d52841cbab09fbaabd58176a744d1ebba823bc711355c7aa: Status 404 returned error can't find the container with id 88b6dce6ac20eff3d52841cbab09fbaabd58176a744d1ebba823bc711355c7aa
Jul 17 17:25:04.646374 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:04.646250    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf" event={"ID":"c831176d-1499-4d5b-a5cd-f627716c1656","Type":"ContainerStarted","Data":"5ee038be83f7f67a1bf953cfc8e292b403e06c15d4073fc8a97f569975b596d2"}
Jul 17 17:25:04.646374 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:04.646337    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf" event={"ID":"c831176d-1499-4d5b-a5cd-f627716c1656","Type":"ContainerStarted","Data":"88b6dce6ac20eff3d52841cbab09fbaabd58176a744d1ebba823bc711355c7aa"}
Jul 17 17:25:04.664214 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:04.664158    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf" podStartSLOduration=1.66414105 podStartE2EDuration="1.66414105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:25:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:25:04.661688045 +0000 UTC m=+3553.520816621" watchObservedRunningTime="2026-07-17 17:25:04.66414105 +0000 UTC m=+3553.523269639"
Jul 17 17:25:05.652497 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:05.652463    2566 generic.go:356] "Generic (PLEG): container finished" podID="c831176d-1499-4d5b-a5cd-f627716c1656" containerID="5ee038be83f7f67a1bf953cfc8e292b403e06c15d4073fc8a97f569975b596d2" exitCode=7
Jul 17 17:25:05.652889 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:05.652547    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf" event={"ID":"c831176d-1499-4d5b-a5cd-f627716c1656","Type":"ContainerDied","Data":"5ee038be83f7f67a1bf953cfc8e292b403e06c15d4073fc8a97f569975b596d2"}
Jul 17 17:25:05.652889 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:05.652735    2566 scope.go:117] "RemoveContainer" containerID="5ee038be83f7f67a1bf953cfc8e292b403e06c15d4073fc8a97f569975b596d2"
Jul 17 17:25:06.659692 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:06.659606    2566 generic.go:356] "Generic (PLEG): container finished" podID="c831176d-1499-4d5b-a5cd-f627716c1656" containerID="7f093ea1b26b076f31421b976f576fd1b60de5f75eda230c9590c507daaa299c" exitCode=7
Jul 17 17:25:06.660097 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:06.659689    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf" event={"ID":"c831176d-1499-4d5b-a5cd-f627716c1656","Type":"ContainerDied","Data":"7f093ea1b26b076f31421b976f576fd1b60de5f75eda230c9590c507daaa299c"}
Jul 17 17:25:06.660097 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:06.659745    2566 scope.go:117] "RemoveContainer" containerID="5ee038be83f7f67a1bf953cfc8e292b403e06c15d4073fc8a97f569975b596d2"
Jul 17 17:25:06.660097 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:06.660027    2566 scope.go:117] "RemoveContainer" containerID="7f093ea1b26b076f31421b976f576fd1b60de5f75eda230c9590c507daaa299c"
Jul 17 17:25:06.660291 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:25:06.660267    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf_odh-ai-gateway-infra(c831176d-1499-4d5b-a5cd-f627716c1656)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf" podUID="c831176d-1499-4d5b-a5cd-f627716c1656"
Jul 17 17:25:07.511914 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.511876    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"]
Jul 17 17:25:07.516875 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.516852    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.519211 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.519191    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f1f5b638-openshift-default-dockercfg-z6j8k\""
Jul 17 17:25:07.526855 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.526779    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"]
Jul 17 17:25:07.580701 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.580670    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-podinfo\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.580701 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.580705    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-workload-certs\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.580885 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.580728    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-workload-socket\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.580885 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.580744    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-token\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.580885 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.580759    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szvxc\" (UniqueName: \"kubernetes.io/projected/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-kube-api-access-szvxc\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.580885 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.580777    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-envoy\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.580885 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.580849    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istiod-ca-cert\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.581071 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.580896    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-credential-socket\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.581071 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.580927    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-data\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.667835 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.667805    2566 scope.go:117] "RemoveContainer" containerID="7f093ea1b26b076f31421b976f576fd1b60de5f75eda230c9590c507daaa299c"
Jul 17 17:25:07.668196 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:25:07.668078    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf_odh-ai-gateway-infra(c831176d-1499-4d5b-a5cd-f627716c1656)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf" podUID="c831176d-1499-4d5b-a5cd-f627716c1656"
Jul 17 17:25:07.681615 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.681523    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istiod-ca-cert\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.681615 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.681608    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-credential-socket\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.681872 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.681651    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-data\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.681872 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.681734    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-podinfo\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.681872 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.681771    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-workload-certs\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.681872 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.681824    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-workload-socket\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.681872 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.681850    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-token\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.682137 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.681896    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szvxc\" (UniqueName: \"kubernetes.io/projected/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-kube-api-access-szvxc\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.682137 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.681922    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-envoy\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.682389 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.682365    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istiod-ca-cert\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.682817 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.682792    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-credential-socket\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.683067 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.683038    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-data\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.683224 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.683193    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-workload-certs\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.683357 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.683337    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-workload-socket\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.685415 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.685384    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-podinfo\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.685593 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.685573    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-envoy\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.690743 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.690717    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-token\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.691361 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.691338    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szvxc\" (UniqueName: \"kubernetes.io/projected/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-kube-api-access-szvxc\") pod \"e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") " pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.831373 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.831311    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:07.979676 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.979651    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"]
Jul 17 17:25:07.981577 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:25:07.981539    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5eaa1b8_b2b0_40ea_9704_161d01a98e5f.slice/crio-4b149996e8fa882816dda567f72ee0dc36d8e2a58611edd341b9f6e64d9d65f6 WatchSource:0}: Error finding container 4b149996e8fa882816dda567f72ee0dc36d8e2a58611edd341b9f6e64d9d65f6: Status 404 returned error can't find the container with id 4b149996e8fa882816dda567f72ee0dc36d8e2a58611edd341b9f6e64d9d65f6
Jul 17 17:25:07.984272 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.984236    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:25:07.984425 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.984314    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:25:07.984425 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:07.984396    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:25:08.684187 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:08.684142    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw" event={"ID":"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f","Type":"ContainerStarted","Data":"9f47a37160161b5bc75a80db0d08ab017836f39614d36774ac95971a385c5549"}
Jul 17 17:25:08.684758 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:08.684250    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw" event={"ID":"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f","Type":"ContainerStarted","Data":"4b149996e8fa882816dda567f72ee0dc36d8e2a58611edd341b9f6e64d9d65f6"}
Jul 17 17:25:08.705850 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:08.705800    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw" podStartSLOduration=1.705761688 podStartE2EDuration="1.705761688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:25:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:25:08.704547079 +0000 UTC m=+3557.563675637" watchObservedRunningTime="2026-07-17 17:25:08.705761688 +0000 UTC m=+3557.564890246"
Jul 17 17:25:08.831829 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:08.831788    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:09.837225 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:09.837192    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:10.026160 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:10.026134    2566 scope.go:117] "RemoveContainer" containerID="ae1b74da3d6c955b47289a0ae4dfe4100fe4398e6e9e12554804b2440dde63e8"
Jul 17 17:25:10.696443 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:10.696409    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx" event={"ID":"6a2347e1-a3ba-47c3-8fda-763c9b0a65c8","Type":"ContainerStarted","Data":"a264493ca0980ba244ef115272c03c7a8c2606f68d3c8d27da2e89f45f2e4095"}
Jul 17 17:25:10.696636 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:10.696619    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:10.697702 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:10.697683    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:11.026726 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:11.026633    2566 scope.go:117] "RemoveContainer" containerID="b6d5be6b0f060b0160a8fcd1be0d9777898f1d62be45f9cc74952e4f30373d57"
Jul 17 17:25:11.704108 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:11.704028    2566 generic.go:356] "Generic (PLEG): container finished" podID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8" containerID="a264493ca0980ba244ef115272c03c7a8c2606f68d3c8d27da2e89f45f2e4095" exitCode=7
Jul 17 17:25:11.704108 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:11.704099    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx" event={"ID":"6a2347e1-a3ba-47c3-8fda-763c9b0a65c8","Type":"ContainerDied","Data":"a264493ca0980ba244ef115272c03c7a8c2606f68d3c8d27da2e89f45f2e4095"}
Jul 17 17:25:11.704377 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:11.704160    2566 scope.go:117] "RemoveContainer" containerID="ae1b74da3d6c955b47289a0ae4dfe4100fe4398e6e9e12554804b2440dde63e8"
Jul 17 17:25:11.704498 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:11.704482    2566 scope.go:117] "RemoveContainer" containerID="a264493ca0980ba244ef115272c03c7a8c2606f68d3c8d27da2e89f45f2e4095"
Jul 17 17:25:11.705518 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:25:11.704746    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-jjkgx_odh-ai-gateway-infra(6a2347e1-a3ba-47c3-8fda-763c9b0a65c8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx" podUID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8"
Jul 17 17:25:11.706382 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:11.706359    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8" event={"ID":"3c91e562-d90e-463b-ade5-bd4eecb7e839","Type":"ContainerStarted","Data":"b2d447019ebc67b89dcb4a473eae37405ee6cdc6cdcd1eeea1297d58f8da1031"}
Jul 17 17:25:11.731271 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:11.731243    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx"]
Jul 17 17:25:11.744582 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:11.744545    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8" podStartSLOduration=16.7445337 podStartE2EDuration="16.7445337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:25:11.743845507 +0000 UTC m=+3560.602974067" watchObservedRunningTime="2026-07-17 17:25:11.7445337 +0000 UTC m=+3560.603662286"
Jul 17 17:25:12.717067 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:12.717034    2566 generic.go:356] "Generic (PLEG): container finished" podID="3c91e562-d90e-463b-ade5-bd4eecb7e839" containerID="b2d447019ebc67b89dcb4a473eae37405ee6cdc6cdcd1eeea1297d58f8da1031" exitCode=7
Jul 17 17:25:12.717503 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:12.717113    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8" event={"ID":"3c91e562-d90e-463b-ade5-bd4eecb7e839","Type":"ContainerDied","Data":"b2d447019ebc67b89dcb4a473eae37405ee6cdc6cdcd1eeea1297d58f8da1031"}
Jul 17 17:25:12.717503 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:12.717195    2566 scope.go:117] "RemoveContainer" containerID="b6d5be6b0f060b0160a8fcd1be0d9777898f1d62be45f9cc74952e4f30373d57"
Jul 17 17:25:12.717640 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:12.717593    2566 scope.go:117] "RemoveContainer" containerID="b2d447019ebc67b89dcb4a473eae37405ee6cdc6cdcd1eeea1297d58f8da1031"
Jul 17 17:25:12.717827 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:25:12.717802    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8_odh-ai-gateway-infra(3c91e562-d90e-463b-ade5-bd4eecb7e839)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8" podUID="3c91e562-d90e-463b-ade5-bd4eecb7e839"
Jul 17 17:25:12.760582 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:12.760542    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8"]
Jul 17 17:25:12.865568 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:12.865544    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx"
Jul 17 17:25:12.930659 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:12.930618    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a2347e1-a3ba-47c3-8fda-763c9b0a65c8-maas-api-service-ca\") pod \"6a2347e1-a3ba-47c3-8fda-763c9b0a65c8\" (UID: \"6a2347e1-a3ba-47c3-8fda-763c9b0a65c8\") "
Jul 17 17:25:12.931013 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:12.930987    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a2347e1-a3ba-47c3-8fda-763c9b0a65c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6a2347e1-a3ba-47c3-8fda-763c9b0a65c8" (UID: "6a2347e1-a3ba-47c3-8fda-763c9b0a65c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:25:13.031597 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:13.031564    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a2347e1-a3ba-47c3-8fda-763c9b0a65c8-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:25:13.728991 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:13.728951    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx" event={"ID":"6a2347e1-a3ba-47c3-8fda-763c9b0a65c8","Type":"ContainerDied","Data":"6beabf0f93c2789e4c16c11cffd5ff3a321bb039fc8eb914462348e9d568ac20"}
Jul 17 17:25:13.729625 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:13.729601    2566 scope.go:117] "RemoveContainer" containerID="a264493ca0980ba244ef115272c03c7a8c2606f68d3c8d27da2e89f45f2e4095"
Jul 17 17:25:13.729714 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:13.729355    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx"
Jul 17 17:25:13.748871 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:13.748845    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx"]
Jul 17 17:25:13.751947 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:13.751925    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-jjkgx"]
Jul 17 17:25:13.920346 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:13.906572    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8"
Jul 17 17:25:13.941033 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:13.940990    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c91e562-d90e-463b-ade5-bd4eecb7e839-maas-api-service-ca\") pod \"3c91e562-d90e-463b-ade5-bd4eecb7e839\" (UID: \"3c91e562-d90e-463b-ade5-bd4eecb7e839\") "
Jul 17 17:25:13.941600 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:13.941549    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c91e562-d90e-463b-ade5-bd4eecb7e839-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3c91e562-d90e-463b-ade5-bd4eecb7e839" (UID: "3c91e562-d90e-463b-ade5-bd4eecb7e839"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:25:14.042635 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:14.042607    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c91e562-d90e-463b-ade5-bd4eecb7e839-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:25:14.742741 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:14.742660    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8"
Jul 17 17:25:14.743176 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:14.742657    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8" event={"ID":"3c91e562-d90e-463b-ade5-bd4eecb7e839","Type":"ContainerDied","Data":"4f46178666cf2faa4ba19ab501a25b575802ab6375774cb58ea4b848e2c1a324"}
Jul 17 17:25:14.743176 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:14.742803    2566 scope.go:117] "RemoveContainer" containerID="b2d447019ebc67b89dcb4a473eae37405ee6cdc6cdcd1eeea1297d58f8da1031"
Jul 17 17:25:14.767257 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:14.767227    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8"]
Jul 17 17:25:14.771857 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:14.771835    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bxsg8"]
Jul 17 17:25:15.035586 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:15.035543    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c91e562-d90e-463b-ade5-bd4eecb7e839" path="/var/lib/kubelet/pods/3c91e562-d90e-463b-ade5-bd4eecb7e839/volumes"
Jul 17 17:25:15.036031 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:15.036008    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8" path="/var/lib/kubelet/pods/6a2347e1-a3ba-47c3-8fda-763c9b0a65c8/volumes"
Jul 17 17:25:20.777773 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:20.777740    2566 generic.go:356] "Generic (PLEG): container finished" podID="d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" containerID="9f47a37160161b5bc75a80db0d08ab017836f39614d36774ac95971a385c5549" exitCode=0
Jul 17 17:25:20.778299 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:20.777821    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw" event={"ID":"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f","Type":"ContainerDied","Data":"9f47a37160161b5bc75a80db0d08ab017836f39614d36774ac95971a385c5549"}
Jul 17 17:25:20.778414 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:20.778356    2566 scope.go:117] "RemoveContainer" containerID="9f47a37160161b5bc75a80db0d08ab017836f39614d36774ac95971a385c5549"
Jul 17 17:25:20.779418 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:20.779390    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:25:20.779490 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:20.779457    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:25:20.779526 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:20.779501    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:25:21.785199 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:21.785161    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw" event={"ID":"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f","Type":"ContainerStarted","Data":"f7ab29144e4c79cd34057ec959109ee74e626bc28f7a7970267b3bba07edab34"}
Jul 17 17:25:21.831942 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:21.831906    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:21.832985 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:21.832954    2566 patch_prober.go:28] interesting pod/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 17 17:25:21.833121 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:21.833012    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw" podUID="d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 17 17:25:22.026551 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:22.026514    2566 scope.go:117] "RemoveContainer" containerID="7f093ea1b26b076f31421b976f576fd1b60de5f75eda230c9590c507daaa299c"
Jul 17 17:25:22.792527 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:22.792493    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf" event={"ID":"c831176d-1499-4d5b-a5cd-f627716c1656","Type":"ContainerStarted","Data":"ab1975fa28339362c8e575d79e52ee43fc1ee7088e6775a5d1c7ffe6ab1b6a79"}
Jul 17 17:25:22.832559 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:22.832525    2566 patch_prober.go:28] interesting pod/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 17 17:25:22.832731 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:22.832582    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw" podUID="d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 17 17:25:23.799153 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:23.799119    2566 generic.go:356] "Generic (PLEG): container finished" podID="c831176d-1499-4d5b-a5cd-f627716c1656" containerID="ab1975fa28339362c8e575d79e52ee43fc1ee7088e6775a5d1c7ffe6ab1b6a79" exitCode=7
Jul 17 17:25:23.799663 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:23.799186    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf" event={"ID":"c831176d-1499-4d5b-a5cd-f627716c1656","Type":"ContainerDied","Data":"ab1975fa28339362c8e575d79e52ee43fc1ee7088e6775a5d1c7ffe6ab1b6a79"}
Jul 17 17:25:23.799663 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:23.799249    2566 scope.go:117] "RemoveContainer" containerID="7f093ea1b26b076f31421b976f576fd1b60de5f75eda230c9590c507daaa299c"
Jul 17 17:25:23.799663 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:23.799537    2566 scope.go:117] "RemoveContainer" containerID="ab1975fa28339362c8e575d79e52ee43fc1ee7088e6775a5d1c7ffe6ab1b6a79"
Jul 17 17:25:23.799837 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:25:23.799818    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf_odh-ai-gateway-infra(c831176d-1499-4d5b-a5cd-f627716c1656)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf" podUID="c831176d-1499-4d5b-a5cd-f627716c1656"
Jul 17 17:25:23.825527 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:23.825486    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf"]
Jul 17 17:25:23.832024 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:23.831990    2566 patch_prober.go:28] interesting pod/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 17 17:25:23.832217 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:23.832042    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw" podUID="d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 17 17:25:24.831978 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:24.831938    2566 patch_prober.go:28] interesting pod/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 17 17:25:24.832476 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:24.831995    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw" podUID="d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 17 17:25:24.984555 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:24.984531    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf"
Jul 17 17:25:25.047359 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:25.047304    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c831176d-1499-4d5b-a5cd-f627716c1656-maas-api-service-ca\") pod \"c831176d-1499-4d5b-a5cd-f627716c1656\" (UID: \"c831176d-1499-4d5b-a5cd-f627716c1656\") "
Jul 17 17:25:25.047607 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:25.047584    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c831176d-1499-4d5b-a5cd-f627716c1656-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c831176d-1499-4d5b-a5cd-f627716c1656" (UID: "c831176d-1499-4d5b-a5cd-f627716c1656"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:25:25.047694 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:25.047657    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c831176d-1499-4d5b-a5cd-f627716c1656-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:25:25.697061 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:25.697030    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:25.816922 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:25.816886    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf" event={"ID":"c831176d-1499-4d5b-a5cd-f627716c1656","Type":"ContainerDied","Data":"88b6dce6ac20eff3d52841cbab09fbaabd58176a744d1ebba823bc711355c7aa"}
Jul 17 17:25:25.816922 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:25.816905    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf"
Jul 17 17:25:25.817131 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:25.816938    2566 scope.go:117] "RemoveContainer" containerID="ab1975fa28339362c8e575d79e52ee43fc1ee7088e6775a5d1c7ffe6ab1b6a79"
Jul 17 17:25:25.835521 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:25.835497    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:25.836480 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:25.836463    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:25.870001 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:25.869979    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf"]
Jul 17 17:25:25.878108 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:25.878076    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-8hfjf"]
Jul 17 17:25:27.031956 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:27.031921    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c831176d-1499-4d5b-a5cd-f627716c1656" path="/var/lib/kubelet/pods/c831176d-1499-4d5b-a5cd-f627716c1656/volumes"
Jul 17 17:25:43.588809 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:43.588726    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"]
Jul 17 17:25:43.589426 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:43.588986    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw" podUID="d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" containerName="istio-proxy" containerID="cri-o://f7ab29144e4c79cd34057ec959109ee74e626bc28f7a7970267b3bba07edab34" gracePeriod=30
Jul 17 17:25:48.849579 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.849553    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:48.941136 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.941059    2566 generic.go:356] "Generic (PLEG): container finished" podID="d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" containerID="f7ab29144e4c79cd34057ec959109ee74e626bc28f7a7970267b3bba07edab34" exitCode=0
Jul 17 17:25:48.941136 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.941110    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"
Jul 17 17:25:48.941344 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.941146    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw" event={"ID":"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f","Type":"ContainerDied","Data":"f7ab29144e4c79cd34057ec959109ee74e626bc28f7a7970267b3bba07edab34"}
Jul 17 17:25:48.941344 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.941204    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw" event={"ID":"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f","Type":"ContainerDied","Data":"4b149996e8fa882816dda567f72ee0dc36d8e2a58611edd341b9f6e64d9d65f6"}
Jul 17 17:25:48.941344 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.941235    2566 scope.go:117] "RemoveContainer" containerID="f7ab29144e4c79cd34057ec959109ee74e626bc28f7a7970267b3bba07edab34"
Jul 17 17:25:48.949682 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.949666    2566 scope.go:117] "RemoveContainer" containerID="9f47a37160161b5bc75a80db0d08ab017836f39614d36774ac95971a385c5549"
Jul 17 17:25:48.952877 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.952852    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istiod-ca-cert\") pod \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") "
Jul 17 17:25:48.952979 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.952929    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-token\") pod \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") "
Jul 17 17:25:48.952979 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.952969    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-workload-certs\") pod \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") "
Jul 17 17:25:48.953076 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.953011    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-workload-socket\") pod \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") "
Jul 17 17:25:48.953076 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.953059    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-podinfo\") pod \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") "
Jul 17 17:25:48.953170 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.953091    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-credential-socket\") pod \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") "
Jul 17 17:25:48.953170 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.953137    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-envoy\") pod \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") "
Jul 17 17:25:48.953170 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.953150    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" (UID: "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:25:48.953359 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.953173    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szvxc\" (UniqueName: \"kubernetes.io/projected/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-kube-api-access-szvxc\") pod \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") "
Jul 17 17:25:48.953359 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.953207    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-data\") pod \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\" (UID: \"d5eaa1b8-b2b0-40ea-9704-161d01a98e5f\") "
Jul 17 17:25:48.953469 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.953364    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" (UID: "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:25:48.953469 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.953445    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" (UID: "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:25:48.953577 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.953512    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" (UID: "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:25:48.953633 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.953602    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-workload-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:25:48.953633 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.953623    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-credential-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:25:48.953731 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.953637    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istiod-ca-cert\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:25:48.954092 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.954060    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-data" (OuterVolumeSpecName: "istio-data") pod "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" (UID: "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:25:48.955643 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.955607    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-token" (OuterVolumeSpecName: "istio-token") pod "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" (UID: "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:25:48.955732 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.955644    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-kube-api-access-szvxc" (OuterVolumeSpecName: "kube-api-access-szvxc") pod "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" (UID: "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f"). InnerVolumeSpecName "kube-api-access-szvxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:25:48.955896 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.955873    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" (UID: "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 17:25:48.955956 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.955935    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" (UID: "d5eaa1b8-b2b0-40ea-9704-161d01a98e5f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:25:48.959016 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.959001    2566 scope.go:117] "RemoveContainer" containerID="f7ab29144e4c79cd34057ec959109ee74e626bc28f7a7970267b3bba07edab34"
Jul 17 17:25:48.959297 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:25:48.959279    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7ab29144e4c79cd34057ec959109ee74e626bc28f7a7970267b3bba07edab34\": container with ID starting with f7ab29144e4c79cd34057ec959109ee74e626bc28f7a7970267b3bba07edab34 not found: ID does not exist" containerID="f7ab29144e4c79cd34057ec959109ee74e626bc28f7a7970267b3bba07edab34"
Jul 17 17:25:48.959400 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.959308    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7ab29144e4c79cd34057ec959109ee74e626bc28f7a7970267b3bba07edab34"} err="failed to get container status \"f7ab29144e4c79cd34057ec959109ee74e626bc28f7a7970267b3bba07edab34\": rpc error: code = NotFound desc = could not find container \"f7ab29144e4c79cd34057ec959109ee74e626bc28f7a7970267b3bba07edab34\": container with ID starting with f7ab29144e4c79cd34057ec959109ee74e626bc28f7a7970267b3bba07edab34 not found: ID does not exist"
Jul 17 17:25:48.959400 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.959348    2566 scope.go:117] "RemoveContainer" containerID="9f47a37160161b5bc75a80db0d08ab017836f39614d36774ac95971a385c5549"
Jul 17 17:25:48.959642 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:25:48.959622    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f47a37160161b5bc75a80db0d08ab017836f39614d36774ac95971a385c5549\": container with ID starting with 9f47a37160161b5bc75a80db0d08ab017836f39614d36774ac95971a385c5549 not found: ID does not exist" containerID="9f47a37160161b5bc75a80db0d08ab017836f39614d36774ac95971a385c5549"
Jul 17 17:25:48.959689 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:48.959649    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f47a37160161b5bc75a80db0d08ab017836f39614d36774ac95971a385c5549"} err="failed to get container status \"9f47a37160161b5bc75a80db0d08ab017836f39614d36774ac95971a385c5549\": rpc error: code = NotFound desc = could not find container \"9f47a37160161b5bc75a80db0d08ab017836f39614d36774ac95971a385c5549\": container with ID starting with 9f47a37160161b5bc75a80db0d08ab017836f39614d36774ac95971a385c5549 not found: ID does not exist"
Jul 17 17:25:49.054827 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:49.054805    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-token\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:25:49.054827 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:49.054828    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-workload-certs\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:25:49.054970 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:49.054842    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-podinfo\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:25:49.054970 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:49.054854    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-envoy\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:25:49.054970 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:49.054866    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szvxc\" (UniqueName: \"kubernetes.io/projected/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-kube-api-access-szvxc\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:25:49.054970 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:49.054878    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f-istio-data\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:25:49.261382 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:49.261352    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"]
Jul 17 17:25:49.265344 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:49.265297    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f1f5b638-openshift-default-978cb6bff-zvwsw"]
Jul 17 17:25:51.031989 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:51.031953    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" path="/var/lib/kubelet/pods/d5eaa1b8-b2b0-40ea-9704-161d01a98e5f/volumes"
Jul 17 17:25:53.182573 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:53.182549    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:25:53.191161 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:25:53.191135    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:26:03.128907 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.128862    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"]
Jul 17 17:26:03.129289 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129236    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c91e562-d90e-463b-ade5-bd4eecb7e839" containerName="revoke-keys"
Jul 17 17:26:03.129289 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129256    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c91e562-d90e-463b-ade5-bd4eecb7e839" containerName="revoke-keys"
Jul 17 17:26:03.129289 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129265    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8" containerName="revoke-keys"
Jul 17 17:26:03.129289 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129271    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8" containerName="revoke-keys"
Jul 17 17:26:03.129289 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129278    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" containerName="istio-proxy"
Jul 17 17:26:03.129289 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129285    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" containerName="istio-proxy"
Jul 17 17:26:03.129289 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129293    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129298    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129308    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c831176d-1499-4d5b-a5cd-f627716c1656" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129313    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c831176d-1499-4d5b-a5cd-f627716c1656" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129338    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c91e562-d90e-463b-ade5-bd4eecb7e839" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129343    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c91e562-d90e-463b-ade5-bd4eecb7e839" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129352    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c831176d-1499-4d5b-a5cd-f627716c1656" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129356    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c831176d-1499-4d5b-a5cd-f627716c1656" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129364    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c91e562-d90e-463b-ade5-bd4eecb7e839" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129370    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c91e562-d90e-463b-ade5-bd4eecb7e839" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129432    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c91e562-d90e-463b-ade5-bd4eecb7e839" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129440    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c831176d-1499-4d5b-a5cd-f627716c1656" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129446    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129452    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c91e562-d90e-463b-ade5-bd4eecb7e839" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129457    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c831176d-1499-4d5b-a5cd-f627716c1656" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129462    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8" containerName="revoke-keys"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129466    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" containerName="istio-proxy"
Jul 17 17:26:03.129531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.129474    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" containerName="istio-proxy"
Jul 17 17:26:03.134136 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.134119    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.136539 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.136519    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9777fc6b-openshift-default-dockercfg-g24j4\""
Jul 17 17:26:03.150828 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.150803    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"]
Jul 17 17:26:03.175500 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.175477    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-istio-data\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.175610 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.175527    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjftx\" (UniqueName: \"kubernetes.io/projected/48c9be24-f441-4777-ba68-828cbd2debee-kube-api-access-cjftx\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.175610 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.175550    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-credential-socket\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.175684 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.175627    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48c9be24-f441-4777-ba68-828cbd2debee-istiod-ca-cert\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.175684 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.175661    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-istio-envoy\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.175751 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.175682    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-workload-socket\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.175751 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.175707    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48c9be24-f441-4777-ba68-828cbd2debee-istio-token\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.175751 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.175728    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48c9be24-f441-4777-ba68-828cbd2debee-istio-podinfo\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.175751 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.175748    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-workload-certs\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.276626 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.276590    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjftx\" (UniqueName: \"kubernetes.io/projected/48c9be24-f441-4777-ba68-828cbd2debee-kube-api-access-cjftx\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.276626 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.276629    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-credential-socket\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.276849 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.276680    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48c9be24-f441-4777-ba68-828cbd2debee-istiod-ca-cert\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.276849 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.276707    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-istio-envoy\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.276849 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.276735    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-workload-socket\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.276849 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.276757    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48c9be24-f441-4777-ba68-828cbd2debee-istio-token\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.277058 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.276903    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48c9be24-f441-4777-ba68-828cbd2debee-istio-podinfo\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.277058 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.276958    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-workload-certs\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.277058 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.277033    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-istio-data\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.277264 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.277238    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-credential-socket\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.277375 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.277277    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-workload-socket\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.277375 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.277344    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-workload-certs\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.277510 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.277471    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-istio-data\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.277566 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.277547    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48c9be24-f441-4777-ba68-828cbd2debee-istiod-ca-cert\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.279555 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.279527    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-istio-envoy\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.279653 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.279637    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48c9be24-f441-4777-ba68-828cbd2debee-istio-podinfo\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.284557 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.284534    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48c9be24-f441-4777-ba68-828cbd2debee-istio-token\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.284738 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.284721    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjftx\" (UniqueName: \"kubernetes.io/projected/48c9be24-f441-4777-ba68-828cbd2debee-kube-api-access-cjftx\") pod \"e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") " pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.444560 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.444477    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:03.582953 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.582922    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"]
Jul 17 17:26:03.584670 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:26:03.584637    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48c9be24_f441_4777_ba68_828cbd2debee.slice/crio-66618303d1f3ba5bcbd4ce06ef97f3ae1fbb1b3ef95e2095670c91dafc1bb430 WatchSource:0}: Error finding container 66618303d1f3ba5bcbd4ce06ef97f3ae1fbb1b3ef95e2095670c91dafc1bb430: Status 404 returned error can't find the container with id 66618303d1f3ba5bcbd4ce06ef97f3ae1fbb1b3ef95e2095670c91dafc1bb430
Jul 17 17:26:03.587204 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.587173    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:26:03.587290 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.587232    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:26:03.587290 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.587262    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:26:03.658949 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.658920    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j"]
Jul 17 17:26:03.659543 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.659527    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c831176d-1499-4d5b-a5cd-f627716c1656" containerName="revoke-keys"
Jul 17 17:26:03.659642 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.659545    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c831176d-1499-4d5b-a5cd-f627716c1656" containerName="revoke-keys"
Jul 17 17:26:03.659642 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.659581    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" containerName="istio-proxy"
Jul 17 17:26:03.659642 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.659591    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5eaa1b8-b2b0-40ea-9704-161d01a98e5f" containerName="istio-proxy"
Jul 17 17:26:03.659642 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.659606    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8" containerName="revoke-keys"
Jul 17 17:26:03.659642 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.659614    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8" containerName="revoke-keys"
Jul 17 17:26:03.659916 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.659702    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c91e562-d90e-463b-ade5-bd4eecb7e839" containerName="revoke-keys"
Jul 17 17:26:03.659916 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.659714    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c831176d-1499-4d5b-a5cd-f627716c1656" containerName="revoke-keys"
Jul 17 17:26:03.659916 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.659723    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a2347e1-a3ba-47c3-8fda-763c9b0a65c8" containerName="revoke-keys"
Jul 17 17:26:03.675766 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.675725    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j"]
Jul 17 17:26:03.675957 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.675836    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j"
Jul 17 17:26:03.678291 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.678270    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:26:03.678505 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.678329    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:26:03.780422 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.780391    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7114bea0-dae5-49ee-99ce-dbdff8e5a806-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j\" (UID: \"7114bea0-dae5-49ee-99ce-dbdff8e5a806\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j"
Jul 17 17:26:03.881641 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.881611    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7114bea0-dae5-49ee-99ce-dbdff8e5a806-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j\" (UID: \"7114bea0-dae5-49ee-99ce-dbdff8e5a806\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j"
Jul 17 17:26:03.882170 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.882151    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7114bea0-dae5-49ee-99ce-dbdff8e5a806-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j\" (UID: \"7114bea0-dae5-49ee-99ce-dbdff8e5a806\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j"
Jul 17 17:26:03.991333 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:03.991289    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j"
Jul 17 17:26:04.020455 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:04.020419    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6" event={"ID":"48c9be24-f441-4777-ba68-828cbd2debee","Type":"ContainerStarted","Data":"9bdb4202475958dc0432d2bd78018259029355cf9bc3c39dbff3462ae7c73d06"}
Jul 17 17:26:04.020596 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:04.020489    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6" event={"ID":"48c9be24-f441-4777-ba68-828cbd2debee","Type":"ContainerStarted","Data":"66618303d1f3ba5bcbd4ce06ef97f3ae1fbb1b3ef95e2095670c91dafc1bb430"}
Jul 17 17:26:04.057732 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:04.057681    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6" podStartSLOduration=1.057662383 podStartE2EDuration="1.057662383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:26:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:26:04.057095076 +0000 UTC m=+3612.916223636" watchObservedRunningTime="2026-07-17 17:26:04.057662383 +0000 UTC m=+3612.916790943"
Jul 17 17:26:04.123760 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:04.123732    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j"]
Jul 17 17:26:04.125820 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:26:04.125794    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7114bea0_dae5_49ee_99ce_dbdff8e5a806.slice/crio-044cb0aa83123e2ff55a0c315ba070c95c78981506870e60d7e87ed03edd49ae WatchSource:0}: Error finding container 044cb0aa83123e2ff55a0c315ba070c95c78981506870e60d7e87ed03edd49ae: Status 404 returned error can't find the container with id 044cb0aa83123e2ff55a0c315ba070c95c78981506870e60d7e87ed03edd49ae
Jul 17 17:26:04.445541 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:04.445509    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:04.450396 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:04.450375    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:05.027510 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:05.027478    2566 generic.go:356] "Generic (PLEG): container finished" podID="7114bea0-dae5-49ee-99ce-dbdff8e5a806" containerID="7f38d3d660eee4a57e4bcfba95796373158723e8e2eb8f4a47f187bb919d03f5" exitCode=7
Jul 17 17:26:05.027860 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:05.027842    2566 scope.go:117] "RemoveContainer" containerID="7f38d3d660eee4a57e4bcfba95796373158723e8e2eb8f4a47f187bb919d03f5"
Jul 17 17:26:05.033363 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:05.033344    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:05.033431 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:05.033393    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j" event={"ID":"7114bea0-dae5-49ee-99ce-dbdff8e5a806","Type":"ContainerDied","Data":"7f38d3d660eee4a57e4bcfba95796373158723e8e2eb8f4a47f187bb919d03f5"}
Jul 17 17:26:05.033431 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:05.033423    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j" event={"ID":"7114bea0-dae5-49ee-99ce-dbdff8e5a806","Type":"ContainerStarted","Data":"044cb0aa83123e2ff55a0c315ba070c95c78981506870e60d7e87ed03edd49ae"}
Jul 17 17:26:05.033501 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:05.033480    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:06.033642 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:06.033612    2566 generic.go:356] "Generic (PLEG): container finished" podID="7114bea0-dae5-49ee-99ce-dbdff8e5a806" containerID="48d8aea81456b9ee4bd48a73a61c064be537f5d2b11ca8cdb00fdadda97c8e18" exitCode=7
Jul 17 17:26:06.034016 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:06.033696    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j" event={"ID":"7114bea0-dae5-49ee-99ce-dbdff8e5a806","Type":"ContainerDied","Data":"48d8aea81456b9ee4bd48a73a61c064be537f5d2b11ca8cdb00fdadda97c8e18"}
Jul 17 17:26:06.034016 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:06.033752    2566 scope.go:117] "RemoveContainer" containerID="7f38d3d660eee4a57e4bcfba95796373158723e8e2eb8f4a47f187bb919d03f5"
Jul 17 17:26:06.034016 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:06.033804    2566 scope.go:117] "RemoveContainer" containerID="48d8aea81456b9ee4bd48a73a61c064be537f5d2b11ca8cdb00fdadda97c8e18"
Jul 17 17:26:06.034016 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:26:06.033995    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j_odh-ai-gateway-infra(7114bea0-dae5-49ee-99ce-dbdff8e5a806)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j" podUID="7114bea0-dae5-49ee-99ce-dbdff8e5a806"
Jul 17 17:26:07.039883 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:07.039850    2566 scope.go:117] "RemoveContainer" containerID="48d8aea81456b9ee4bd48a73a61c064be537f5d2b11ca8cdb00fdadda97c8e18"
Jul 17 17:26:07.040347 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:26:07.040051    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j_odh-ai-gateway-infra(7114bea0-dae5-49ee-99ce-dbdff8e5a806)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j" podUID="7114bea0-dae5-49ee-99ce-dbdff8e5a806"
Jul 17 17:26:18.025942 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:18.025910    2566 scope.go:117] "RemoveContainer" containerID="48d8aea81456b9ee4bd48a73a61c064be537f5d2b11ca8cdb00fdadda97c8e18"
Jul 17 17:26:19.096228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:19.096147    2566 generic.go:356] "Generic (PLEG): container finished" podID="7114bea0-dae5-49ee-99ce-dbdff8e5a806" containerID="31cdeec58023f703fc48b719411d3428bc8925b1c4c5901559890d5f9e1c365b" exitCode=7
Jul 17 17:26:19.096228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:19.096215    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j" event={"ID":"7114bea0-dae5-49ee-99ce-dbdff8e5a806","Type":"ContainerDied","Data":"31cdeec58023f703fc48b719411d3428bc8925b1c4c5901559890d5f9e1c365b"}
Jul 17 17:26:19.096735 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:19.096272    2566 scope.go:117] "RemoveContainer" containerID="48d8aea81456b9ee4bd48a73a61c064be537f5d2b11ca8cdb00fdadda97c8e18"
Jul 17 17:26:19.096735 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:19.096616    2566 scope.go:117] "RemoveContainer" containerID="31cdeec58023f703fc48b719411d3428bc8925b1c4c5901559890d5f9e1c365b"
Jul 17 17:26:19.096901 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:26:19.096878    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j_odh-ai-gateway-infra(7114bea0-dae5-49ee-99ce-dbdff8e5a806)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j" podUID="7114bea0-dae5-49ee-99ce-dbdff8e5a806"
Jul 17 17:26:20.148199 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:20.148166    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j"]
Jul 17 17:26:20.178384 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:20.178241    2566 patch_prober.go:28] interesting pod/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:58318->10.132.0.56:15021: read: connection reset by peer" start-of-body=
Jul 17 17:26:20.178384 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:20.178313    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6" podUID="48c9be24-f441-4777-ba68-828cbd2debee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:58318->10.132.0.56:15021: read: connection reset by peer"
Jul 17 17:26:20.289491 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:20.289467    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j"
Jul 17 17:26:20.327078 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:20.327050    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7114bea0-dae5-49ee-99ce-dbdff8e5a806-maas-api-service-ca\") pod \"7114bea0-dae5-49ee-99ce-dbdff8e5a806\" (UID: \"7114bea0-dae5-49ee-99ce-dbdff8e5a806\") "
Jul 17 17:26:20.327405 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:20.327383    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7114bea0-dae5-49ee-99ce-dbdff8e5a806-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7114bea0-dae5-49ee-99ce-dbdff8e5a806" (UID: "7114bea0-dae5-49ee-99ce-dbdff8e5a806"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:26:20.427908 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:20.427824    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7114bea0-dae5-49ee-99ce-dbdff8e5a806-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:26:21.110165 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:21.110141    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j"
Jul 17 17:26:21.110368 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:21.110180    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j" event={"ID":"7114bea0-dae5-49ee-99ce-dbdff8e5a806","Type":"ContainerDied","Data":"044cb0aa83123e2ff55a0c315ba070c95c78981506870e60d7e87ed03edd49ae"}
Jul 17 17:26:21.110368 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:21.110245    2566 scope.go:117] "RemoveContainer" containerID="31cdeec58023f703fc48b719411d3428bc8925b1c4c5901559890d5f9e1c365b"
Jul 17 17:26:21.112335 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:21.112130    2566 generic.go:356] "Generic (PLEG): container finished" podID="48c9be24-f441-4777-ba68-828cbd2debee" containerID="9bdb4202475958dc0432d2bd78018259029355cf9bc3c39dbff3462ae7c73d06" exitCode=0
Jul 17 17:26:21.112335 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:21.112179    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6" event={"ID":"48c9be24-f441-4777-ba68-828cbd2debee","Type":"ContainerDied","Data":"9bdb4202475958dc0432d2bd78018259029355cf9bc3c39dbff3462ae7c73d06"}
Jul 17 17:26:21.112640 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:21.112616    2566 scope.go:117] "RemoveContainer" containerID="9bdb4202475958dc0432d2bd78018259029355cf9bc3c39dbff3462ae7c73d06"
Jul 17 17:26:21.113769 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:21.113739    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:26:21.113859 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:21.113822    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:26:21.113859 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:21.113856    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:26:21.126314 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:21.126291    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j"]
Jul 17 17:26:21.129895 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:21.129872    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pg7j"]
Jul 17 17:26:22.124777 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:22.124732    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6" event={"ID":"48c9be24-f441-4777-ba68-828cbd2debee","Type":"ContainerStarted","Data":"26a2d5e51f756432dbd734ba4fb7a396ad0f5b4192f4ac52673cbc4226c7ba55"}
Jul 17 17:26:22.444765 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:22.444677    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:22.444924 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:22.444901    2566 patch_prober.go:28] interesting pod/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 17:26:22.444967 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:22.444948    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6" podUID="48c9be24-f441-4777-ba68-828cbd2debee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 17:26:23.033072 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:23.033038    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7114bea0-dae5-49ee-99ce-dbdff8e5a806" path="/var/lib/kubelet/pods/7114bea0-dae5-49ee-99ce-dbdff8e5a806/volumes"
Jul 17 17:26:23.445119 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:23.445038    2566 patch_prober.go:28] interesting pod/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 17:26:23.445119 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:23.445095    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6" podUID="48c9be24-f441-4777-ba68-828cbd2debee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 17:26:24.444918 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:24.444888    2566 patch_prober.go:28] interesting pod/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 17:26:24.445094 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:24.444947    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6" podUID="48c9be24-f441-4777-ba68-828cbd2debee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 17:26:25.445162 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:25.445125    2566 patch_prober.go:28] interesting pod/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 17:26:25.445594 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:25.445181    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6" podUID="48c9be24-f441-4777-ba68-828cbd2debee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 17:26:26.448568 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:26.448532    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:26.449005 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:26.448804    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:26.449493 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:26.449478    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:26:36.264169 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.264134    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx"]
Jul 17 17:26:36.264581 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.264525    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7114bea0-dae5-49ee-99ce-dbdff8e5a806" containerName="revoke-keys"
Jul 17 17:26:36.264581 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.264535    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7114bea0-dae5-49ee-99ce-dbdff8e5a806" containerName="revoke-keys"
Jul 17 17:26:36.264581 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.264559    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7114bea0-dae5-49ee-99ce-dbdff8e5a806" containerName="revoke-keys"
Jul 17 17:26:36.264581 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.264565    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7114bea0-dae5-49ee-99ce-dbdff8e5a806" containerName="revoke-keys"
Jul 17 17:26:36.264581 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.264574    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7114bea0-dae5-49ee-99ce-dbdff8e5a806" containerName="revoke-keys"
Jul 17 17:26:36.264581 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.264579    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7114bea0-dae5-49ee-99ce-dbdff8e5a806" containerName="revoke-keys"
Jul 17 17:26:36.264774 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.264639    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7114bea0-dae5-49ee-99ce-dbdff8e5a806" containerName="revoke-keys"
Jul 17 17:26:36.264774 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.264648    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7114bea0-dae5-49ee-99ce-dbdff8e5a806" containerName="revoke-keys"
Jul 17 17:26:36.267502 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.267486    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx"
Jul 17 17:26:36.269775 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.269751    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:26:36.269889 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.269798    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:26:36.275346 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.275304    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx"]
Jul 17 17:26:36.372291 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.372259    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b9db0ab-38f3-4037-a1b6-23926a4b7153-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx\" (UID: \"4b9db0ab-38f3-4037-a1b6-23926a4b7153\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx"
Jul 17 17:26:36.473005 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.472971    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b9db0ab-38f3-4037-a1b6-23926a4b7153-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx\" (UID: \"4b9db0ab-38f3-4037-a1b6-23926a4b7153\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx"
Jul 17 17:26:36.473637 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.473618    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b9db0ab-38f3-4037-a1b6-23926a4b7153-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx\" (UID: \"4b9db0ab-38f3-4037-a1b6-23926a4b7153\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx"
Jul 17 17:26:36.579072 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.579045    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx"
Jul 17 17:26:36.710362 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:36.710303    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx"]
Jul 17 17:26:36.712090 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:26:36.712056    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9db0ab_38f3_4037_a1b6_23926a4b7153.slice/crio-a0205f2f2f9ea128ef97d7f8e48919b24e4ace5a569cc99b52da65e5a3472d39 WatchSource:0}: Error finding container a0205f2f2f9ea128ef97d7f8e48919b24e4ace5a569cc99b52da65e5a3472d39: Status 404 returned error can't find the container with id a0205f2f2f9ea128ef97d7f8e48919b24e4ace5a569cc99b52da65e5a3472d39
Jul 17 17:26:37.205060 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:37.204976    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx" event={"ID":"4b9db0ab-38f3-4037-a1b6-23926a4b7153","Type":"ContainerStarted","Data":"81bbba6a5bc14c20420928352d8b20ecb5c76bbe788afab289a16f70ab92f1aa"}
Jul 17 17:26:37.205060 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:37.205028    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx" event={"ID":"4b9db0ab-38f3-4037-a1b6-23926a4b7153","Type":"ContainerStarted","Data":"a0205f2f2f9ea128ef97d7f8e48919b24e4ace5a569cc99b52da65e5a3472d39"}
Jul 17 17:26:37.220498 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:37.220437    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx" podStartSLOduration=1.220420992 podStartE2EDuration="1.220420992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:26:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:26:37.219379362 +0000 UTC m=+3646.078507922" watchObservedRunningTime="2026-07-17 17:26:37.220420992 +0000 UTC m=+3646.079549551"
Jul 17 17:26:38.211777 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:38.211747    2566 generic.go:356] "Generic (PLEG): container finished" podID="4b9db0ab-38f3-4037-a1b6-23926a4b7153" containerID="81bbba6a5bc14c20420928352d8b20ecb5c76bbe788afab289a16f70ab92f1aa" exitCode=7
Jul 17 17:26:38.212352 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:38.211805    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx" event={"ID":"4b9db0ab-38f3-4037-a1b6-23926a4b7153","Type":"ContainerDied","Data":"81bbba6a5bc14c20420928352d8b20ecb5c76bbe788afab289a16f70ab92f1aa"}
Jul 17 17:26:38.212352 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:38.211987    2566 scope.go:117] "RemoveContainer" containerID="81bbba6a5bc14c20420928352d8b20ecb5c76bbe788afab289a16f70ab92f1aa"
Jul 17 17:26:39.218131 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:39.218096    2566 generic.go:356] "Generic (PLEG): container finished" podID="4b9db0ab-38f3-4037-a1b6-23926a4b7153" containerID="17a29f188551f56db1276fd3e49df09b4a203f91b86264731aba8bb5c8e4e838" exitCode=7
Jul 17 17:26:39.218546 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:39.218192    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx" event={"ID":"4b9db0ab-38f3-4037-a1b6-23926a4b7153","Type":"ContainerDied","Data":"17a29f188551f56db1276fd3e49df09b4a203f91b86264731aba8bb5c8e4e838"}
Jul 17 17:26:39.218546 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:39.218251    2566 scope.go:117] "RemoveContainer" containerID="81bbba6a5bc14c20420928352d8b20ecb5c76bbe788afab289a16f70ab92f1aa"
Jul 17 17:26:39.218546 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:39.218399    2566 scope.go:117] "RemoveContainer" containerID="17a29f188551f56db1276fd3e49df09b4a203f91b86264731aba8bb5c8e4e838"
Jul 17 17:26:39.218709 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:26:39.218614    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx_odh-ai-gateway-infra(4b9db0ab-38f3-4037-a1b6-23926a4b7153)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx" podUID="4b9db0ab-38f3-4037-a1b6-23926a4b7153"
Jul 17 17:26:40.225290 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:40.225261    2566 scope.go:117] "RemoveContainer" containerID="17a29f188551f56db1276fd3e49df09b4a203f91b86264731aba8bb5c8e4e838"
Jul 17 17:26:40.225703 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:26:40.225477    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx_odh-ai-gateway-infra(4b9db0ab-38f3-4037-a1b6-23926a4b7153)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx" podUID="4b9db0ab-38f3-4037-a1b6-23926a4b7153"
Jul 17 17:26:43.800150 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:43.800116    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph"]
Jul 17 17:26:43.800657 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:43.800631    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7114bea0-dae5-49ee-99ce-dbdff8e5a806" containerName="revoke-keys"
Jul 17 17:26:43.804720 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:43.804702    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph"
Jul 17 17:26:43.811254 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:43.811224    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph"]
Jul 17 17:26:43.946289 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:43.946251    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f272f43d-f02f-4dcd-b9e5-a428ec773e09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph\" (UID: \"f272f43d-f02f-4dcd-b9e5-a428ec773e09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph"
Jul 17 17:26:44.046783 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:44.046748    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f272f43d-f02f-4dcd-b9e5-a428ec773e09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph\" (UID: \"f272f43d-f02f-4dcd-b9e5-a428ec773e09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph"
Jul 17 17:26:44.047387 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:44.047369    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f272f43d-f02f-4dcd-b9e5-a428ec773e09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph\" (UID: \"f272f43d-f02f-4dcd-b9e5-a428ec773e09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph"
Jul 17 17:26:44.117978 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:44.117906    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph"
Jul 17 17:26:44.457588 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:44.457562    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph"]
Jul 17 17:26:44.459616 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:26:44.459587    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf272f43d_f02f_4dcd_b9e5_a428ec773e09.slice/crio-2312f42846480815c8ba8db77ee55502896dc20c0344cc4d0d0ca9e580272045 WatchSource:0}: Error finding container 2312f42846480815c8ba8db77ee55502896dc20c0344cc4d0d0ca9e580272045: Status 404 returned error can't find the container with id 2312f42846480815c8ba8db77ee55502896dc20c0344cc4d0d0ca9e580272045
Jul 17 17:26:45.252589 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:45.252546    2566 generic.go:356] "Generic (PLEG): container finished" podID="f272f43d-f02f-4dcd-b9e5-a428ec773e09" containerID="e9b816a83a58662b0f0053f9fa2b890dbddd0146a6c6fb7a859ad566d67db6fe" exitCode=0
Jul 17 17:26:45.252956 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:45.252625    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph" event={"ID":"f272f43d-f02f-4dcd-b9e5-a428ec773e09","Type":"ContainerDied","Data":"e9b816a83a58662b0f0053f9fa2b890dbddd0146a6c6fb7a859ad566d67db6fe"}
Jul 17 17:26:45.252956 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:45.252680    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph" event={"ID":"f272f43d-f02f-4dcd-b9e5-a428ec773e09","Type":"ContainerStarted","Data":"2312f42846480815c8ba8db77ee55502896dc20c0344cc4d0d0ca9e580272045"}
Jul 17 17:26:46.397191 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:46.397166    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph"
Jul 17 17:26:46.569029 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:46.569002    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f272f43d-f02f-4dcd-b9e5-a428ec773e09-maas-api-service-ca\") pod \"f272f43d-f02f-4dcd-b9e5-a428ec773e09\" (UID: \"f272f43d-f02f-4dcd-b9e5-a428ec773e09\") "
Jul 17 17:26:46.569430 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:46.569408    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f272f43d-f02f-4dcd-b9e5-a428ec773e09-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f272f43d-f02f-4dcd-b9e5-a428ec773e09" (UID: "f272f43d-f02f-4dcd-b9e5-a428ec773e09"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:26:46.670149 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:46.670117    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f272f43d-f02f-4dcd-b9e5-a428ec773e09-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:26:47.265177 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:47.265139    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph" event={"ID":"f272f43d-f02f-4dcd-b9e5-a428ec773e09","Type":"ContainerDied","Data":"2312f42846480815c8ba8db77ee55502896dc20c0344cc4d0d0ca9e580272045"}
Jul 17 17:26:47.265177 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:47.265176    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph"
Jul 17 17:26:47.265419 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:47.265190    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2312f42846480815c8ba8db77ee55502896dc20c0344cc4d0d0ca9e580272045"
Jul 17 17:26:54.026619 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:54.026589    2566 scope.go:117] "RemoveContainer" containerID="17a29f188551f56db1276fd3e49df09b4a203f91b86264731aba8bb5c8e4e838"
Jul 17 17:26:55.306699 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:55.306665    2566 generic.go:356] "Generic (PLEG): container finished" podID="4b9db0ab-38f3-4037-a1b6-23926a4b7153" containerID="18858a8d945223c272bb08a4ce3b1879576e1b07a038ddc55f35a4896da601b4" exitCode=7
Jul 17 17:26:55.307133 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:55.306723    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx" event={"ID":"4b9db0ab-38f3-4037-a1b6-23926a4b7153","Type":"ContainerDied","Data":"18858a8d945223c272bb08a4ce3b1879576e1b07a038ddc55f35a4896da601b4"}
Jul 17 17:26:55.307133 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:55.306769    2566 scope.go:117] "RemoveContainer" containerID="17a29f188551f56db1276fd3e49df09b4a203f91b86264731aba8bb5c8e4e838"
Jul 17 17:26:55.307133 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:55.307069    2566 scope.go:117] "RemoveContainer" containerID="18858a8d945223c272bb08a4ce3b1879576e1b07a038ddc55f35a4896da601b4"
Jul 17 17:26:55.307361 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:26:55.307314    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx_odh-ai-gateway-infra(4b9db0ab-38f3-4037-a1b6-23926a4b7153)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx" podUID="4b9db0ab-38f3-4037-a1b6-23926a4b7153"
Jul 17 17:26:56.333968 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:56.333935    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx"]
Jul 17 17:26:56.475407 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:56.475382    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx"
Jul 17 17:26:56.583922 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:56.583892    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b9db0ab-38f3-4037-a1b6-23926a4b7153-maas-api-service-ca\") pod \"4b9db0ab-38f3-4037-a1b6-23926a4b7153\" (UID: \"4b9db0ab-38f3-4037-a1b6-23926a4b7153\") "
Jul 17 17:26:56.584282 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:56.584237    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b9db0ab-38f3-4037-a1b6-23926a4b7153-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4b9db0ab-38f3-4037-a1b6-23926a4b7153" (UID: "4b9db0ab-38f3-4037-a1b6-23926a4b7153"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:26:56.684748 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:56.684716    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b9db0ab-38f3-4037-a1b6-23926a4b7153-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:26:57.319092 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:57.319018    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx"
Jul 17 17:26:57.319092 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:57.319059    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx" event={"ID":"4b9db0ab-38f3-4037-a1b6-23926a4b7153","Type":"ContainerDied","Data":"a0205f2f2f9ea128ef97d7f8e48919b24e4ace5a569cc99b52da65e5a3472d39"}
Jul 17 17:26:57.319302 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:57.319120    2566 scope.go:117] "RemoveContainer" containerID="18858a8d945223c272bb08a4ce3b1879576e1b07a038ddc55f35a4896da601b4"
Jul 17 17:26:57.342817 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:57.342791    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx"]
Jul 17 17:26:57.345549 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:57.345524    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-fhppx"]
Jul 17 17:26:59.032198 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:26:59.032162    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b9db0ab-38f3-4037-a1b6-23926a4b7153" path="/var/lib/kubelet/pods/4b9db0ab-38f3-4037-a1b6-23926a4b7153/volumes"
Jul 17 17:27:01.228418 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.228382    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp"]
Jul 17 17:27:01.228800 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.228773    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b9db0ab-38f3-4037-a1b6-23926a4b7153" containerName="revoke-keys"
Jul 17 17:27:01.228800 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.228784    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b9db0ab-38f3-4037-a1b6-23926a4b7153" containerName="revoke-keys"
Jul 17 17:27:01.228800 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.228798    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b9db0ab-38f3-4037-a1b6-23926a4b7153" containerName="revoke-keys"
Jul 17 17:27:01.228905 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.228805    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b9db0ab-38f3-4037-a1b6-23926a4b7153" containerName="revoke-keys"
Jul 17 17:27:01.228905 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.228824    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f272f43d-f02f-4dcd-b9e5-a428ec773e09" containerName="revoke-keys"
Jul 17 17:27:01.228905 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.228829    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f272f43d-f02f-4dcd-b9e5-a428ec773e09" containerName="revoke-keys"
Jul 17 17:27:01.228905 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.228838    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b9db0ab-38f3-4037-a1b6-23926a4b7153" containerName="revoke-keys"
Jul 17 17:27:01.228905 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.228843    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b9db0ab-38f3-4037-a1b6-23926a4b7153" containerName="revoke-keys"
Jul 17 17:27:01.228905 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.228899    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b9db0ab-38f3-4037-a1b6-23926a4b7153" containerName="revoke-keys"
Jul 17 17:27:01.228905 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.228905    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b9db0ab-38f3-4037-a1b6-23926a4b7153" containerName="revoke-keys"
Jul 17 17:27:01.229116 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.228913    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b9db0ab-38f3-4037-a1b6-23926a4b7153" containerName="revoke-keys"
Jul 17 17:27:01.229116 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.228920    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f272f43d-f02f-4dcd-b9e5-a428ec773e09" containerName="revoke-keys"
Jul 17 17:27:01.233379 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.233364    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp"
Jul 17 17:27:01.235900 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.235876    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:27:01.236180 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.236155    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:27:01.238262 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.238230    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp"]
Jul 17 17:27:01.327601 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.327562    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b512f9-d4e3-4d15-bf5c-0f45d901d55c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp\" (UID: \"e2b512f9-d4e3-4d15-bf5c-0f45d901d55c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp"
Jul 17 17:27:01.428402 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.428368    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b512f9-d4e3-4d15-bf5c-0f45d901d55c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp\" (UID: \"e2b512f9-d4e3-4d15-bf5c-0f45d901d55c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp"
Jul 17 17:27:01.428987 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.428967    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b512f9-d4e3-4d15-bf5c-0f45d901d55c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp\" (UID: \"e2b512f9-d4e3-4d15-bf5c-0f45d901d55c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp"
Jul 17 17:27:01.545494 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.545462    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp"
Jul 17 17:27:01.889080 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:01.889008    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp"]
Jul 17 17:27:01.892332 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:27:01.892288    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b512f9_d4e3_4d15_bf5c_0f45d901d55c.slice/crio-2c60ff8bbe7abb7d2ea02bea4152274d1618756f7ec7db4c3130b153f59265d0 WatchSource:0}: Error finding container 2c60ff8bbe7abb7d2ea02bea4152274d1618756f7ec7db4c3130b153f59265d0: Status 404 returned error can't find the container with id 2c60ff8bbe7abb7d2ea02bea4152274d1618756f7ec7db4c3130b153f59265d0
Jul 17 17:27:02.353956 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:02.353925    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp" event={"ID":"e2b512f9-d4e3-4d15-bf5c-0f45d901d55c","Type":"ContainerStarted","Data":"4fd39a6b228870eb4dea09c3801c7b3b487ab6cd2084e7bf5523ed02a7c16e97"}
Jul 17 17:27:02.354342 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:02.353978    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp" event={"ID":"e2b512f9-d4e3-4d15-bf5c-0f45d901d55c","Type":"ContainerStarted","Data":"2c60ff8bbe7abb7d2ea02bea4152274d1618756f7ec7db4c3130b153f59265d0"}
Jul 17 17:27:02.369348 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:02.369288    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp" podStartSLOduration=1.369275504 podStartE2EDuration="1.369275504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:27:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:27:02.366518272 +0000 UTC m=+3671.225646830" watchObservedRunningTime="2026-07-17 17:27:02.369275504 +0000 UTC m=+3671.228404063"
Jul 17 17:27:03.360571 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:03.360538    2566 generic.go:356] "Generic (PLEG): container finished" podID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c" containerID="4fd39a6b228870eb4dea09c3801c7b3b487ab6cd2084e7bf5523ed02a7c16e97" exitCode=7
Jul 17 17:27:03.360984 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:03.360592    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp" event={"ID":"e2b512f9-d4e3-4d15-bf5c-0f45d901d55c","Type":"ContainerDied","Data":"4fd39a6b228870eb4dea09c3801c7b3b487ab6cd2084e7bf5523ed02a7c16e97"}
Jul 17 17:27:03.360984 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:03.360792    2566 scope.go:117] "RemoveContainer" containerID="4fd39a6b228870eb4dea09c3801c7b3b487ab6cd2084e7bf5523ed02a7c16e97"
Jul 17 17:27:03.924681 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:03.924588    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph"]
Jul 17 17:27:03.926868 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:03.926841    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9777fc6b-wc9ph"]
Jul 17 17:27:04.367623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:04.367591    2566 generic.go:356] "Generic (PLEG): container finished" podID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c" containerID="5ad5a93b2df1bc8d2437ec9b629cfd47fe94ab0b922f5f71b5b50bd533d6154e" exitCode=7
Jul 17 17:27:04.368014 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:04.367659    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp" event={"ID":"e2b512f9-d4e3-4d15-bf5c-0f45d901d55c","Type":"ContainerDied","Data":"5ad5a93b2df1bc8d2437ec9b629cfd47fe94ab0b922f5f71b5b50bd533d6154e"}
Jul 17 17:27:04.368014 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:04.367753    2566 scope.go:117] "RemoveContainer" containerID="4fd39a6b228870eb4dea09c3801c7b3b487ab6cd2084e7bf5523ed02a7c16e97"
Jul 17 17:27:04.368014 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:04.367956    2566 scope.go:117] "RemoveContainer" containerID="5ad5a93b2df1bc8d2437ec9b629cfd47fe94ab0b922f5f71b5b50bd533d6154e"
Jul 17 17:27:04.368213 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:27:04.368189    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp_odh-ai-gateway-infra(e2b512f9-d4e3-4d15-bf5c-0f45d901d55c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp" podUID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c"
Jul 17 17:27:05.031847 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:05.031813    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f272f43d-f02f-4dcd-b9e5-a428ec773e09" path="/var/lib/kubelet/pods/f272f43d-f02f-4dcd-b9e5-a428ec773e09/volumes"
Jul 17 17:27:05.374109 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:05.374027    2566 scope.go:117] "RemoveContainer" containerID="5ad5a93b2df1bc8d2437ec9b629cfd47fe94ab0b922f5f71b5b50bd533d6154e"
Jul 17 17:27:05.374490 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:27:05.374210    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp_odh-ai-gateway-infra(e2b512f9-d4e3-4d15-bf5c-0f45d901d55c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp" podUID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c"
Jul 17 17:27:19.025946 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:19.025908    2566 scope.go:117] "RemoveContainer" containerID="5ad5a93b2df1bc8d2437ec9b629cfd47fe94ab0b922f5f71b5b50bd533d6154e"
Jul 17 17:27:19.448827 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:19.448792    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp" event={"ID":"e2b512f9-d4e3-4d15-bf5c-0f45d901d55c","Type":"ContainerStarted","Data":"cfb6982b6192c43fdfd6a960107491f89f593544533fbd53809e4c9bd3548fd0"}
Jul 17 17:27:20.455491 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:20.455461    2566 generic.go:356] "Generic (PLEG): container finished" podID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c" containerID="cfb6982b6192c43fdfd6a960107491f89f593544533fbd53809e4c9bd3548fd0" exitCode=7
Jul 17 17:27:20.455943 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:20.455527    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp" event={"ID":"e2b512f9-d4e3-4d15-bf5c-0f45d901d55c","Type":"ContainerDied","Data":"cfb6982b6192c43fdfd6a960107491f89f593544533fbd53809e4c9bd3548fd0"}
Jul 17 17:27:20.455943 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:20.455588    2566 scope.go:117] "RemoveContainer" containerID="5ad5a93b2df1bc8d2437ec9b629cfd47fe94ab0b922f5f71b5b50bd533d6154e"
Jul 17 17:27:20.455943 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:20.455849    2566 scope.go:117] "RemoveContainer" containerID="cfb6982b6192c43fdfd6a960107491f89f593544533fbd53809e4c9bd3548fd0"
Jul 17 17:27:20.456094 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:27:20.456072    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp_odh-ai-gateway-infra(e2b512f9-d4e3-4d15-bf5c-0f45d901d55c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp" podUID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c"
Jul 17 17:27:20.480623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:20.480599    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp"]
Jul 17 17:27:21.598278 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:21.598255    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp"
Jul 17 17:27:21.721151 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:21.721062    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b512f9-d4e3-4d15-bf5c-0f45d901d55c-maas-api-service-ca\") pod \"e2b512f9-d4e3-4d15-bf5c-0f45d901d55c\" (UID: \"e2b512f9-d4e3-4d15-bf5c-0f45d901d55c\") "
Jul 17 17:27:21.721496 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:21.721474    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2b512f9-d4e3-4d15-bf5c-0f45d901d55c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e2b512f9-d4e3-4d15-bf5c-0f45d901d55c" (UID: "e2b512f9-d4e3-4d15-bf5c-0f45d901d55c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:27:21.822687 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:21.822652    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b512f9-d4e3-4d15-bf5c-0f45d901d55c-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:27:22.467703 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:22.467665    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp" event={"ID":"e2b512f9-d4e3-4d15-bf5c-0f45d901d55c","Type":"ContainerDied","Data":"2c60ff8bbe7abb7d2ea02bea4152274d1618756f7ec7db4c3130b153f59265d0"}
Jul 17 17:27:22.467858 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:22.467724    2566 scope.go:117] "RemoveContainer" containerID="cfb6982b6192c43fdfd6a960107491f89f593544533fbd53809e4c9bd3548fd0"
Jul 17 17:27:22.467858 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:22.467680    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp"
Jul 17 17:27:22.490654 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:22.490630    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp"]
Jul 17 17:27:22.498504 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:22.498480    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-vshnp"]
Jul 17 17:27:23.038359 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:23.038302    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c" path="/var/lib/kubelet/pods/e2b512f9-d4e3-4d15-bf5c-0f45d901d55c/volumes"
Jul 17 17:27:36.310110 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.310069    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w"]
Jul 17 17:27:36.310726 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.310671    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c" containerName="revoke-keys"
Jul 17 17:27:36.310726 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.310691    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c" containerName="revoke-keys"
Jul 17 17:27:36.310726 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.310714    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c" containerName="revoke-keys"
Jul 17 17:27:36.310726 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.310723    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c" containerName="revoke-keys"
Jul 17 17:27:36.310946 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.310744    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c" containerName="revoke-keys"
Jul 17 17:27:36.310946 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.310752    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c" containerName="revoke-keys"
Jul 17 17:27:36.310946 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.310846    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c" containerName="revoke-keys"
Jul 17 17:27:36.310946 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.310858    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c" containerName="revoke-keys"
Jul 17 17:27:36.310946 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.310868    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2b512f9-d4e3-4d15-bf5c-0f45d901d55c" containerName="revoke-keys"
Jul 17 17:27:36.314063 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.314042    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w"
Jul 17 17:27:36.316299 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.316279    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:27:36.316400 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.316279    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:27:36.321957 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.321937    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w"]
Jul 17 17:27:36.353267 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.353227    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w\" (UID: \"17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w"
Jul 17 17:27:36.454818 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.454775    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w\" (UID: \"17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w"
Jul 17 17:27:36.460513 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.460484    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w\" (UID: \"17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w"
Jul 17 17:27:36.626689 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.626608    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w"
Jul 17 17:27:36.756997 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:36.756969    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w"]
Jul 17 17:27:36.758884 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:27:36.758855    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f3af94_22ac_4d7c_b70b_5eb6e8cbfc35.slice/crio-fe374a6f4c8606764dcbb5fde482cde38af5d753dc87b1ba69264fafb9e3bfaa WatchSource:0}: Error finding container fe374a6f4c8606764dcbb5fde482cde38af5d753dc87b1ba69264fafb9e3bfaa: Status 404 returned error can't find the container with id fe374a6f4c8606764dcbb5fde482cde38af5d753dc87b1ba69264fafb9e3bfaa
Jul 17 17:27:37.547475 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:37.547440    2566 generic.go:356] "Generic (PLEG): container finished" podID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35" containerID="c015fb14214630377b38bcd1fc2c5c81e336519bedd65bb573dceea5dd85dc66" exitCode=7
Jul 17 17:27:37.547928 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:37.547528    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w" event={"ID":"17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35","Type":"ContainerDied","Data":"c015fb14214630377b38bcd1fc2c5c81e336519bedd65bb573dceea5dd85dc66"}
Jul 17 17:27:37.547928 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:37.547582    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w" event={"ID":"17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35","Type":"ContainerStarted","Data":"fe374a6f4c8606764dcbb5fde482cde38af5d753dc87b1ba69264fafb9e3bfaa"}
Jul 17 17:27:37.547928 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:37.547679    2566 scope.go:117] "RemoveContainer" containerID="c015fb14214630377b38bcd1fc2c5c81e336519bedd65bb573dceea5dd85dc66"
Jul 17 17:27:38.554144 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:38.554112    2566 generic.go:356] "Generic (PLEG): container finished" podID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35" containerID="fb2e5064f256d73b1dbf1891d53216bba4bae663fae7015e1d9098516bbcf5d9" exitCode=7
Jul 17 17:27:38.554570 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:38.554196    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w" event={"ID":"17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35","Type":"ContainerDied","Data":"fb2e5064f256d73b1dbf1891d53216bba4bae663fae7015e1d9098516bbcf5d9"}
Jul 17 17:27:38.554570 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:38.554258    2566 scope.go:117] "RemoveContainer" containerID="c015fb14214630377b38bcd1fc2c5c81e336519bedd65bb573dceea5dd85dc66"
Jul 17 17:27:38.554570 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:38.554455    2566 scope.go:117] "RemoveContainer" containerID="fb2e5064f256d73b1dbf1891d53216bba4bae663fae7015e1d9098516bbcf5d9"
Jul 17 17:27:38.554733 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:27:38.554690    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w_odh-ai-gateway-infra(17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w" podUID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35"
Jul 17 17:27:39.561140 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:39.561114    2566 scope.go:117] "RemoveContainer" containerID="fb2e5064f256d73b1dbf1891d53216bba4bae663fae7015e1d9098516bbcf5d9"
Jul 17 17:27:39.561546 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:27:39.561303    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w_odh-ai-gateway-infra(17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w" podUID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35"
Jul 17 17:27:52.026154 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:52.026117    2566 scope.go:117] "RemoveContainer" containerID="fb2e5064f256d73b1dbf1891d53216bba4bae663fae7015e1d9098516bbcf5d9"
Jul 17 17:27:52.634879 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:52.634848    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w" event={"ID":"17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35","Type":"ContainerStarted","Data":"40472b98be2432ccfe97f917d93ce68cd212112499ff255e0e7730fd1eb45b37"}
Jul 17 17:27:52.650722 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:52.650677    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w" podStartSLOduration=16.650661568 podStartE2EDuration="16.650661568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:27:52.649290074 +0000 UTC m=+3721.508418634" watchObservedRunningTime="2026-07-17 17:27:52.650661568 +0000 UTC m=+3721.509790127"
Jul 17 17:27:53.642675 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:53.642584    2566 generic.go:356] "Generic (PLEG): container finished" podID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35" containerID="40472b98be2432ccfe97f917d93ce68cd212112499ff255e0e7730fd1eb45b37" exitCode=7
Jul 17 17:27:53.642675 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:53.642651    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w" event={"ID":"17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35","Type":"ContainerDied","Data":"40472b98be2432ccfe97f917d93ce68cd212112499ff255e0e7730fd1eb45b37"}
Jul 17 17:27:53.643164 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:53.642713    2566 scope.go:117] "RemoveContainer" containerID="fb2e5064f256d73b1dbf1891d53216bba4bae663fae7015e1d9098516bbcf5d9"
Jul 17 17:27:53.643164 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:53.642994    2566 scope.go:117] "RemoveContainer" containerID="40472b98be2432ccfe97f917d93ce68cd212112499ff255e0e7730fd1eb45b37"
Jul 17 17:27:53.643273 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:27:53.643241    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w_odh-ai-gateway-infra(17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w" podUID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35"
Jul 17 17:27:53.666117 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:53.666093    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w"]
Jul 17 17:27:54.176506 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:54.176477    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"]
Jul 17 17:27:54.176727 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:54.176686    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6" podUID="48c9be24-f441-4777-ba68-828cbd2debee" containerName="istio-proxy" containerID="cri-o://26a2d5e51f756432dbd734ba4fb7a396ad0f5b4192f4ac52673cbc4226c7ba55" gracePeriod=30
Jul 17 17:27:54.786475 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:54.786452    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w"
Jul 17 17:27:54.919896 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:54.919813    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35-maas-api-service-ca\") pod \"17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35\" (UID: \"17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35\") "
Jul 17 17:27:54.920136 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:54.920115    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35" (UID: "17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:27:55.020753 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:55.020723    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:27:55.656198 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:55.656165    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w"
Jul 17 17:27:55.656392 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:55.656162    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w" event={"ID":"17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35","Type":"ContainerDied","Data":"fe374a6f4c8606764dcbb5fde482cde38af5d753dc87b1ba69264fafb9e3bfaa"}
Jul 17 17:27:55.656392 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:55.656339    2566 scope.go:117] "RemoveContainer" containerID="40472b98be2432ccfe97f917d93ce68cd212112499ff255e0e7730fd1eb45b37"
Jul 17 17:27:55.671682 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:55.671656    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w"]
Jul 17 17:27:55.678229 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:55.678210    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8mb7w"]
Jul 17 17:27:56.451660 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:56.451628    2566 patch_prober.go:28] interesting pod/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 17:27:56.452020 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:56.451693    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6" podUID="48c9be24-f441-4777-ba68-828cbd2debee" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 17:27:57.031961 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:57.031928    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35" path="/var/lib/kubelet/pods/17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35/volumes"
Jul 17 17:27:59.444533 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.444471    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:27:59.562340 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.562285    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48c9be24-f441-4777-ba68-828cbd2debee-istiod-ca-cert\") pod \"48c9be24-f441-4777-ba68-828cbd2debee\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") "
Jul 17 17:27:59.562510 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.562354    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-workload-socket\") pod \"48c9be24-f441-4777-ba68-828cbd2debee\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") "
Jul 17 17:27:59.562510 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.562420    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48c9be24-f441-4777-ba68-828cbd2debee-istio-token\") pod \"48c9be24-f441-4777-ba68-828cbd2debee\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") "
Jul 17 17:27:59.562510 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.562450    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-istio-data\") pod \"48c9be24-f441-4777-ba68-828cbd2debee\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") "
Jul 17 17:27:59.562510 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.562477    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48c9be24-f441-4777-ba68-828cbd2debee-istio-podinfo\") pod \"48c9be24-f441-4777-ba68-828cbd2debee\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") "
Jul 17 17:27:59.562510 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.562505    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-workload-certs\") pod \"48c9be24-f441-4777-ba68-828cbd2debee\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") "
Jul 17 17:27:59.562762 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.562597    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjftx\" (UniqueName: \"kubernetes.io/projected/48c9be24-f441-4777-ba68-828cbd2debee-kube-api-access-cjftx\") pod \"48c9be24-f441-4777-ba68-828cbd2debee\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") "
Jul 17 17:27:59.562762 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.562634    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-credential-socket\") pod \"48c9be24-f441-4777-ba68-828cbd2debee\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") "
Jul 17 17:27:59.562762 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.562660    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-istio-envoy\") pod \"48c9be24-f441-4777-ba68-828cbd2debee\" (UID: \"48c9be24-f441-4777-ba68-828cbd2debee\") "
Jul 17 17:27:59.562762 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.562690    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48c9be24-f441-4777-ba68-828cbd2debee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "48c9be24-f441-4777-ba68-828cbd2debee" (UID: "48c9be24-f441-4777-ba68-828cbd2debee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:27:59.562762 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.562730    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "48c9be24-f441-4777-ba68-828cbd2debee" (UID: "48c9be24-f441-4777-ba68-828cbd2debee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:27:59.563032 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.562824    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "48c9be24-f441-4777-ba68-828cbd2debee" (UID: "48c9be24-f441-4777-ba68-828cbd2debee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:27:59.563032 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.562869    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "48c9be24-f441-4777-ba68-828cbd2debee" (UID: "48c9be24-f441-4777-ba68-828cbd2debee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:27:59.563032 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.563003    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-workload-certs\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:27:59.563032 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.563021    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-credential-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:27:59.563032 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.563034    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48c9be24-f441-4777-ba68-828cbd2debee-istiod-ca-cert\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:27:59.563294 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.563046    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-workload-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:27:59.563623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.563602    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-istio-data" (OuterVolumeSpecName: "istio-data") pod "48c9be24-f441-4777-ba68-828cbd2debee" (UID: "48c9be24-f441-4777-ba68-828cbd2debee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:27:59.564878 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.564854    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "48c9be24-f441-4777-ba68-828cbd2debee" (UID: "48c9be24-f441-4777-ba68-828cbd2debee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:27:59.565054 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.565032    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48c9be24-f441-4777-ba68-828cbd2debee-kube-api-access-cjftx" (OuterVolumeSpecName: "kube-api-access-cjftx") pod "48c9be24-f441-4777-ba68-828cbd2debee" (UID: "48c9be24-f441-4777-ba68-828cbd2debee"). InnerVolumeSpecName "kube-api-access-cjftx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:27:59.565054 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.565048    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48c9be24-f441-4777-ba68-828cbd2debee-istio-token" (OuterVolumeSpecName: "istio-token") pod "48c9be24-f441-4777-ba68-828cbd2debee" (UID: "48c9be24-f441-4777-ba68-828cbd2debee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:27:59.565349 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.565331    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/48c9be24-f441-4777-ba68-828cbd2debee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "48c9be24-f441-4777-ba68-828cbd2debee" (UID: "48c9be24-f441-4777-ba68-828cbd2debee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 17:27:59.664105 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.664070    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjftx\" (UniqueName: \"kubernetes.io/projected/48c9be24-f441-4777-ba68-828cbd2debee-kube-api-access-cjftx\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:27:59.664105 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.664097    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-istio-envoy\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:27:59.664105 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.664108    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48c9be24-f441-4777-ba68-828cbd2debee-istio-token\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:27:59.664105 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.664116    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48c9be24-f441-4777-ba68-828cbd2debee-istio-data\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:27:59.664388 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.664124    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48c9be24-f441-4777-ba68-828cbd2debee-istio-podinfo\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:27:59.679459 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.679431    2566 generic.go:356] "Generic (PLEG): container finished" podID="48c9be24-f441-4777-ba68-828cbd2debee" containerID="26a2d5e51f756432dbd734ba4fb7a396ad0f5b4192f4ac52673cbc4226c7ba55" exitCode=0
Jul 17 17:27:59.679620 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.679510    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"
Jul 17 17:27:59.679620 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.679502    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6" event={"ID":"48c9be24-f441-4777-ba68-828cbd2debee","Type":"ContainerDied","Data":"26a2d5e51f756432dbd734ba4fb7a396ad0f5b4192f4ac52673cbc4226c7ba55"}
Jul 17 17:27:59.679759 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.679622    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6" event={"ID":"48c9be24-f441-4777-ba68-828cbd2debee","Type":"ContainerDied","Data":"66618303d1f3ba5bcbd4ce06ef97f3ae1fbb1b3ef95e2095670c91dafc1bb430"}
Jul 17 17:27:59.679759 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.679683    2566 scope.go:117] "RemoveContainer" containerID="26a2d5e51f756432dbd734ba4fb7a396ad0f5b4192f4ac52673cbc4226c7ba55"
Jul 17 17:27:59.690060 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.690043    2566 scope.go:117] "RemoveContainer" containerID="9bdb4202475958dc0432d2bd78018259029355cf9bc3c39dbff3462ae7c73d06"
Jul 17 17:27:59.699798 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.699775    2566 scope.go:117] "RemoveContainer" containerID="26a2d5e51f756432dbd734ba4fb7a396ad0f5b4192f4ac52673cbc4226c7ba55"
Jul 17 17:27:59.700082 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:27:59.700060    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26a2d5e51f756432dbd734ba4fb7a396ad0f5b4192f4ac52673cbc4226c7ba55\": container with ID starting with 26a2d5e51f756432dbd734ba4fb7a396ad0f5b4192f4ac52673cbc4226c7ba55 not found: ID does not exist" containerID="26a2d5e51f756432dbd734ba4fb7a396ad0f5b4192f4ac52673cbc4226c7ba55"
Jul 17 17:27:59.700159 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.700095    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a2d5e51f756432dbd734ba4fb7a396ad0f5b4192f4ac52673cbc4226c7ba55"} err="failed to get container status \"26a2d5e51f756432dbd734ba4fb7a396ad0f5b4192f4ac52673cbc4226c7ba55\": rpc error: code = NotFound desc = could not find container \"26a2d5e51f756432dbd734ba4fb7a396ad0f5b4192f4ac52673cbc4226c7ba55\": container with ID starting with 26a2d5e51f756432dbd734ba4fb7a396ad0f5b4192f4ac52673cbc4226c7ba55 not found: ID does not exist"
Jul 17 17:27:59.700159 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.700119    2566 scope.go:117] "RemoveContainer" containerID="9bdb4202475958dc0432d2bd78018259029355cf9bc3c39dbff3462ae7c73d06"
Jul 17 17:27:59.700405 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:27:59.700384    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bdb4202475958dc0432d2bd78018259029355cf9bc3c39dbff3462ae7c73d06\": container with ID starting with 9bdb4202475958dc0432d2bd78018259029355cf9bc3c39dbff3462ae7c73d06 not found: ID does not exist" containerID="9bdb4202475958dc0432d2bd78018259029355cf9bc3c39dbff3462ae7c73d06"
Jul 17 17:27:59.700471 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.700412    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bdb4202475958dc0432d2bd78018259029355cf9bc3c39dbff3462ae7c73d06"} err="failed to get container status \"9bdb4202475958dc0432d2bd78018259029355cf9bc3c39dbff3462ae7c73d06\": rpc error: code = NotFound desc = could not find container \"9bdb4202475958dc0432d2bd78018259029355cf9bc3c39dbff3462ae7c73d06\": container with ID starting with 9bdb4202475958dc0432d2bd78018259029355cf9bc3c39dbff3462ae7c73d06 not found: ID does not exist"
Jul 17 17:27:59.704604 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.704578    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"]
Jul 17 17:27:59.708135 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:27:59.708102    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9777fc6b-openshift-default-85858996dc-djnf6"]
Jul 17 17:28:01.031703 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.031670    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48c9be24-f441-4777-ba68-828cbd2debee" path="/var/lib/kubelet/pods/48c9be24-f441-4777-ba68-828cbd2debee/volumes"
Jul 17 17:28:01.277470 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.277442    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk"]
Jul 17 17:28:01.277849 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.277837    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c9be24-f441-4777-ba68-828cbd2debee" containerName="istio-proxy"
Jul 17 17:28:01.277904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.277851    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c9be24-f441-4777-ba68-828cbd2debee" containerName="istio-proxy"
Jul 17 17:28:01.277904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.277859    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35" containerName="revoke-keys"
Jul 17 17:28:01.277904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.277865    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35" containerName="revoke-keys"
Jul 17 17:28:01.277904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.277873    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35" containerName="revoke-keys"
Jul 17 17:28:01.277904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.277879    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35" containerName="revoke-keys"
Jul 17 17:28:01.277904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.277889    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35" containerName="revoke-keys"
Jul 17 17:28:01.277904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.277894    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35" containerName="revoke-keys"
Jul 17 17:28:01.278114 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.277951    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35" containerName="revoke-keys"
Jul 17 17:28:01.278114 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.277961    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="48c9be24-f441-4777-ba68-828cbd2debee" containerName="istio-proxy"
Jul 17 17:28:01.278114 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.277968    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="48c9be24-f441-4777-ba68-828cbd2debee" containerName="istio-proxy"
Jul 17 17:28:01.278114 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.277974    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35" containerName="revoke-keys"
Jul 17 17:28:01.288372 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.288260    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk"
Jul 17 17:28:01.290015 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.289979    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk"]
Jul 17 17:28:01.290941 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.290898    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:28:01.291312 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.291291    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:28:01.381438 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.381404    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2fb7b5b-141a-4cc4-9647-406bdfcbce9c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk\" (UID: \"e2fb7b5b-141a-4cc4-9647-406bdfcbce9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk"
Jul 17 17:28:01.482745 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.482705    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2fb7b5b-141a-4cc4-9647-406bdfcbce9c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk\" (UID: \"e2fb7b5b-141a-4cc4-9647-406bdfcbce9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk"
Jul 17 17:28:01.483406 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.483383    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2fb7b5b-141a-4cc4-9647-406bdfcbce9c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk\" (UID: \"e2fb7b5b-141a-4cc4-9647-406bdfcbce9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk"
Jul 17 17:28:01.600736 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.600660    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk"
Jul 17 17:28:01.738291 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:01.738268    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk"]
Jul 17 17:28:01.740378 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:28:01.740350    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2fb7b5b_141a_4cc4_9647_406bdfcbce9c.slice/crio-afe1cdca1271272e3aa44f180f3b51a0363a77afe8f9d5badf7d3960ff76a85e WatchSource:0}: Error finding container afe1cdca1271272e3aa44f180f3b51a0363a77afe8f9d5badf7d3960ff76a85e: Status 404 returned error can't find the container with id afe1cdca1271272e3aa44f180f3b51a0363a77afe8f9d5badf7d3960ff76a85e
Jul 17 17:28:02.698361 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:02.698257    2566 generic.go:356] "Generic (PLEG): container finished" podID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c" containerID="90540291b9c945018d4b074fb09be6c4198f3167c955841f83d046e075b9ae16" exitCode=7
Jul 17 17:28:02.698693 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:02.698371    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk" event={"ID":"e2fb7b5b-141a-4cc4-9647-406bdfcbce9c","Type":"ContainerDied","Data":"90540291b9c945018d4b074fb09be6c4198f3167c955841f83d046e075b9ae16"}
Jul 17 17:28:02.698693 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:02.698415    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk" event={"ID":"e2fb7b5b-141a-4cc4-9647-406bdfcbce9c","Type":"ContainerStarted","Data":"afe1cdca1271272e3aa44f180f3b51a0363a77afe8f9d5badf7d3960ff76a85e"}
Jul 17 17:28:02.698693 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:02.698527    2566 scope.go:117] "RemoveContainer" containerID="90540291b9c945018d4b074fb09be6c4198f3167c955841f83d046e075b9ae16"
Jul 17 17:28:03.705290 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:03.705194    2566 generic.go:356] "Generic (PLEG): container finished" podID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c" containerID="6836b4e06f6ffe47b62c1094e5006526e84ab40efca01dcde923d84f0a7e65c5" exitCode=7
Jul 17 17:28:03.705290 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:03.705273    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk" event={"ID":"e2fb7b5b-141a-4cc4-9647-406bdfcbce9c","Type":"ContainerDied","Data":"6836b4e06f6ffe47b62c1094e5006526e84ab40efca01dcde923d84f0a7e65c5"}
Jul 17 17:28:03.705793 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:03.705363    2566 scope.go:117] "RemoveContainer" containerID="90540291b9c945018d4b074fb09be6c4198f3167c955841f83d046e075b9ae16"
Jul 17 17:28:03.705793 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:03.705601    2566 scope.go:117] "RemoveContainer" containerID="6836b4e06f6ffe47b62c1094e5006526e84ab40efca01dcde923d84f0a7e65c5"
Jul 17 17:28:03.705893 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:28:03.705836    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk_odh-ai-gateway-infra(e2fb7b5b-141a-4cc4-9647-406bdfcbce9c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk" podUID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c"
Jul 17 17:28:04.711916 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:04.711891    2566 scope.go:117] "RemoveContainer" containerID="6836b4e06f6ffe47b62c1094e5006526e84ab40efca01dcde923d84f0a7e65c5"
Jul 17 17:28:04.712306 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:28:04.712103    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk_odh-ai-gateway-infra(e2fb7b5b-141a-4cc4-9647-406bdfcbce9c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk" podUID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c"
Jul 17 17:28:16.026517 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:16.026488    2566 scope.go:117] "RemoveContainer" containerID="6836b4e06f6ffe47b62c1094e5006526e84ab40efca01dcde923d84f0a7e65c5"
Jul 17 17:28:16.775268 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:16.775232    2566 generic.go:356] "Generic (PLEG): container finished" podID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c" containerID="110f8e38241ded4d6267245f98974c0cbbf757707773369950ea163a5a7f4a55" exitCode=7
Jul 17 17:28:16.775431 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:16.775305    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk" event={"ID":"e2fb7b5b-141a-4cc4-9647-406bdfcbce9c","Type":"ContainerDied","Data":"110f8e38241ded4d6267245f98974c0cbbf757707773369950ea163a5a7f4a55"}
Jul 17 17:28:16.775431 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:16.775379    2566 scope.go:117] "RemoveContainer" containerID="6836b4e06f6ffe47b62c1094e5006526e84ab40efca01dcde923d84f0a7e65c5"
Jul 17 17:28:16.775620 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:16.775607    2566 scope.go:117] "RemoveContainer" containerID="110f8e38241ded4d6267245f98974c0cbbf757707773369950ea163a5a7f4a55"
Jul 17 17:28:16.775873 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:28:16.775854    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk_odh-ai-gateway-infra(e2fb7b5b-141a-4cc4-9647-406bdfcbce9c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk" podUID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c"
Jul 17 17:28:17.801207 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:17.801177    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk"]
Jul 17 17:28:17.940240 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:17.940218    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk"
Jul 17 17:28:18.134330 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:18.134242    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2fb7b5b-141a-4cc4-9647-406bdfcbce9c-maas-api-service-ca\") pod \"e2fb7b5b-141a-4cc4-9647-406bdfcbce9c\" (UID: \"e2fb7b5b-141a-4cc4-9647-406bdfcbce9c\") "
Jul 17 17:28:18.134646 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:18.134615    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2fb7b5b-141a-4cc4-9647-406bdfcbce9c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e2fb7b5b-141a-4cc4-9647-406bdfcbce9c" (UID: "e2fb7b5b-141a-4cc4-9647-406bdfcbce9c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:28:18.234786 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:18.234755    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2fb7b5b-141a-4cc4-9647-406bdfcbce9c-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:28:18.787552 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:18.787523    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk"
Jul 17 17:28:18.787725 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:18.787563    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk" event={"ID":"e2fb7b5b-141a-4cc4-9647-406bdfcbce9c","Type":"ContainerDied","Data":"afe1cdca1271272e3aa44f180f3b51a0363a77afe8f9d5badf7d3960ff76a85e"}
Jul 17 17:28:18.787725 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:18.787621    2566 scope.go:117] "RemoveContainer" containerID="110f8e38241ded4d6267245f98974c0cbbf757707773369950ea163a5a7f4a55"
Jul 17 17:28:18.809264 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:18.809235    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk"]
Jul 17 17:28:18.814885 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:18.814865    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-xhwkk"]
Jul 17 17:28:19.032844 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:19.032812    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c" path="/var/lib/kubelet/pods/e2fb7b5b-141a-4cc4-9647-406bdfcbce9c/volumes"
Jul 17 17:28:26.361402 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.361371    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g"]
Jul 17 17:28:26.361853 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.361766    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c" containerName="revoke-keys"
Jul 17 17:28:26.361853 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.361780    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c" containerName="revoke-keys"
Jul 17 17:28:26.361853 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.361797    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c9be24-f441-4777-ba68-828cbd2debee" containerName="istio-proxy"
Jul 17 17:28:26.361853 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.361806    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c9be24-f441-4777-ba68-828cbd2debee" containerName="istio-proxy"
Jul 17 17:28:26.361853 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.361823    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c" containerName="revoke-keys"
Jul 17 17:28:26.361853 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.361832    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c" containerName="revoke-keys"
Jul 17 17:28:26.362047 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.361949    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f3af94-22ac-4d7c-b70b-5eb6e8cbfc35" containerName="revoke-keys"
Jul 17 17:28:26.362047 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.361965    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c" containerName="revoke-keys"
Jul 17 17:28:26.362047 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.361978    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c" containerName="revoke-keys"
Jul 17 17:28:26.366361 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.366344    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g"
Jul 17 17:28:26.368661 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.368637    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:28:26.368793 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.368669    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:28:26.372254 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.372230    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g"]
Jul 17 17:28:26.397373 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.397349    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed73f804-5841-4635-84e6-707b4e74f4af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g\" (UID: \"ed73f804-5841-4635-84e6-707b4e74f4af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g"
Jul 17 17:28:26.498692 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.498668    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed73f804-5841-4635-84e6-707b4e74f4af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g\" (UID: \"ed73f804-5841-4635-84e6-707b4e74f4af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g"
Jul 17 17:28:26.499255 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.499237    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed73f804-5841-4635-84e6-707b4e74f4af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g\" (UID: \"ed73f804-5841-4635-84e6-707b4e74f4af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g"
Jul 17 17:28:26.678967 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.678895    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g"
Jul 17 17:28:26.812473 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.812437    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g"]
Jul 17 17:28:26.815673 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:28:26.815637    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded73f804_5841_4635_84e6_707b4e74f4af.slice/crio-37a1ae1c5da7d3f119f83766845e7bc7a62f349107209a158796e694dedfa4b2 WatchSource:0}: Error finding container 37a1ae1c5da7d3f119f83766845e7bc7a62f349107209a158796e694dedfa4b2: Status 404 returned error can't find the container with id 37a1ae1c5da7d3f119f83766845e7bc7a62f349107209a158796e694dedfa4b2
Jul 17 17:28:26.829577 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:26.829551    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g" event={"ID":"ed73f804-5841-4635-84e6-707b4e74f4af","Type":"ContainerStarted","Data":"37a1ae1c5da7d3f119f83766845e7bc7a62f349107209a158796e694dedfa4b2"}
Jul 17 17:28:27.835960 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:27.835924    2566 generic.go:356] "Generic (PLEG): container finished" podID="ed73f804-5841-4635-84e6-707b4e74f4af" containerID="70743344a2eafbe45eaf893badbcd1698ea5dabbe1d34989ba61ff94647dc53b" exitCode=7
Jul 17 17:28:27.836359 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:27.836011    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g" event={"ID":"ed73f804-5841-4635-84e6-707b4e74f4af","Type":"ContainerDied","Data":"70743344a2eafbe45eaf893badbcd1698ea5dabbe1d34989ba61ff94647dc53b"}
Jul 17 17:28:27.836359 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:27.836178    2566 scope.go:117] "RemoveContainer" containerID="70743344a2eafbe45eaf893badbcd1698ea5dabbe1d34989ba61ff94647dc53b"
Jul 17 17:28:28.842366 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:28.842333    2566 generic.go:356] "Generic (PLEG): container finished" podID="ed73f804-5841-4635-84e6-707b4e74f4af" containerID="dbb4d564b5b90bab56557f4c6003a09a24d1d44961fd755cf4d2f3e84cdcb93a" exitCode=7
Jul 17 17:28:28.842776 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:28.842414    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g" event={"ID":"ed73f804-5841-4635-84e6-707b4e74f4af","Type":"ContainerDied","Data":"dbb4d564b5b90bab56557f4c6003a09a24d1d44961fd755cf4d2f3e84cdcb93a"}
Jul 17 17:28:28.842776 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:28.842471    2566 scope.go:117] "RemoveContainer" containerID="70743344a2eafbe45eaf893badbcd1698ea5dabbe1d34989ba61ff94647dc53b"
Jul 17 17:28:28.842776 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:28.842677    2566 scope.go:117] "RemoveContainer" containerID="dbb4d564b5b90bab56557f4c6003a09a24d1d44961fd755cf4d2f3e84cdcb93a"
Jul 17 17:28:28.842955 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:28:28.842897    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g_odh-ai-gateway-infra(ed73f804-5841-4635-84e6-707b4e74f4af)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g" podUID="ed73f804-5841-4635-84e6-707b4e74f4af"
Jul 17 17:28:29.849343 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:29.849292    2566 scope.go:117] "RemoveContainer" containerID="dbb4d564b5b90bab56557f4c6003a09a24d1d44961fd755cf4d2f3e84cdcb93a"
Jul 17 17:28:29.849715 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:28:29.849530    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g_odh-ai-gateway-infra(ed73f804-5841-4635-84e6-707b4e74f4af)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g" podUID="ed73f804-5841-4635-84e6-707b4e74f4af"
Jul 17 17:28:33.772965 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:33.772931    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7"]
Jul 17 17:28:33.773440 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:33.773350    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c" containerName="revoke-keys"
Jul 17 17:28:33.773440 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:33.773363    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c" containerName="revoke-keys"
Jul 17 17:28:33.773440 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:33.773442    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2fb7b5b-141a-4cc4-9647-406bdfcbce9c" containerName="revoke-keys"
Jul 17 17:28:33.777748 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:33.777729    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7"
Jul 17 17:28:33.784556 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:33.784531    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7"]
Jul 17 17:28:33.864028 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:33.863988    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91237fff-0d08-49cd-8a69-e2f3540b400e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7\" (UID: \"91237fff-0d08-49cd-8a69-e2f3540b400e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7"
Jul 17 17:28:33.965084 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:33.965047    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91237fff-0d08-49cd-8a69-e2f3540b400e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7\" (UID: \"91237fff-0d08-49cd-8a69-e2f3540b400e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7"
Jul 17 17:28:33.965745 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:33.965717    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91237fff-0d08-49cd-8a69-e2f3540b400e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7\" (UID: \"91237fff-0d08-49cd-8a69-e2f3540b400e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7"
Jul 17 17:28:34.088954 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:34.088924    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7"
Jul 17 17:28:34.218628 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:34.218603    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7"]
Jul 17 17:28:34.220849 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:28:34.220821    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91237fff_0d08_49cd_8a69_e2f3540b400e.slice/crio-81e1c6d871bcf668f2c00fbdf898a78e34982c0ed8dcc38d2d31c87cef5b069d WatchSource:0}: Error finding container 81e1c6d871bcf668f2c00fbdf898a78e34982c0ed8dcc38d2d31c87cef5b069d: Status 404 returned error can't find the container with id 81e1c6d871bcf668f2c00fbdf898a78e34982c0ed8dcc38d2d31c87cef5b069d
Jul 17 17:28:34.874645 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:34.874612    2566 generic.go:356] "Generic (PLEG): container finished" podID="91237fff-0d08-49cd-8a69-e2f3540b400e" containerID="bab036093d0d987530fc477e239f42186d93f94e51de0e3130880abdcedab6de" exitCode=7
Jul 17 17:28:34.874950 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:34.874697    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7" event={"ID":"91237fff-0d08-49cd-8a69-e2f3540b400e","Type":"ContainerDied","Data":"bab036093d0d987530fc477e239f42186d93f94e51de0e3130880abdcedab6de"}
Jul 17 17:28:34.874950 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:34.874754    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7" event={"ID":"91237fff-0d08-49cd-8a69-e2f3540b400e","Type":"ContainerStarted","Data":"81e1c6d871bcf668f2c00fbdf898a78e34982c0ed8dcc38d2d31c87cef5b069d"}
Jul 17 17:28:34.874950 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:34.874850    2566 scope.go:117] "RemoveContainer" containerID="bab036093d0d987530fc477e239f42186d93f94e51de0e3130880abdcedab6de"
Jul 17 17:28:35.881593 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:35.881560    2566 generic.go:356] "Generic (PLEG): container finished" podID="91237fff-0d08-49cd-8a69-e2f3540b400e" containerID="7b6c10b95631953b3970301eba60316abf911d63e84ec27eb70bf666f5bb7dfc" exitCode=7
Jul 17 17:28:35.882005 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:35.881600    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7" event={"ID":"91237fff-0d08-49cd-8a69-e2f3540b400e","Type":"ContainerDied","Data":"7b6c10b95631953b3970301eba60316abf911d63e84ec27eb70bf666f5bb7dfc"}
Jul 17 17:28:35.882005 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:35.881645    2566 scope.go:117] "RemoveContainer" containerID="bab036093d0d987530fc477e239f42186d93f94e51de0e3130880abdcedab6de"
Jul 17 17:28:35.882005 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:35.881841    2566 scope.go:117] "RemoveContainer" containerID="7b6c10b95631953b3970301eba60316abf911d63e84ec27eb70bf666f5bb7dfc"
Jul 17 17:28:35.882137 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:28:35.882012    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7_odh-ai-gateway-infra(91237fff-0d08-49cd-8a69-e2f3540b400e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7" podUID="91237fff-0d08-49cd-8a69-e2f3540b400e"
Jul 17 17:28:35.900726 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:35.900698    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr"]
Jul 17 17:28:35.905333 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:35.905301    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr"
Jul 17 17:28:35.910199 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:35.910174    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr"]
Jul 17 17:28:35.980996 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:35.980960    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d429da-f417-451e-876e-19510634f38f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-xnmpr\" (UID: \"60d429da-f417-451e-876e-19510634f38f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr"
Jul 17 17:28:36.082351 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:36.082288    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d429da-f417-451e-876e-19510634f38f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-xnmpr\" (UID: \"60d429da-f417-451e-876e-19510634f38f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr"
Jul 17 17:28:36.082905 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:36.082878    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d429da-f417-451e-876e-19510634f38f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-xnmpr\" (UID: \"60d429da-f417-451e-876e-19510634f38f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr"
Jul 17 17:28:36.218399 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:36.218277    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr"
Jul 17 17:28:36.347910 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:36.347881    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr"]
Jul 17 17:28:36.349966 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:28:36.349934    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d429da_f417_451e_876e_19510634f38f.slice/crio-26d691bc4f1362d38e0589341704139a249442bae6f4b1e014594af5041df00c WatchSource:0}: Error finding container 26d691bc4f1362d38e0589341704139a249442bae6f4b1e014594af5041df00c: Status 404 returned error can't find the container with id 26d691bc4f1362d38e0589341704139a249442bae6f4b1e014594af5041df00c
Jul 17 17:28:36.889091 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:36.889061    2566 scope.go:117] "RemoveContainer" containerID="7b6c10b95631953b3970301eba60316abf911d63e84ec27eb70bf666f5bb7dfc"
Jul 17 17:28:36.889534 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:28:36.889281    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7_odh-ai-gateway-infra(91237fff-0d08-49cd-8a69-e2f3540b400e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7" podUID="91237fff-0d08-49cd-8a69-e2f3540b400e"
Jul 17 17:28:36.890284 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:36.890262    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr" event={"ID":"60d429da-f417-451e-876e-19510634f38f","Type":"ContainerStarted","Data":"a0b889dacf341ae20f7131e0ecd4771ba41f02718e110ea15165914c71c16af9"}
Jul 17 17:28:36.890360 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:36.890304    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr" event={"ID":"60d429da-f417-451e-876e-19510634f38f","Type":"ContainerStarted","Data":"26d691bc4f1362d38e0589341704139a249442bae6f4b1e014594af5041df00c"}
Jul 17 17:28:36.920202 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:36.920162    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr" podStartSLOduration=1.920148757 podStartE2EDuration="1.920148757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:28:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:28:36.919178463 +0000 UTC m=+3765.778307024" watchObservedRunningTime="2026-07-17 17:28:36.920148757 +0000 UTC m=+3765.779277315"
Jul 17 17:28:37.896724 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:37.896690    2566 generic.go:356] "Generic (PLEG): container finished" podID="60d429da-f417-451e-876e-19510634f38f" containerID="a0b889dacf341ae20f7131e0ecd4771ba41f02718e110ea15165914c71c16af9" exitCode=7
Jul 17 17:28:37.897099 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:37.896772    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr" event={"ID":"60d429da-f417-451e-876e-19510634f38f","Type":"ContainerDied","Data":"a0b889dacf341ae20f7131e0ecd4771ba41f02718e110ea15165914c71c16af9"}
Jul 17 17:28:37.897099 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:37.896930    2566 scope.go:117] "RemoveContainer" containerID="a0b889dacf341ae20f7131e0ecd4771ba41f02718e110ea15165914c71c16af9"
Jul 17 17:28:38.904003 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:38.903970    2566 generic.go:356] "Generic (PLEG): container finished" podID="60d429da-f417-451e-876e-19510634f38f" containerID="f81eead5e9f529846315aab6a460fd47a36a70e6bbb4ef9b3955e686d70daa0d" exitCode=7
Jul 17 17:28:38.904448 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:38.904057    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr" event={"ID":"60d429da-f417-451e-876e-19510634f38f","Type":"ContainerDied","Data":"f81eead5e9f529846315aab6a460fd47a36a70e6bbb4ef9b3955e686d70daa0d"}
Jul 17 17:28:38.904448 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:38.904167    2566 scope.go:117] "RemoveContainer" containerID="a0b889dacf341ae20f7131e0ecd4771ba41f02718e110ea15165914c71c16af9"
Jul 17 17:28:38.904448 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:38.904193    2566 scope.go:117] "RemoveContainer" containerID="f81eead5e9f529846315aab6a460fd47a36a70e6bbb4ef9b3955e686d70daa0d"
Jul 17 17:28:38.904448 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:28:38.904438    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-xnmpr_odh-ai-gateway-infra(60d429da-f417-451e-876e-19510634f38f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr" podUID="60d429da-f417-451e-876e-19510634f38f"
Jul 17 17:28:39.911458 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:39.911431    2566 scope.go:117] "RemoveContainer" containerID="f81eead5e9f529846315aab6a460fd47a36a70e6bbb4ef9b3955e686d70daa0d"
Jul 17 17:28:39.911824 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:28:39.911614    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-xnmpr_odh-ai-gateway-infra(60d429da-f417-451e-876e-19510634f38f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr" podUID="60d429da-f417-451e-876e-19510634f38f"
Jul 17 17:28:40.025690 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:40.025668    2566 scope.go:117] "RemoveContainer" containerID="dbb4d564b5b90bab56557f4c6003a09a24d1d44961fd755cf4d2f3e84cdcb93a"
Jul 17 17:28:40.917564 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:40.917533    2566 generic.go:356] "Generic (PLEG): container finished" podID="ed73f804-5841-4635-84e6-707b4e74f4af" containerID="032303c6228d67c8aebadc49aeffe6fb0dde75429242899ab8f2129434ffd548" exitCode=7
Jul 17 17:28:40.917974 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:40.917599    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g" event={"ID":"ed73f804-5841-4635-84e6-707b4e74f4af","Type":"ContainerDied","Data":"032303c6228d67c8aebadc49aeffe6fb0dde75429242899ab8f2129434ffd548"}
Jul 17 17:28:40.917974 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:40.917660    2566 scope.go:117] "RemoveContainer" containerID="dbb4d564b5b90bab56557f4c6003a09a24d1d44961fd755cf4d2f3e84cdcb93a"
Jul 17 17:28:40.918095 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:40.918004    2566 scope.go:117] "RemoveContainer" containerID="032303c6228d67c8aebadc49aeffe6fb0dde75429242899ab8f2129434ffd548"
Jul 17 17:28:40.918252 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:28:40.918232    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g_odh-ai-gateway-infra(ed73f804-5841-4635-84e6-707b4e74f4af)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g" podUID="ed73f804-5841-4635-84e6-707b4e74f4af"
Jul 17 17:28:41.942467 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:41.942435    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g"]
Jul 17 17:28:42.078696 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:42.078674    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g"
Jul 17 17:28:42.135297 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:42.135266    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed73f804-5841-4635-84e6-707b4e74f4af-maas-api-service-ca\") pod \"ed73f804-5841-4635-84e6-707b4e74f4af\" (UID: \"ed73f804-5841-4635-84e6-707b4e74f4af\") "
Jul 17 17:28:42.135627 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:42.135591    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed73f804-5841-4635-84e6-707b4e74f4af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ed73f804-5841-4635-84e6-707b4e74f4af" (UID: "ed73f804-5841-4635-84e6-707b4e74f4af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:28:42.135754 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:42.135684    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed73f804-5841-4635-84e6-707b4e74f4af-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:28:42.931266 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:42.931236    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g"
Jul 17 17:28:42.931492 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:42.931285    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g" event={"ID":"ed73f804-5841-4635-84e6-707b4e74f4af","Type":"ContainerDied","Data":"37a1ae1c5da7d3f119f83766845e7bc7a62f349107209a158796e694dedfa4b2"}
Jul 17 17:28:42.931492 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:42.931369    2566 scope.go:117] "RemoveContainer" containerID="032303c6228d67c8aebadc49aeffe6fb0dde75429242899ab8f2129434ffd548"
Jul 17 17:28:42.954528 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:42.954501    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g"]
Jul 17 17:28:42.957984 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:42.957948    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-bn62g"]
Jul 17 17:28:43.032119 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:43.032088    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed73f804-5841-4635-84e6-707b4e74f4af" path="/var/lib/kubelet/pods/ed73f804-5841-4635-84e6-707b4e74f4af/volumes"
Jul 17 17:28:49.026284 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.026204    2566 scope.go:117] "RemoveContainer" containerID="7b6c10b95631953b3970301eba60316abf911d63e84ec27eb70bf666f5bb7dfc"
Jul 17 17:28:49.578156 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.578126    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"]
Jul 17 17:28:49.578560 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.578546    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed73f804-5841-4635-84e6-707b4e74f4af" containerName="revoke-keys"
Jul 17 17:28:49.578606 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.578562    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed73f804-5841-4635-84e6-707b4e74f4af" containerName="revoke-keys"
Jul 17 17:28:49.578606 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.578573    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed73f804-5841-4635-84e6-707b4e74f4af" containerName="revoke-keys"
Jul 17 17:28:49.578606 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.578579    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed73f804-5841-4635-84e6-707b4e74f4af" containerName="revoke-keys"
Jul 17 17:28:49.578703 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.578648    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed73f804-5841-4635-84e6-707b4e74f4af" containerName="revoke-keys"
Jul 17 17:28:49.578703 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.578661    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed73f804-5841-4635-84e6-707b4e74f4af" containerName="revoke-keys"
Jul 17 17:28:49.582047 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.582027    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.584568 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.584551    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-7ca540-openshift-default-dockercfg-hb769\""
Jul 17 17:28:49.593884 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.593861    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"]
Jul 17 17:28:49.708364 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.708312    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-envoy\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.708493 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.708435    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-workload-certs\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.708493 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.708474    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8bmz\" (UniqueName: \"kubernetes.io/projected/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-kube-api-access-c8bmz\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.708565 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.708496    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-podinfo\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.708565 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.708526    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-credential-socket\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.708650 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.708623    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-data\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.708686 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.708659    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istiod-ca-cert\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.708718 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.708697    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-workload-socket\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.708755 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.708727    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-token\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.810099 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.810067    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-workload-certs\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.810295 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.810113    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8bmz\" (UniqueName: \"kubernetes.io/projected/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-kube-api-access-c8bmz\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.810295 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.810140    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-podinfo\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.810295 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.810259    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-credential-socket\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.810510 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.810310    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-data\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.810510 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.810378    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istiod-ca-cert\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.810510 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.810425    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-workload-socket\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.810510 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.810468    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-token\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.810710 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.810532    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-envoy\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.810710 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.810579    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-workload-certs\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.810710 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.810661    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-credential-socket\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.810876 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.810847    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-data\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.810942 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.810910    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-workload-socket\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.811164 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.811142    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istiod-ca-cert\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.812731 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.812703    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-podinfo\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.812857 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.812840    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-envoy\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.820878 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.820839    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-token\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.822340 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.822296    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8bmz\" (UniqueName: \"kubernetes.io/projected/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-kube-api-access-c8bmz\") pod \"e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") " pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.892813 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.892732    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:49.974718 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.974681    2566 generic.go:356] "Generic (PLEG): container finished" podID="91237fff-0d08-49cd-8a69-e2f3540b400e" containerID="f9eff0abb21043833b1afd2b6546059785395ab065ae359098be7542060bc741" exitCode=7
Jul 17 17:28:49.974888 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.974747    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7" event={"ID":"91237fff-0d08-49cd-8a69-e2f3540b400e","Type":"ContainerDied","Data":"f9eff0abb21043833b1afd2b6546059785395ab065ae359098be7542060bc741"}
Jul 17 17:28:49.974888 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.974813    2566 scope.go:117] "RemoveContainer" containerID="7b6c10b95631953b3970301eba60316abf911d63e84ec27eb70bf666f5bb7dfc"
Jul 17 17:28:49.975105 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:49.975088    2566 scope.go:117] "RemoveContainer" containerID="f9eff0abb21043833b1afd2b6546059785395ab065ae359098be7542060bc741"
Jul 17 17:28:49.975382 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:28:49.975363    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7_odh-ai-gateway-infra(91237fff-0d08-49cd-8a69-e2f3540b400e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7" podUID="91237fff-0d08-49cd-8a69-e2f3540b400e"
Jul 17 17:28:50.045493 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:50.045461    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"]
Jul 17 17:28:50.046555 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:28:50.046529    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3738ff_2e47_4d7b_96fa_8bdd6ff7ad06.slice/crio-4c536980a9e4ba114f9f253e0706829269a2698f128fdba61b22e5da269beaf9 WatchSource:0}: Error finding container 4c536980a9e4ba114f9f253e0706829269a2698f128fdba61b22e5da269beaf9: Status 404 returned error can't find the container with id 4c536980a9e4ba114f9f253e0706829269a2698f128fdba61b22e5da269beaf9
Jul 17 17:28:50.049057 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:50.049021    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:28:50.049137 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:50.049114    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:28:50.049181 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:50.049166    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:28:50.983089 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:50.983062    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv" event={"ID":"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06","Type":"ContainerStarted","Data":"9493ced14a480d7cf48159c34136f1239e42c111d651f2a1fd8d2e986e5dd1b4"}
Jul 17 17:28:50.983251 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:50.983108    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv" event={"ID":"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06","Type":"ContainerStarted","Data":"4c536980a9e4ba114f9f253e0706829269a2698f128fdba61b22e5da269beaf9"}
Jul 17 17:28:51.012000 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.011971    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7"]
Jul 17 17:28:51.024612 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.024549    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv" podStartSLOduration=2.024528959 podStartE2EDuration="2.024528959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:28:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:28:51.017196641 +0000 UTC m=+3779.876325202" watchObservedRunningTime="2026-07-17 17:28:51.024528959 +0000 UTC m=+3779.883657519"
Jul 17 17:28:51.027694 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.027672    2566 scope.go:117] "RemoveContainer" containerID="f81eead5e9f529846315aab6a460fd47a36a70e6bbb4ef9b3955e686d70daa0d"
Jul 17 17:28:51.164924 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.164898    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7"
Jul 17 17:28:51.224670 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.224640    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91237fff-0d08-49cd-8a69-e2f3540b400e-maas-api-service-ca\") pod \"91237fff-0d08-49cd-8a69-e2f3540b400e\" (UID: \"91237fff-0d08-49cd-8a69-e2f3540b400e\") "
Jul 17 17:28:51.225010 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.224987    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91237fff-0d08-49cd-8a69-e2f3540b400e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "91237fff-0d08-49cd-8a69-e2f3540b400e" (UID: "91237fff-0d08-49cd-8a69-e2f3540b400e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:28:51.325940 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.325915    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91237fff-0d08-49cd-8a69-e2f3540b400e-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:28:51.893177 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.893135    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:51.897906 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.897883    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:51.989673 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.989642    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7"
Jul 17 17:28:51.989846 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.989641    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7" event={"ID":"91237fff-0d08-49cd-8a69-e2f3540b400e","Type":"ContainerDied","Data":"81e1c6d871bcf668f2c00fbdf898a78e34982c0ed8dcc38d2d31c87cef5b069d"}
Jul 17 17:28:51.989846 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.989801    2566 scope.go:117] "RemoveContainer" containerID="f9eff0abb21043833b1afd2b6546059785395ab065ae359098be7542060bc741"
Jul 17 17:28:51.991613 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.991589    2566 generic.go:356] "Generic (PLEG): container finished" podID="60d429da-f417-451e-876e-19510634f38f" containerID="048db62ab31d17a635dae7dd05bfa503d42256f2e710c5700929e7b0ab569ab8" exitCode=7
Jul 17 17:28:51.991752 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.991655    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr" event={"ID":"60d429da-f417-451e-876e-19510634f38f","Type":"ContainerDied","Data":"048db62ab31d17a635dae7dd05bfa503d42256f2e710c5700929e7b0ab569ab8"}
Jul 17 17:28:51.991946 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.991927    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:51.992090 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.992073    2566 scope.go:117] "RemoveContainer" containerID="048db62ab31d17a635dae7dd05bfa503d42256f2e710c5700929e7b0ab569ab8"
Jul 17 17:28:51.992335 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:28:51.992298    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-xnmpr_odh-ai-gateway-infra(60d429da-f417-451e-876e-19510634f38f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr" podUID="60d429da-f417-451e-876e-19510634f38f"
Jul 17 17:28:51.993219 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.993196    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:28:51.999470 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:51.999455    2566 scope.go:117] "RemoveContainer" containerID="f81eead5e9f529846315aab6a460fd47a36a70e6bbb4ef9b3955e686d70daa0d"
Jul 17 17:28:52.044103 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:52.044033    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7"]
Jul 17 17:28:52.046616 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:52.046591    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-l7hk7"]
Jul 17 17:28:53.037914 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:53.037878    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91237fff-0d08-49cd-8a69-e2f3540b400e" path="/var/lib/kubelet/pods/91237fff-0d08-49cd-8a69-e2f3540b400e/volumes"
Jul 17 17:28:53.041665 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:53.041638    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr"]
Jul 17 17:28:53.184130 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:53.184104    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr"
Jul 17 17:28:53.242933 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:53.242903    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d429da-f417-451e-876e-19510634f38f-maas-api-service-ca\") pod \"60d429da-f417-451e-876e-19510634f38f\" (UID: \"60d429da-f417-451e-876e-19510634f38f\") "
Jul 17 17:28:53.243232 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:53.243208    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60d429da-f417-451e-876e-19510634f38f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "60d429da-f417-451e-876e-19510634f38f" (UID: "60d429da-f417-451e-876e-19510634f38f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:28:53.344252 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:53.344159    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d429da-f417-451e-876e-19510634f38f-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:28:54.007039 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:54.007009    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr"
Jul 17 17:28:54.007221 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:54.007053    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr" event={"ID":"60d429da-f417-451e-876e-19510634f38f","Type":"ContainerDied","Data":"26d691bc4f1362d38e0589341704139a249442bae6f4b1e014594af5041df00c"}
Jul 17 17:28:54.007221 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:54.007119    2566 scope.go:117] "RemoveContainer" containerID="048db62ab31d17a635dae7dd05bfa503d42256f2e710c5700929e7b0ab569ab8"
Jul 17 17:28:54.028366 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:54.028343    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr"]
Jul 17 17:28:54.032115 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:54.032096    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-xnmpr"]
Jul 17 17:28:55.031131 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:55.031097    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60d429da-f417-451e-876e-19510634f38f" path="/var/lib/kubelet/pods/60d429da-f417-451e-876e-19510634f38f/volumes"
Jul 17 17:28:58.031441 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.031409    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"]
Jul 17 17:28:58.031904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.031864    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d429da-f417-451e-876e-19510634f38f" containerName="revoke-keys"
Jul 17 17:28:58.031904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.031878    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d429da-f417-451e-876e-19510634f38f" containerName="revoke-keys"
Jul 17 17:28:58.031904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.031891    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91237fff-0d08-49cd-8a69-e2f3540b400e" containerName="revoke-keys"
Jul 17 17:28:58.031904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.031896    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="91237fff-0d08-49cd-8a69-e2f3540b400e" containerName="revoke-keys"
Jul 17 17:28:58.031904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.031904    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91237fff-0d08-49cd-8a69-e2f3540b400e" containerName="revoke-keys"
Jul 17 17:28:58.032069 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.031910    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="91237fff-0d08-49cd-8a69-e2f3540b400e" containerName="revoke-keys"
Jul 17 17:28:58.032069 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.031924    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed73f804-5841-4635-84e6-707b4e74f4af" containerName="revoke-keys"
Jul 17 17:28:58.032069 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.031930    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed73f804-5841-4635-84e6-707b4e74f4af" containerName="revoke-keys"
Jul 17 17:28:58.032069 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.031947    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d429da-f417-451e-876e-19510634f38f" containerName="revoke-keys"
Jul 17 17:28:58.032069 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.031952    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d429da-f417-451e-876e-19510634f38f" containerName="revoke-keys"
Jul 17 17:28:58.032069 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.032007    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d429da-f417-451e-876e-19510634f38f" containerName="revoke-keys"
Jul 17 17:28:58.032069 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.032015    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed73f804-5841-4635-84e6-707b4e74f4af" containerName="revoke-keys"
Jul 17 17:28:58.032069 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.032024    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="91237fff-0d08-49cd-8a69-e2f3540b400e" containerName="revoke-keys"
Jul 17 17:28:58.032069 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.032030    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="91237fff-0d08-49cd-8a69-e2f3540b400e" containerName="revoke-keys"
Jul 17 17:28:58.032069 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.032037    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="91237fff-0d08-49cd-8a69-e2f3540b400e" containerName="revoke-keys"
Jul 17 17:28:58.032069 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.032044    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d429da-f417-451e-876e-19510634f38f" containerName="revoke-keys"
Jul 17 17:28:58.036694 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.036677    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.039228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.039208    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f748a7-openshift-default-dockercfg-pntxr\""
Jul 17 17:28:58.051761 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.051737    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"]
Jul 17 17:28:58.191297 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.191214    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-istio-data\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.191501 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.191366    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-workload-socket\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.191501 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.191405    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-workload-certs\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.191501 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.191468    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ngl2\" (UniqueName: \"kubernetes.io/projected/12ee698a-0a84-4547-8948-3631f8970baf-kube-api-access-7ngl2\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.191501 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.191494    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12ee698a-0a84-4547-8948-3631f8970baf-istio-podinfo\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.191643 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.191574    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-credential-socket\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.191643 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.191612    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-istio-envoy\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.191643 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.191628    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12ee698a-0a84-4547-8948-3631f8970baf-istio-token\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.191740 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.191689    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12ee698a-0a84-4547-8948-3631f8970baf-istiod-ca-cert\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.292781 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.292689    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-credential-socket\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.292781 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.292732    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-istio-envoy\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.292781 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.292750    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12ee698a-0a84-4547-8948-3631f8970baf-istio-token\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.292781 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.292780    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12ee698a-0a84-4547-8948-3631f8970baf-istiod-ca-cert\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.293144 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.292799    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-istio-data\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.293144 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.292823    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-workload-socket\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.293144 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.292839    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-workload-certs\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.293144 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.292881    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ngl2\" (UniqueName: \"kubernetes.io/projected/12ee698a-0a84-4547-8948-3631f8970baf-kube-api-access-7ngl2\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.293144 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.292902    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12ee698a-0a84-4547-8948-3631f8970baf-istio-podinfo\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.293519 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.293377    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-istio-data\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.293584 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.293546    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-workload-socket\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.293584 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.293569    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-workload-certs\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.293694 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.293651    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12ee698a-0a84-4547-8948-3631f8970baf-istiod-ca-cert\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.293694 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.293667    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-credential-socket\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.295123 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.295102    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-istio-envoy\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.295424 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.295405    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12ee698a-0a84-4547-8948-3631f8970baf-istio-podinfo\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.300526 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.300500    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12ee698a-0a84-4547-8948-3631f8970baf-istio-token\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.300815 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.300793    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ngl2\" (UniqueName: \"kubernetes.io/projected/12ee698a-0a84-4547-8948-3631f8970baf-kube-api-access-7ngl2\") pod \"e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") " pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.346686 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.346651    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:58.488131 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.488102    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"]
Jul 17 17:28:58.490555 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:28:58.490525    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ee698a_0a84_4547_8948_3631f8970baf.slice/crio-da809b5f6bbd27be69452c3e8dfe2d36327fab7b65a12389cba3da7f486a197f WatchSource:0}: Error finding container da809b5f6bbd27be69452c3e8dfe2d36327fab7b65a12389cba3da7f486a197f: Status 404 returned error can't find the container with id da809b5f6bbd27be69452c3e8dfe2d36327fab7b65a12389cba3da7f486a197f
Jul 17 17:28:58.492792 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.492754    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:28:58.492885 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.492864    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:28:58.492935 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:58.492919    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:28:59.037502 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:59.037465    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf" event={"ID":"12ee698a-0a84-4547-8948-3631f8970baf","Type":"ContainerStarted","Data":"440290e3f28ea93cddd64c6ccec6a31093d6acb6ad4e2935f5d4c2d0e743fde1"}
Jul 17 17:28:59.037885 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:59.037519    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf" event={"ID":"12ee698a-0a84-4547-8948-3631f8970baf","Type":"ContainerStarted","Data":"da809b5f6bbd27be69452c3e8dfe2d36327fab7b65a12389cba3da7f486a197f"}
Jul 17 17:28:59.062873 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:59.062819    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf" podStartSLOduration=1.062802236 podStartE2EDuration="1.062802236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:28:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:28:59.061879744 +0000 UTC m=+3787.921008328" watchObservedRunningTime="2026-07-17 17:28:59.062802236 +0000 UTC m=+3787.921930797"
Jul 17 17:28:59.347157 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:59.347075    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:28:59.352206 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:28:59.352181    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:29:00.042952 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:00.042923    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:29:00.044076 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:00.044055    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:29:08.033509 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:08.033464    2566 patch_prober.go:28] interesting pod/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 17:29:08.033892 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:08.033550    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv" podUID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 17:29:09.093233 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:09.093191    2566 generic.go:356] "Generic (PLEG): container finished" podID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerID="9493ced14a480d7cf48159c34136f1239e42c111d651f2a1fd8d2e986e5dd1b4" exitCode=0
Jul 17 17:29:09.093695 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:09.093270    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv" event={"ID":"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06","Type":"ContainerDied","Data":"9493ced14a480d7cf48159c34136f1239e42c111d651f2a1fd8d2e986e5dd1b4"}
Jul 17 17:29:09.093695 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:09.093666    2566 scope.go:117] "RemoveContainer" containerID="9493ced14a480d7cf48159c34136f1239e42c111d651f2a1fd8d2e986e5dd1b4"
Jul 17 17:29:09.094632 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:09.094601    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:29:09.094741 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:09.094700    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:29:09.094741 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:09.094730    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:29:10.100995 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:10.100961    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv" event={"ID":"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06","Type":"ContainerStarted","Data":"6556b0a74d72d2c509cf2ad9aaaa53f59352f9e007e55f97fa6912ead8486d49"}
Jul 17 17:29:10.893801 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:10.893753    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:29:10.894042 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:10.894016    2566 patch_prober.go:28] interesting pod/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 17 17:29:10.894229 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:10.894199    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv" podUID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 17 17:29:11.893564 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:11.893528    2566 patch_prober.go:28] interesting pod/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 17 17:29:11.893978 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:11.893583    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv" podUID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 17 17:29:12.893350 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:12.893288    2566 patch_prober.go:28] interesting pod/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 17 17:29:12.893574 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:12.893376    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv" podUID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 17 17:29:13.893339 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:13.893277    2566 patch_prober.go:28] interesting pod/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 17 17:29:13.893762 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:13.893394    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv" podUID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 17 17:29:14.896407 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:14.896311    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:29:14.896755 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:14.896722    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:29:14.897303 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:14.897282    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:29:16.084473 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:16.084438    2566 patch_prober.go:28] interesting pod/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 17:29:16.084947 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:16.084497    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf" podUID="12ee698a-0a84-4547-8948-3631f8970baf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 17:29:18.156593 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:18.156562    2566 generic.go:356] "Generic (PLEG): container finished" podID="12ee698a-0a84-4547-8948-3631f8970baf" containerID="440290e3f28ea93cddd64c6ccec6a31093d6acb6ad4e2935f5d4c2d0e743fde1" exitCode=0
Jul 17 17:29:18.157138 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:18.156645    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf" event={"ID":"12ee698a-0a84-4547-8948-3631f8970baf","Type":"ContainerDied","Data":"440290e3f28ea93cddd64c6ccec6a31093d6acb6ad4e2935f5d4c2d0e743fde1"}
Jul 17 17:29:18.157208 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:18.157176    2566 scope.go:117] "RemoveContainer" containerID="440290e3f28ea93cddd64c6ccec6a31093d6acb6ad4e2935f5d4c2d0e743fde1"
Jul 17 17:29:18.158275 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:18.158250    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:29:18.158355 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:18.158330    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:29:18.158400 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:18.158372    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:29:19.164063 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:19.164029    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf" event={"ID":"12ee698a-0a84-4547-8948-3631f8970baf","Type":"ContainerStarted","Data":"a765b6fa14a6f430f57ce569537f3fc3249d77da896043d51f1453a0f9fe7b7e"}
Jul 17 17:29:19.347051 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:19.347018    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:29:19.347226 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:19.347197    2566 patch_prober.go:28] interesting pod/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 17 17:29:19.347274 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:19.347243    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf" podUID="12ee698a-0a84-4547-8948-3631f8970baf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 17 17:29:20.347272 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:20.347234    2566 patch_prober.go:28] interesting pod/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 17 17:29:20.347680 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:20.347292    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf" podUID="12ee698a-0a84-4547-8948-3631f8970baf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 17 17:29:21.347270 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:21.347235    2566 patch_prober.go:28] interesting pod/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 17 17:29:21.347703 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:21.347291    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf" podUID="12ee698a-0a84-4547-8948-3631f8970baf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 17 17:29:22.347595 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:22.347559    2566 patch_prober.go:28] interesting pod/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 17 17:29:22.347999 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:22.347611    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf" podUID="12ee698a-0a84-4547-8948-3631f8970baf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 17 17:29:23.351241 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:23.351213    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:29:23.351658 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:23.351559    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:29:23.352236 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:23.352220    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:29:23.824097 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:23.824054    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj"]
Jul 17 17:29:23.824992 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:23.824967    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91237fff-0d08-49cd-8a69-e2f3540b400e" containerName="revoke-keys"
Jul 17 17:29:23.824992 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:23.824993    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="91237fff-0d08-49cd-8a69-e2f3540b400e" containerName="revoke-keys"
Jul 17 17:29:23.825199 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:23.825058    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d429da-f417-451e-876e-19510634f38f" containerName="revoke-keys"
Jul 17 17:29:23.825199 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:23.825067    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d429da-f417-451e-876e-19510634f38f" containerName="revoke-keys"
Jul 17 17:29:23.825313 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:23.825266    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d429da-f417-451e-876e-19510634f38f" containerName="revoke-keys"
Jul 17 17:29:23.829024 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:23.828996    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj"
Jul 17 17:29:23.831517 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:23.831491    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:29:23.831707 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:23.831675    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:29:23.831836 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:23.831740    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj"]
Jul 17 17:29:23.961634 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:23.961605    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/498e21f8-80ef-4fb3-a740-97f2d1d29fed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj\" (UID: \"498e21f8-80ef-4fb3-a740-97f2d1d29fed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj"
Jul 17 17:29:24.062842 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:24.062818    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/498e21f8-80ef-4fb3-a740-97f2d1d29fed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj\" (UID: \"498e21f8-80ef-4fb3-a740-97f2d1d29fed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj"
Jul 17 17:29:24.063466 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:24.063449    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/498e21f8-80ef-4fb3-a740-97f2d1d29fed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj\" (UID: \"498e21f8-80ef-4fb3-a740-97f2d1d29fed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj"
Jul 17 17:29:24.141187 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:24.141120    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj"
Jul 17 17:29:24.276218 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:24.276191    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj"]
Jul 17 17:29:24.278268 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:29:24.278240    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod498e21f8_80ef_4fb3_a740_97f2d1d29fed.slice/crio-4d7b3d522236434c8ad0871028c1ce64e5fa8bc9f446142a65df34e8bbdf53e7 WatchSource:0}: Error finding container 4d7b3d522236434c8ad0871028c1ce64e5fa8bc9f446142a65df34e8bbdf53e7: Status 404 returned error can't find the container with id 4d7b3d522236434c8ad0871028c1ce64e5fa8bc9f446142a65df34e8bbdf53e7
Jul 17 17:29:25.197081 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:25.197052    2566 generic.go:356] "Generic (PLEG): container finished" podID="498e21f8-80ef-4fb3-a740-97f2d1d29fed" containerID="717ae25b9f7f8ccf76ab8c18c12062843ffe96b94c4774aa992794637490a80d" exitCode=7
Jul 17 17:29:25.197427 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:25.197140    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj" event={"ID":"498e21f8-80ef-4fb3-a740-97f2d1d29fed","Type":"ContainerDied","Data":"717ae25b9f7f8ccf76ab8c18c12062843ffe96b94c4774aa992794637490a80d"}
Jul 17 17:29:25.197427 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:25.197195    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj" event={"ID":"498e21f8-80ef-4fb3-a740-97f2d1d29fed","Type":"ContainerStarted","Data":"4d7b3d522236434c8ad0871028c1ce64e5fa8bc9f446142a65df34e8bbdf53e7"}
Jul 17 17:29:25.197427 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:25.197311    2566 scope.go:117] "RemoveContainer" containerID="717ae25b9f7f8ccf76ab8c18c12062843ffe96b94c4774aa992794637490a80d"
Jul 17 17:29:26.205762 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:26.205668    2566 generic.go:356] "Generic (PLEG): container finished" podID="498e21f8-80ef-4fb3-a740-97f2d1d29fed" containerID="b5738257c2df989ad5ae05ab66b3ca8fa755a4bcb5ece2307672c816cce9fcca" exitCode=7
Jul 17 17:29:26.205762 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:26.205752    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj" event={"ID":"498e21f8-80ef-4fb3-a740-97f2d1d29fed","Type":"ContainerDied","Data":"b5738257c2df989ad5ae05ab66b3ca8fa755a4bcb5ece2307672c816cce9fcca"}
Jul 17 17:29:26.206221 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:26.205806    2566 scope.go:117] "RemoveContainer" containerID="717ae25b9f7f8ccf76ab8c18c12062843ffe96b94c4774aa992794637490a80d"
Jul 17 17:29:26.206221 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:26.205983    2566 scope.go:117] "RemoveContainer" containerID="b5738257c2df989ad5ae05ab66b3ca8fa755a4bcb5ece2307672c816cce9fcca"
Jul 17 17:29:26.206295 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:29:26.206223    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj_odh-ai-gateway-infra(498e21f8-80ef-4fb3-a740-97f2d1d29fed)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj" podUID="498e21f8-80ef-4fb3-a740-97f2d1d29fed"
Jul 17 17:29:27.212970 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:27.212945    2566 scope.go:117] "RemoveContainer" containerID="b5738257c2df989ad5ae05ab66b3ca8fa755a4bcb5ece2307672c816cce9fcca"
Jul 17 17:29:27.213391 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:29:27.213147    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj_odh-ai-gateway-infra(498e21f8-80ef-4fb3-a740-97f2d1d29fed)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj" podUID="498e21f8-80ef-4fb3-a740-97f2d1d29fed"
Jul 17 17:29:42.026307 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:42.026269    2566 scope.go:117] "RemoveContainer" containerID="b5738257c2df989ad5ae05ab66b3ca8fa755a4bcb5ece2307672c816cce9fcca"
Jul 17 17:29:42.291484 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:42.291459    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj" event={"ID":"498e21f8-80ef-4fb3-a740-97f2d1d29fed","Type":"ContainerStarted","Data":"e768e34dfedc476e161e51f85928f84d1e079232aa57edf999b6689abc5a0e52"}
Jul 17 17:29:42.307954 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:42.307912    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj" podStartSLOduration=19.307899683 podStartE2EDuration="19.307899683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:29:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:29:42.306618633 +0000 UTC m=+3831.165747192" watchObservedRunningTime="2026-07-17 17:29:42.307899683 +0000 UTC m=+3831.167028242"
Jul 17 17:29:43.298294 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:43.298263    2566 generic.go:356] "Generic (PLEG): container finished" podID="498e21f8-80ef-4fb3-a740-97f2d1d29fed" containerID="e768e34dfedc476e161e51f85928f84d1e079232aa57edf999b6689abc5a0e52" exitCode=7
Jul 17 17:29:43.298693 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:43.298352    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj" event={"ID":"498e21f8-80ef-4fb3-a740-97f2d1d29fed","Type":"ContainerDied","Data":"e768e34dfedc476e161e51f85928f84d1e079232aa57edf999b6689abc5a0e52"}
Jul 17 17:29:43.298693 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:43.298419    2566 scope.go:117] "RemoveContainer" containerID="b5738257c2df989ad5ae05ab66b3ca8fa755a4bcb5ece2307672c816cce9fcca"
Jul 17 17:29:43.298693 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:43.298609    2566 scope.go:117] "RemoveContainer" containerID="e768e34dfedc476e161e51f85928f84d1e079232aa57edf999b6689abc5a0e52"
Jul 17 17:29:43.298834 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:29:43.298819    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj_odh-ai-gateway-infra(498e21f8-80ef-4fb3-a740-97f2d1d29fed)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj" podUID="498e21f8-80ef-4fb3-a740-97f2d1d29fed"
Jul 17 17:29:43.321229 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:43.321197    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj"]
Jul 17 17:29:44.467171 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:44.467145    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj"
Jul 17 17:29:44.644823 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:44.644727    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/498e21f8-80ef-4fb3-a740-97f2d1d29fed-maas-api-service-ca\") pod \"498e21f8-80ef-4fb3-a740-97f2d1d29fed\" (UID: \"498e21f8-80ef-4fb3-a740-97f2d1d29fed\") "
Jul 17 17:29:44.645133 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:44.645108    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/498e21f8-80ef-4fb3-a740-97f2d1d29fed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "498e21f8-80ef-4fb3-a740-97f2d1d29fed" (UID: "498e21f8-80ef-4fb3-a740-97f2d1d29fed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:29:44.745503 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:44.745475    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/498e21f8-80ef-4fb3-a740-97f2d1d29fed-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:29:45.310835 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:45.310756    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj"
Jul 17 17:29:45.310835 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:45.310797    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj" event={"ID":"498e21f8-80ef-4fb3-a740-97f2d1d29fed","Type":"ContainerDied","Data":"4d7b3d522236434c8ad0871028c1ce64e5fa8bc9f446142a65df34e8bbdf53e7"}
Jul 17 17:29:45.311057 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:45.310853    2566 scope.go:117] "RemoveContainer" containerID="e768e34dfedc476e161e51f85928f84d1e079232aa57edf999b6689abc5a0e52"
Jul 17 17:29:45.327066 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:45.327042    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj"]
Jul 17 17:29:45.331498 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:45.331478    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-k5gfj"]
Jul 17 17:29:47.032201 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:47.032171    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="498e21f8-80ef-4fb3-a740-97f2d1d29fed" path="/var/lib/kubelet/pods/498e21f8-80ef-4fb3-a740-97f2d1d29fed/volumes"
Jul 17 17:29:49.726431 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:49.726402    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc"]
Jul 17 17:29:49.726817 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:49.726779    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="498e21f8-80ef-4fb3-a740-97f2d1d29fed" containerName="revoke-keys"
Jul 17 17:29:49.726817 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:49.726790    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="498e21f8-80ef-4fb3-a740-97f2d1d29fed" containerName="revoke-keys"
Jul 17 17:29:49.726817 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:49.726801    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="498e21f8-80ef-4fb3-a740-97f2d1d29fed" containerName="revoke-keys"
Jul 17 17:29:49.726817 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:49.726808    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="498e21f8-80ef-4fb3-a740-97f2d1d29fed" containerName="revoke-keys"
Jul 17 17:29:49.726953 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:49.726871    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="498e21f8-80ef-4fb3-a740-97f2d1d29fed" containerName="revoke-keys"
Jul 17 17:29:49.726953 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:49.726880    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="498e21f8-80ef-4fb3-a740-97f2d1d29fed" containerName="revoke-keys"
Jul 17 17:29:49.731441 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:49.731422    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc"
Jul 17 17:29:49.734466 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:49.734443    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:29:49.734750 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:49.734487    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:29:49.736730 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:49.736708    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc"]
Jul 17 17:29:49.895683 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:49.895654    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79745848-5455-474c-9156-149b36cabfc0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc\" (UID: \"79745848-5455-474c-9156-149b36cabfc0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc"
Jul 17 17:29:49.997138 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:49.997069    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79745848-5455-474c-9156-149b36cabfc0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc\" (UID: \"79745848-5455-474c-9156-149b36cabfc0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc"
Jul 17 17:29:49.997738 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:49.997714    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79745848-5455-474c-9156-149b36cabfc0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc\" (UID: \"79745848-5455-474c-9156-149b36cabfc0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc"
Jul 17 17:29:50.043268 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:50.043246    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc"
Jul 17 17:29:50.174622 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:50.174600    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc"]
Jul 17 17:29:50.177530 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:29:50.177506    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79745848_5455_474c_9156_149b36cabfc0.slice/crio-e981f2ccebfb9869ceb05be5292b04e3d35d7afbd0a2a66d3f49e0b9b6053cbf WatchSource:0}: Error finding container e981f2ccebfb9869ceb05be5292b04e3d35d7afbd0a2a66d3f49e0b9b6053cbf: Status 404 returned error can't find the container with id e981f2ccebfb9869ceb05be5292b04e3d35d7afbd0a2a66d3f49e0b9b6053cbf
Jul 17 17:29:50.339379 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:50.339344    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc" event={"ID":"79745848-5455-474c-9156-149b36cabfc0","Type":"ContainerStarted","Data":"e981f2ccebfb9869ceb05be5292b04e3d35d7afbd0a2a66d3f49e0b9b6053cbf"}
Jul 17 17:29:51.346468 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:51.346428    2566 generic.go:356] "Generic (PLEG): container finished" podID="79745848-5455-474c-9156-149b36cabfc0" containerID="c7702ae3af167456386d68c3f43bde9d64e56dccc7aeb44bf2100b4fe0c6f61e" exitCode=0
Jul 17 17:29:51.346850 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:51.346470    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc" event={"ID":"79745848-5455-474c-9156-149b36cabfc0","Type":"ContainerDied","Data":"c7702ae3af167456386d68c3f43bde9d64e56dccc7aeb44bf2100b4fe0c6f61e"}
Jul 17 17:29:52.485404 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:52.485379    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc"
Jul 17 17:29:52.620668 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:52.620586    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79745848-5455-474c-9156-149b36cabfc0-maas-api-service-ca\") pod \"79745848-5455-474c-9156-149b36cabfc0\" (UID: \"79745848-5455-474c-9156-149b36cabfc0\") "
Jul 17 17:29:52.620920 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:52.620897    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79745848-5455-474c-9156-149b36cabfc0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "79745848-5455-474c-9156-149b36cabfc0" (UID: "79745848-5455-474c-9156-149b36cabfc0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:29:52.721243 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:52.721211    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79745848-5455-474c-9156-149b36cabfc0-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:29:53.357126 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:53.357057    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc"
Jul 17 17:29:53.357256 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:53.357055    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc" event={"ID":"79745848-5455-474c-9156-149b36cabfc0","Type":"ContainerDied","Data":"e981f2ccebfb9869ceb05be5292b04e3d35d7afbd0a2a66d3f49e0b9b6053cbf"}
Jul 17 17:29:53.357256 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:29:53.357177    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e981f2ccebfb9869ceb05be5292b04e3d35d7afbd0a2a66d3f49e0b9b6053cbf"
Jul 17 17:30:00.142877 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.142843    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks"]
Jul 17 17:30:00.143291 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.143274    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79745848-5455-474c-9156-149b36cabfc0" containerName="revoke-keys"
Jul 17 17:30:00.143361 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.143294    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="79745848-5455-474c-9156-149b36cabfc0" containerName="revoke-keys"
Jul 17 17:30:00.143361 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.143313    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="498e21f8-80ef-4fb3-a740-97f2d1d29fed" containerName="revoke-keys"
Jul 17 17:30:00.143361 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.143332    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="498e21f8-80ef-4fb3-a740-97f2d1d29fed" containerName="revoke-keys"
Jul 17 17:30:00.143458 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.143397    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="498e21f8-80ef-4fb3-a740-97f2d1d29fed" containerName="revoke-keys"
Jul 17 17:30:00.143458 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.143406    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="79745848-5455-474c-9156-149b36cabfc0" containerName="revoke-keys"
Jul 17 17:30:00.148278 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.148254    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks"
Jul 17 17:30:00.148627 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.148608    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q"]
Jul 17 17:30:00.150920 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.150897    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:30:00.151800 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.151783    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz"]
Jul 17 17:30:00.151920 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.151904    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q"
Jul 17 17:30:00.155053 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.155025    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz"
Jul 17 17:30:00.158058 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.158039    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks"]
Jul 17 17:30:00.160726 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.160706    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks"
Jul 17 17:30:00.173239 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.173206    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q"
Jul 17 17:30:00.173452 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.173434    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q"]
Jul 17 17:30:00.178671 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.178650    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz"]
Jul 17 17:30:00.179978 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.179955    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77"]
Jul 17 17:30:00.193464 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.192860    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77"
Jul 17 17:30:00.200139 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.200044    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77"]
Jul 17 17:30:00.230344 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.230296    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz"
Jul 17 17:30:00.232715 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.232690    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77"]
Jul 17 17:30:00.242650 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.242557    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77"
Jul 17 17:30:00.586146 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.586124    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks"]
Jul 17 17:30:00.588624 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:30:00.588590    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93657b5e_4a8a_4f86_8ddf_5fc62f26ee75.slice/crio-973de17ff5b98c6e74957fea2575df5bc1e89109383fbf16841a54428a72da26 WatchSource:0}: Error finding container 973de17ff5b98c6e74957fea2575df5bc1e89109383fbf16841a54428a72da26: Status 404 returned error can't find the container with id 973de17ff5b98c6e74957fea2575df5bc1e89109383fbf16841a54428a72da26
Jul 17 17:30:00.623563 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.623533    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q"]
Jul 17 17:30:00.628603 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:30:00.628579    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode316a5ac_c1a7_46a6_876e_75a58fd605af.slice/crio-781b26d50ce102b9ca0160681d82f370fe46996dcc1c6dcc2e3943541d0840a3 WatchSource:0}: Error finding container 781b26d50ce102b9ca0160681d82f370fe46996dcc1c6dcc2e3943541d0840a3: Status 404 returned error can't find the container with id 781b26d50ce102b9ca0160681d82f370fe46996dcc1c6dcc2e3943541d0840a3
Jul 17 17:30:00.652412 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.652345    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz"]
Jul 17 17:30:00.654624 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:00.654594    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77"]
Jul 17 17:30:00.654731 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:30:00.654671    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca446cb8_a570_4f8b_ad39_d1c4c24f9a63.slice/crio-5bba52a2d6650c3c56fc585cfabdce4c79d23383de8ecfd684b75addd2eea8fb WatchSource:0}: Error finding container 5bba52a2d6650c3c56fc585cfabdce4c79d23383de8ecfd684b75addd2eea8fb: Status 404 returned error can't find the container with id 5bba52a2d6650c3c56fc585cfabdce4c79d23383de8ecfd684b75addd2eea8fb
Jul 17 17:30:00.655727 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:30:00.655651    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57d73bc_d3d6_4119_b86b_b8719f933085.slice/crio-2464164d433217412813afb4da162f0ee52a5afa714539331fc4d070925a31b2 WatchSource:0}: Error finding container 2464164d433217412813afb4da162f0ee52a5afa714539331fc4d070925a31b2: Status 404 returned error can't find the container with id 2464164d433217412813afb4da162f0ee52a5afa714539331fc4d070925a31b2
Jul 17 17:30:01.402267 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.402234    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q" event={"ID":"e316a5ac-c1a7-46a6-876e-75a58fd605af","Type":"ContainerStarted","Data":"0ef70bcf5560f167df2df2e543208ba234fbcda460dd64694a3ee44015de3677"}
Jul 17 17:30:01.402785 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.402297    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q" event={"ID":"e316a5ac-c1a7-46a6-876e-75a58fd605af","Type":"ContainerStarted","Data":"781b26d50ce102b9ca0160681d82f370fe46996dcc1c6dcc2e3943541d0840a3"}
Jul 17 17:30:01.404043 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.404019    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz" event={"ID":"ca446cb8-a570-4f8b-ad39-d1c4c24f9a63","Type":"ContainerStarted","Data":"7c1eaf2d0996a83355b39cd20b76f3a715dafec61ba4f348c40ed8451cb23373"}
Jul 17 17:30:01.404183 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.404071    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz" event={"ID":"ca446cb8-a570-4f8b-ad39-d1c4c24f9a63","Type":"ContainerStarted","Data":"5bba52a2d6650c3c56fc585cfabdce4c79d23383de8ecfd684b75addd2eea8fb"}
Jul 17 17:30:01.405824 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.405796    2566 generic.go:356] "Generic (PLEG): container finished" podID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75" containerID="cc5f6676908fd783a17f5e47d421b30d3613a9156d5d6b2bc0a9177cd0fdea74" exitCode=7
Jul 17 17:30:01.405910 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.405876    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks" event={"ID":"93657b5e-4a8a-4f86-8ddf-5fc62f26ee75","Type":"ContainerDied","Data":"cc5f6676908fd783a17f5e47d421b30d3613a9156d5d6b2bc0a9177cd0fdea74"}
Jul 17 17:30:01.405983 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.405923    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks" event={"ID":"93657b5e-4a8a-4f86-8ddf-5fc62f26ee75","Type":"ContainerStarted","Data":"973de17ff5b98c6e74957fea2575df5bc1e89109383fbf16841a54428a72da26"}
Jul 17 17:30:01.405983 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.405970    2566 scope.go:117] "RemoveContainer" containerID="cc5f6676908fd783a17f5e47d421b30d3613a9156d5d6b2bc0a9177cd0fdea74"
Jul 17 17:30:01.407588 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.407555    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77" event={"ID":"a57d73bc-d3d6-4119-b86b-b8719f933085","Type":"ContainerStarted","Data":"41558656ccadb6cfd84d3d8e5aed336f1c07f19c32f33bdc7dd0413cc12bd774"}
Jul 17 17:30:01.407684 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.407592    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77" event={"ID":"a57d73bc-d3d6-4119-b86b-b8719f933085","Type":"ContainerStarted","Data":"2464164d433217412813afb4da162f0ee52a5afa714539331fc4d070925a31b2"}
Jul 17 17:30:01.407684 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.407607    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77" podUID="a57d73bc-d3d6-4119-b86b-b8719f933085" containerName="cleanup" containerID="cri-o://41558656ccadb6cfd84d3d8e5aed336f1c07f19c32f33bdc7dd0413cc12bd774" gracePeriod=30
Jul 17 17:30:01.417812 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.417413    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q" podStartSLOduration=1.41739705 podStartE2EDuration="1.41739705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:01.416883814 +0000 UTC m=+3850.276012373" watchObservedRunningTime="2026-07-17 17:30:01.41739705 +0000 UTC m=+3850.276525614"
Jul 17 17:30:01.430457 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.430412    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz" podStartSLOduration=1.430396055 podStartE2EDuration="1.430396055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:01.430383112 +0000 UTC m=+3850.289511672" watchObservedRunningTime="2026-07-17 17:30:01.430396055 +0000 UTC m=+3850.289524615"
Jul 17 17:30:01.445123 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.445090    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77" podStartSLOduration=1.445079223 podStartE2EDuration="1.445079223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:01.443414365 +0000 UTC m=+3850.302542924" watchObservedRunningTime="2026-07-17 17:30:01.445079223 +0000 UTC m=+3850.304207845"
Jul 17 17:30:01.708910 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:01.708886    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77"
Jul 17 17:30:02.415422 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.415389    2566 generic.go:356] "Generic (PLEG): container finished" podID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63" containerID="7c1eaf2d0996a83355b39cd20b76f3a715dafec61ba4f348c40ed8451cb23373" exitCode=7
Jul 17 17:30:02.415780 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.415442    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz" event={"ID":"ca446cb8-a570-4f8b-ad39-d1c4c24f9a63","Type":"ContainerDied","Data":"7c1eaf2d0996a83355b39cd20b76f3a715dafec61ba4f348c40ed8451cb23373"}
Jul 17 17:30:02.415780 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.415617    2566 scope.go:117] "RemoveContainer" containerID="7c1eaf2d0996a83355b39cd20b76f3a715dafec61ba4f348c40ed8451cb23373"
Jul 17 17:30:02.417303 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.417277    2566 generic.go:356] "Generic (PLEG): container finished" podID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75" containerID="80a5c6be48f84b3d4f370db93cf4ca7b08187d2ff24498734daf3666118a3473" exitCode=7
Jul 17 17:30:02.417417 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.417350    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks" event={"ID":"93657b5e-4a8a-4f86-8ddf-5fc62f26ee75","Type":"ContainerDied","Data":"80a5c6be48f84b3d4f370db93cf4ca7b08187d2ff24498734daf3666118a3473"}
Jul 17 17:30:02.417417 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.417401    2566 scope.go:117] "RemoveContainer" containerID="cc5f6676908fd783a17f5e47d421b30d3613a9156d5d6b2bc0a9177cd0fdea74"
Jul 17 17:30:02.417544 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.417527    2566 scope.go:117] "RemoveContainer" containerID="80a5c6be48f84b3d4f370db93cf4ca7b08187d2ff24498734daf3666118a3473"
Jul 17 17:30:02.417761 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:02.417741    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks_odh-ai-gateway-infra(93657b5e-4a8a-4f86-8ddf-5fc62f26ee75)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks" podUID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75"
Jul 17 17:30:02.418916 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.418812    2566 generic.go:356] "Generic (PLEG): container finished" podID="a57d73bc-d3d6-4119-b86b-b8719f933085" containerID="41558656ccadb6cfd84d3d8e5aed336f1c07f19c32f33bdc7dd0413cc12bd774" exitCode=6
Jul 17 17:30:02.418916 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.418850    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77"
Jul 17 17:30:02.418916 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.418890    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77" event={"ID":"a57d73bc-d3d6-4119-b86b-b8719f933085","Type":"ContainerDied","Data":"41558656ccadb6cfd84d3d8e5aed336f1c07f19c32f33bdc7dd0413cc12bd774"}
Jul 17 17:30:02.419111 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.418939    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77" event={"ID":"a57d73bc-d3d6-4119-b86b-b8719f933085","Type":"ContainerDied","Data":"2464164d433217412813afb4da162f0ee52a5afa714539331fc4d070925a31b2"}
Jul 17 17:30:02.420583 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.420562    2566 generic.go:356] "Generic (PLEG): container finished" podID="e316a5ac-c1a7-46a6-876e-75a58fd605af" containerID="0ef70bcf5560f167df2df2e543208ba234fbcda460dd64694a3ee44015de3677" exitCode=7
Jul 17 17:30:02.420673 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.420642    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q" event={"ID":"e316a5ac-c1a7-46a6-876e-75a58fd605af","Type":"ContainerDied","Data":"0ef70bcf5560f167df2df2e543208ba234fbcda460dd64694a3ee44015de3677"}
Jul 17 17:30:02.420759 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.420747    2566 scope.go:117] "RemoveContainer" containerID="0ef70bcf5560f167df2df2e543208ba234fbcda460dd64694a3ee44015de3677"
Jul 17 17:30:02.429439 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.429420    2566 scope.go:117] "RemoveContainer" containerID="41558656ccadb6cfd84d3d8e5aed336f1c07f19c32f33bdc7dd0413cc12bd774"
Jul 17 17:30:02.447517 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.447498    2566 scope.go:117] "RemoveContainer" containerID="41558656ccadb6cfd84d3d8e5aed336f1c07f19c32f33bdc7dd0413cc12bd774"
Jul 17 17:30:02.447774 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:02.447756    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41558656ccadb6cfd84d3d8e5aed336f1c07f19c32f33bdc7dd0413cc12bd774\": container with ID starting with 41558656ccadb6cfd84d3d8e5aed336f1c07f19c32f33bdc7dd0413cc12bd774 not found: ID does not exist" containerID="41558656ccadb6cfd84d3d8e5aed336f1c07f19c32f33bdc7dd0413cc12bd774"
Jul 17 17:30:02.447827 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.447781    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41558656ccadb6cfd84d3d8e5aed336f1c07f19c32f33bdc7dd0413cc12bd774"} err="failed to get container status \"41558656ccadb6cfd84d3d8e5aed336f1c07f19c32f33bdc7dd0413cc12bd774\": rpc error: code = NotFound desc = could not find container \"41558656ccadb6cfd84d3d8e5aed336f1c07f19c32f33bdc7dd0413cc12bd774\": container with ID starting with 41558656ccadb6cfd84d3d8e5aed336f1c07f19c32f33bdc7dd0413cc12bd774 not found: ID does not exist"
Jul 17 17:30:02.456473 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.456452    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77"]
Jul 17 17:30:02.460144 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:02.460124    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7ca540-29738490-2zx77"]
Jul 17 17:30:03.032531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:03.032506    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a57d73bc-d3d6-4119-b86b-b8719f933085" path="/var/lib/kubelet/pods/a57d73bc-d3d6-4119-b86b-b8719f933085/volumes"
Jul 17 17:30:03.429550 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:03.429517    2566 generic.go:356] "Generic (PLEG): container finished" podID="e316a5ac-c1a7-46a6-876e-75a58fd605af" containerID="48d7eb28896023498342a568fccead2c86a36e4d310bd6caea9e4f6750ed1d61" exitCode=7
Jul 17 17:30:03.430002 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:03.429602    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q" event={"ID":"e316a5ac-c1a7-46a6-876e-75a58fd605af","Type":"ContainerDied","Data":"48d7eb28896023498342a568fccead2c86a36e4d310bd6caea9e4f6750ed1d61"}
Jul 17 17:30:03.430002 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:03.429662    2566 scope.go:117] "RemoveContainer" containerID="0ef70bcf5560f167df2df2e543208ba234fbcda460dd64694a3ee44015de3677"
Jul 17 17:30:03.430002 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:03.429827    2566 scope.go:117] "RemoveContainer" containerID="48d7eb28896023498342a568fccead2c86a36e4d310bd6caea9e4f6750ed1d61"
Jul 17 17:30:03.430136 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:03.430076    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q_odh-ai-gateway-infra(e316a5ac-c1a7-46a6-876e-75a58fd605af)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q" podUID="e316a5ac-c1a7-46a6-876e-75a58fd605af"
Jul 17 17:30:03.431502 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:03.431481    2566 generic.go:356] "Generic (PLEG): container finished" podID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63" containerID="7bc81582d7403e8635e952d7c35e6e6b1052d66226359f511f889f4166af1d2e" exitCode=7
Jul 17 17:30:03.431587 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:03.431562    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz" event={"ID":"ca446cb8-a570-4f8b-ad39-d1c4c24f9a63","Type":"ContainerDied","Data":"7bc81582d7403e8635e952d7c35e6e6b1052d66226359f511f889f4166af1d2e"}
Jul 17 17:30:03.431710 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:03.431696    2566 scope.go:117] "RemoveContainer" containerID="7bc81582d7403e8635e952d7c35e6e6b1052d66226359f511f889f4166af1d2e"
Jul 17 17:30:03.431933 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:03.431912    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz_odh-ai-gateway-infra(ca446cb8-a570-4f8b-ad39-d1c4c24f9a63)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz" podUID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63"
Jul 17 17:30:03.432987 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:03.432972    2566 scope.go:117] "RemoveContainer" containerID="80a5c6be48f84b3d4f370db93cf4ca7b08187d2ff24498734daf3666118a3473"
Jul 17 17:30:03.433170 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:03.433152    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks_odh-ai-gateway-infra(93657b5e-4a8a-4f86-8ddf-5fc62f26ee75)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks" podUID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75"
Jul 17 17:30:03.441642 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:03.441619    2566 scope.go:117] "RemoveContainer" containerID="7c1eaf2d0996a83355b39cd20b76f3a715dafec61ba4f348c40ed8451cb23373"
Jul 17 17:30:04.440706 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:04.440671    2566 scope.go:117] "RemoveContainer" containerID="48d7eb28896023498342a568fccead2c86a36e4d310bd6caea9e4f6750ed1d61"
Jul 17 17:30:04.441182 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:04.440960    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q_odh-ai-gateway-infra(e316a5ac-c1a7-46a6-876e-75a58fd605af)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q" podUID="e316a5ac-c1a7-46a6-876e-75a58fd605af"
Jul 17 17:30:04.442204 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:04.442187    2566 scope.go:117] "RemoveContainer" containerID="7bc81582d7403e8635e952d7c35e6e6b1052d66226359f511f889f4166af1d2e"
Jul 17 17:30:04.442394 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:04.442376    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz_odh-ai-gateway-infra(ca446cb8-a570-4f8b-ad39-d1c4c24f9a63)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz" podUID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63"
Jul 17 17:30:04.812734 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:04.812696    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc"]
Jul 17 17:30:04.814644 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:04.814618    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7ca540-dgwvc"]
Jul 17 17:30:05.032795 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:05.032763    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79745848-5455-474c-9156-149b36cabfc0" path="/var/lib/kubelet/pods/79745848-5455-474c-9156-149b36cabfc0/volumes"
Jul 17 17:30:11.238711 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:11.238678    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"]
Jul 17 17:30:11.239121 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:11.238889    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv" podUID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerName="istio-proxy" containerID="cri-o://6556b0a74d72d2c509cf2ad9aaaa53f59352f9e007e55f97fa6912ead8486d49" gracePeriod=30
Jul 17 17:30:14.899105 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:14.899069    2566 patch_prober.go:28] interesting pod/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 17:30:14.899528 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:14.899131    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv" podUID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 17:30:16.489181 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.489158    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:30:16.506202 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.506135    2566 generic.go:356] "Generic (PLEG): container finished" podID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerID="6556b0a74d72d2c509cf2ad9aaaa53f59352f9e007e55f97fa6912ead8486d49" exitCode=0
Jul 17 17:30:16.506202 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.506180    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"
Jul 17 17:30:16.506370 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.506224    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv" event={"ID":"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06","Type":"ContainerDied","Data":"6556b0a74d72d2c509cf2ad9aaaa53f59352f9e007e55f97fa6912ead8486d49"}
Jul 17 17:30:16.506370 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.506276    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv" event={"ID":"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06","Type":"ContainerDied","Data":"4c536980a9e4ba114f9f253e0706829269a2698f128fdba61b22e5da269beaf9"}
Jul 17 17:30:16.506370 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.506299    2566 scope.go:117] "RemoveContainer" containerID="6556b0a74d72d2c509cf2ad9aaaa53f59352f9e007e55f97fa6912ead8486d49"
Jul 17 17:30:16.520341 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.517850    2566 scope.go:117] "RemoveContainer" containerID="9493ced14a480d7cf48159c34136f1239e42c111d651f2a1fd8d2e986e5dd1b4"
Jul 17 17:30:16.526570 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.526548    2566 scope.go:117] "RemoveContainer" containerID="6556b0a74d72d2c509cf2ad9aaaa53f59352f9e007e55f97fa6912ead8486d49"
Jul 17 17:30:16.526812 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:16.526795    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6556b0a74d72d2c509cf2ad9aaaa53f59352f9e007e55f97fa6912ead8486d49\": container with ID starting with 6556b0a74d72d2c509cf2ad9aaaa53f59352f9e007e55f97fa6912ead8486d49 not found: ID does not exist" containerID="6556b0a74d72d2c509cf2ad9aaaa53f59352f9e007e55f97fa6912ead8486d49"
Jul 17 17:30:16.526884 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.526825    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6556b0a74d72d2c509cf2ad9aaaa53f59352f9e007e55f97fa6912ead8486d49"} err="failed to get container status \"6556b0a74d72d2c509cf2ad9aaaa53f59352f9e007e55f97fa6912ead8486d49\": rpc error: code = NotFound desc = could not find container \"6556b0a74d72d2c509cf2ad9aaaa53f59352f9e007e55f97fa6912ead8486d49\": container with ID starting with 6556b0a74d72d2c509cf2ad9aaaa53f59352f9e007e55f97fa6912ead8486d49 not found: ID does not exist"
Jul 17 17:30:16.526884 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.526848    2566 scope.go:117] "RemoveContainer" containerID="9493ced14a480d7cf48159c34136f1239e42c111d651f2a1fd8d2e986e5dd1b4"
Jul 17 17:30:16.527108 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:16.527090    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9493ced14a480d7cf48159c34136f1239e42c111d651f2a1fd8d2e986e5dd1b4\": container with ID starting with 9493ced14a480d7cf48159c34136f1239e42c111d651f2a1fd8d2e986e5dd1b4 not found: ID does not exist" containerID="9493ced14a480d7cf48159c34136f1239e42c111d651f2a1fd8d2e986e5dd1b4"
Jul 17 17:30:16.527155 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.527113    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9493ced14a480d7cf48159c34136f1239e42c111d651f2a1fd8d2e986e5dd1b4"} err="failed to get container status \"9493ced14a480d7cf48159c34136f1239e42c111d651f2a1fd8d2e986e5dd1b4\": rpc error: code = NotFound desc = could not find container \"9493ced14a480d7cf48159c34136f1239e42c111d651f2a1fd8d2e986e5dd1b4\": container with ID starting with 9493ced14a480d7cf48159c34136f1239e42c111d651f2a1fd8d2e986e5dd1b4 not found: ID does not exist"
Jul 17 17:30:16.625762 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.625729    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-envoy\") pod \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") "
Jul 17 17:30:16.625915 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.625831    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-workload-certs\") pod \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") "
Jul 17 17:30:16.625915 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.625873    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-podinfo\") pod \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") "
Jul 17 17:30:16.625915 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.625897    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-workload-socket\") pod \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") "
Jul 17 17:30:16.626087 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.625921    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-token\") pod \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") "
Jul 17 17:30:16.626087 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.625958    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istiod-ca-cert\") pod \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") "
Jul 17 17:30:16.626087 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.625997    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8bmz\" (UniqueName: \"kubernetes.io/projected/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-kube-api-access-c8bmz\") pod \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") "
Jul 17 17:30:16.626246 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.626174    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-credential-socket\") pod \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") "
Jul 17 17:30:16.626246 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.626235    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-data\") pod \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\" (UID: \"2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06\") "
Jul 17 17:30:16.626440 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.626174    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" (UID: "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:30:16.626440 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.626399    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" (UID: "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:30:16.626612 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.626418    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" (UID: "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:30:16.626672 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.626643    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-workload-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:16.626672 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.626665    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istiod-ca-cert\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:16.626774 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.626681    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-credential-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:16.626774 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.626746    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" (UID: "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:30:16.627239 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.627216    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" (UID: "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:30:16.627995 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.627969    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" (UID: "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:30:16.628403 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.628378    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" (UID: "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:30:16.628518 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.628500    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-kube-api-access-c8bmz" (OuterVolumeSpecName: "kube-api-access-c8bmz") pod "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" (UID: "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06"). InnerVolumeSpecName "kube-api-access-c8bmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:30:16.628579 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.628520    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" (UID: "2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 17:30:16.727578 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.727554    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-envoy\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:16.727578 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.727574    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-workload-certs\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:16.727578 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.727583    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-podinfo\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:16.727756 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.727590    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-token\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:16.727756 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.727598    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8bmz\" (UniqueName: \"kubernetes.io/projected/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-kube-api-access-c8bmz\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:16.727756 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.727606    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06-istio-data\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:16.828895 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.828868    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"]
Jul 17 17:30:16.835457 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:16.835436    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-7ca540-openshift-default-b5c6f567c-nw5qv"]
Jul 17 17:30:17.025825 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:17.025799    2566 scope.go:117] "RemoveContainer" containerID="7bc81582d7403e8635e952d7c35e6e6b1052d66226359f511f889f4166af1d2e"
Jul 17 17:30:17.032511 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:17.032494    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" path="/var/lib/kubelet/pods/2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06/volumes"
Jul 17 17:30:17.513592 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:17.513506    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz" event={"ID":"ca446cb8-a570-4f8b-ad39-d1c4c24f9a63","Type":"ContainerStarted","Data":"7cd5248b40caf7e96f529730a89252c2af2073769f55f71354fc53987e28c0ab"}
Jul 17 17:30:18.026060 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:18.026033    2566 scope.go:117] "RemoveContainer" containerID="48d7eb28896023498342a568fccead2c86a36e4d310bd6caea9e4f6750ed1d61"
Jul 17 17:30:18.520597 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:18.520569    2566 generic.go:356] "Generic (PLEG): container finished" podID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63" containerID="7cd5248b40caf7e96f529730a89252c2af2073769f55f71354fc53987e28c0ab" exitCode=7
Jul 17 17:30:18.521015 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:18.520648    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz" event={"ID":"ca446cb8-a570-4f8b-ad39-d1c4c24f9a63","Type":"ContainerDied","Data":"7cd5248b40caf7e96f529730a89252c2af2073769f55f71354fc53987e28c0ab"}
Jul 17 17:30:18.521015 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:18.520712    2566 scope.go:117] "RemoveContainer" containerID="7bc81582d7403e8635e952d7c35e6e6b1052d66226359f511f889f4166af1d2e"
Jul 17 17:30:18.521015 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:18.520936    2566 scope.go:117] "RemoveContainer" containerID="7cd5248b40caf7e96f529730a89252c2af2073769f55f71354fc53987e28c0ab"
Jul 17 17:30:18.521195 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:18.521171    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz_odh-ai-gateway-infra(ca446cb8-a570-4f8b-ad39-d1c4c24f9a63)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz" podUID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63"
Jul 17 17:30:18.522632 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:18.522610    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q" event={"ID":"e316a5ac-c1a7-46a6-876e-75a58fd605af","Type":"ContainerStarted","Data":"514cd50009d00010996a2d2b53b9de9381bcdc258f1f63c01ee1d75f79c8448f"}
Jul 17 17:30:18.546733 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:18.546711    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz"]
Jul 17 17:30:19.026518 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:19.026443    2566 scope.go:117] "RemoveContainer" containerID="80a5c6be48f84b3d4f370db93cf4ca7b08187d2ff24498734daf3666118a3473"
Jul 17 17:30:19.529787 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:19.529757    2566 generic.go:356] "Generic (PLEG): container finished" podID="e316a5ac-c1a7-46a6-876e-75a58fd605af" containerID="514cd50009d00010996a2d2b53b9de9381bcdc258f1f63c01ee1d75f79c8448f" exitCode=7
Jul 17 17:30:19.530245 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:19.529828    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q" event={"ID":"e316a5ac-c1a7-46a6-876e-75a58fd605af","Type":"ContainerDied","Data":"514cd50009d00010996a2d2b53b9de9381bcdc258f1f63c01ee1d75f79c8448f"}
Jul 17 17:30:19.530245 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:19.529879    2566 scope.go:117] "RemoveContainer" containerID="48d7eb28896023498342a568fccead2c86a36e4d310bd6caea9e4f6750ed1d61"
Jul 17 17:30:19.530245 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:19.530126    2566 scope.go:117] "RemoveContainer" containerID="514cd50009d00010996a2d2b53b9de9381bcdc258f1f63c01ee1d75f79c8448f"
Jul 17 17:30:19.530431 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:19.530379    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q_odh-ai-gateway-infra(e316a5ac-c1a7-46a6-876e-75a58fd605af)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q" podUID="e316a5ac-c1a7-46a6-876e-75a58fd605af"
Jul 17 17:30:19.533473 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:19.533442    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks" event={"ID":"93657b5e-4a8a-4f86-8ddf-5fc62f26ee75","Type":"ContainerStarted","Data":"de558a8b7c1d417622e0630f592648a448f083da9c5d77814125c19700d92c62"}
Jul 17 17:30:19.570520 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:19.570444    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q"]
Jul 17 17:30:19.590641 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:19.590373    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks" podStartSLOduration=19.590353015 podStartE2EDuration="19.590353015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:19.587759942 +0000 UTC m=+3868.446888500" watchObservedRunningTime="2026-07-17 17:30:19.590353015 +0000 UTC m=+3868.449481574"
Jul 17 17:30:19.671874 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:19.671843    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz"
Jul 17 17:30:20.541434 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:20.541407    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz"
Jul 17 17:30:20.541434 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:20.541418    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz" event={"ID":"ca446cb8-a570-4f8b-ad39-d1c4c24f9a63","Type":"ContainerDied","Data":"5bba52a2d6650c3c56fc585cfabdce4c79d23383de8ecfd684b75addd2eea8fb"}
Jul 17 17:30:20.541873 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:20.541478    2566 scope.go:117] "RemoveContainer" containerID="7cd5248b40caf7e96f529730a89252c2af2073769f55f71354fc53987e28c0ab"
Jul 17 17:30:20.543633 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:20.543603    2566 generic.go:356] "Generic (PLEG): container finished" podID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75" containerID="de558a8b7c1d417622e0630f592648a448f083da9c5d77814125c19700d92c62" exitCode=7
Jul 17 17:30:20.543742 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:20.543648    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks" event={"ID":"93657b5e-4a8a-4f86-8ddf-5fc62f26ee75","Type":"ContainerDied","Data":"de558a8b7c1d417622e0630f592648a448f083da9c5d77814125c19700d92c62"}
Jul 17 17:30:20.543946 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:20.543930    2566 scope.go:117] "RemoveContainer" containerID="de558a8b7c1d417622e0630f592648a448f083da9c5d77814125c19700d92c62"
Jul 17 17:30:20.544196 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:20.544174    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks_odh-ai-gateway-infra(93657b5e-4a8a-4f86-8ddf-5fc62f26ee75)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks" podUID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75"
Jul 17 17:30:20.551748 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:20.551734    2566 scope.go:117] "RemoveContainer" containerID="80a5c6be48f84b3d4f370db93cf4ca7b08187d2ff24498734daf3666118a3473"
Jul 17 17:30:20.602024 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:20.601996    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks"]
Jul 17 17:30:20.608555 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:20.608530    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz"]
Jul 17 17:30:20.629182 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:20.629157    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4cb0f3bd-29738490-k6dbz"]
Jul 17 17:30:20.681129 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:20.681107    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q"
Jul 17 17:30:21.031904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:21.031879    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63" path="/var/lib/kubelet/pods/ca446cb8-a570-4f8b-ad39-d1c4c24f9a63/volumes"
Jul 17 17:30:21.549775 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:21.549749    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q"
Jul 17 17:30:21.550228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:21.549774    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q" event={"ID":"e316a5ac-c1a7-46a6-876e-75a58fd605af","Type":"ContainerDied","Data":"781b26d50ce102b9ca0160681d82f370fe46996dcc1c6dcc2e3943541d0840a3"}
Jul 17 17:30:21.550228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:21.549839    2566 scope.go:117] "RemoveContainer" containerID="514cd50009d00010996a2d2b53b9de9381bcdc258f1f63c01ee1d75f79c8448f"
Jul 17 17:30:21.566423 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:21.566391    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q"]
Jul 17 17:30:21.568396 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:21.568375    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-0d4fd87f-29738490-4lz8q"]
Jul 17 17:30:21.689664 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:21.689635    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks"
Jul 17 17:30:22.561206 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:22.561181    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks"
Jul 17 17:30:22.561664 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:22.561182    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks" event={"ID":"93657b5e-4a8a-4f86-8ddf-5fc62f26ee75","Type":"ContainerDied","Data":"973de17ff5b98c6e74957fea2575df5bc1e89109383fbf16841a54428a72da26"}
Jul 17 17:30:22.561664 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:22.561304    2566 scope.go:117] "RemoveContainer" containerID="de558a8b7c1d417622e0630f592648a448f083da9c5d77814125c19700d92c62"
Jul 17 17:30:22.582020 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:22.581995    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks"]
Jul 17 17:30:22.585804 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:22.585785    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-8c607776-29738490-87fks"]
Jul 17 17:30:23.032420 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:23.032393    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75" path="/var/lib/kubelet/pods/93657b5e-4a8a-4f86-8ddf-5fc62f26ee75/volumes"
Jul 17 17:30:23.032695 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:23.032681    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e316a5ac-c1a7-46a6-876e-75a58fd605af" path="/var/lib/kubelet/pods/e316a5ac-c1a7-46a6-876e-75a58fd605af/volumes"
Jul 17 17:30:25.991030 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991000    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf"]
Jul 17 17:30:25.991413 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991395    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75" containerName="cleanup"
Jul 17 17:30:25.991413 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991406    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75" containerName="cleanup"
Jul 17 17:30:25.991487 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991417    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e316a5ac-c1a7-46a6-876e-75a58fd605af" containerName="cleanup"
Jul 17 17:30:25.991487 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991423    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e316a5ac-c1a7-46a6-876e-75a58fd605af" containerName="cleanup"
Jul 17 17:30:25.991487 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991429    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e316a5ac-c1a7-46a6-876e-75a58fd605af" containerName="cleanup"
Jul 17 17:30:25.991487 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991435    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e316a5ac-c1a7-46a6-876e-75a58fd605af" containerName="cleanup"
Jul 17 17:30:25.991487 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991441    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75" containerName="cleanup"
Jul 17 17:30:25.991487 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991446    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75" containerName="cleanup"
Jul 17 17:30:25.991487 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991458    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57d73bc-d3d6-4119-b86b-b8719f933085" containerName="cleanup"
Jul 17 17:30:25.991487 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991463    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57d73bc-d3d6-4119-b86b-b8719f933085" containerName="cleanup"
Jul 17 17:30:25.991487 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991468    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63" containerName="cleanup"
Jul 17 17:30:25.991487 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991473    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63" containerName="cleanup"
Jul 17 17:30:25.991487 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991479    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63" containerName="cleanup"
Jul 17 17:30:25.991487 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991484    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63" containerName="cleanup"
Jul 17 17:30:25.991487 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991493    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e316a5ac-c1a7-46a6-876e-75a58fd605af" containerName="cleanup"
Jul 17 17:30:25.991977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991497    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e316a5ac-c1a7-46a6-876e-75a58fd605af" containerName="cleanup"
Jul 17 17:30:25.991977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991504    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerName="istio-proxy"
Jul 17 17:30:25.991977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991509    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerName="istio-proxy"
Jul 17 17:30:25.991977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991570    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerName="istio-proxy"
Jul 17 17:30:25.991977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991577    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75" containerName="cleanup"
Jul 17 17:30:25.991977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991583    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a57d73bc-d3d6-4119-b86b-b8719f933085" containerName="cleanup"
Jul 17 17:30:25.991977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991589    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerName="istio-proxy"
Jul 17 17:30:25.991977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991595    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63" containerName="cleanup"
Jul 17 17:30:25.991977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991600    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e316a5ac-c1a7-46a6-876e-75a58fd605af" containerName="cleanup"
Jul 17 17:30:25.991977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991607    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e316a5ac-c1a7-46a6-876e-75a58fd605af" containerName="cleanup"
Jul 17 17:30:25.991977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991613    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63" containerName="cleanup"
Jul 17 17:30:25.991977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991619    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63" containerName="cleanup"
Jul 17 17:30:25.991977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991624    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e316a5ac-c1a7-46a6-876e-75a58fd605af" containerName="cleanup"
Jul 17 17:30:25.991977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.991631    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75" containerName="cleanup"
Jul 17 17:30:25.996094 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.996078    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf"
Jul 17 17:30:25.998731 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.998708    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:30:25.998731 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:25.998702    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:30:26.002607 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:26.002581    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf"]
Jul 17 17:30:26.108659 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:26.108620    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6ee22fb-306e-4dba-a3b9-08aab54e0081-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-vp4tf\" (UID: \"f6ee22fb-306e-4dba-a3b9-08aab54e0081\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf"
Jul 17 17:30:26.209957 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:26.209920    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6ee22fb-306e-4dba-a3b9-08aab54e0081-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-vp4tf\" (UID: \"f6ee22fb-306e-4dba-a3b9-08aab54e0081\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf"
Jul 17 17:30:26.210557 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:26.210539    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6ee22fb-306e-4dba-a3b9-08aab54e0081-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-vp4tf\" (UID: \"f6ee22fb-306e-4dba-a3b9-08aab54e0081\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf"
Jul 17 17:30:26.307656 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:26.307624    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf"
Jul 17 17:30:26.467301 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:26.467275    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf"]
Jul 17 17:30:26.469184 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:30:26.469155    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ee22fb_306e_4dba_a3b9_08aab54e0081.slice/crio-0dd385a3e59c2f38c175dabdd5903e380af5f01c3de4fb081c0d96f451af330d WatchSource:0}: Error finding container 0dd385a3e59c2f38c175dabdd5903e380af5f01c3de4fb081c0d96f451af330d: Status 404 returned error can't find the container with id 0dd385a3e59c2f38c175dabdd5903e380af5f01c3de4fb081c0d96f451af330d
Jul 17 17:30:26.584543 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:26.584468    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf" event={"ID":"f6ee22fb-306e-4dba-a3b9-08aab54e0081","Type":"ContainerStarted","Data":"0dd385a3e59c2f38c175dabdd5903e380af5f01c3de4fb081c0d96f451af330d"}
Jul 17 17:30:27.592549 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:27.592517    2566 generic.go:356] "Generic (PLEG): container finished" podID="f6ee22fb-306e-4dba-a3b9-08aab54e0081" containerID="50da94fa30244526899ea9c395a04db659f7a54a8e088638d32b8e7b875dba1e" exitCode=7
Jul 17 17:30:27.593018 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:27.592566    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf" event={"ID":"f6ee22fb-306e-4dba-a3b9-08aab54e0081","Type":"ContainerDied","Data":"50da94fa30244526899ea9c395a04db659f7a54a8e088638d32b8e7b875dba1e"}
Jul 17 17:30:27.593018 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:27.592825    2566 scope.go:117] "RemoveContainer" containerID="50da94fa30244526899ea9c395a04db659f7a54a8e088638d32b8e7b875dba1e"
Jul 17 17:30:28.599864 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:28.599832    2566 generic.go:356] "Generic (PLEG): container finished" podID="f6ee22fb-306e-4dba-a3b9-08aab54e0081" containerID="764a70a83d3d2a46d78d1a02fae8473c6772c74e2f887ba3a427223ab08d0cd6" exitCode=7
Jul 17 17:30:28.600350 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:28.599882    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf" event={"ID":"f6ee22fb-306e-4dba-a3b9-08aab54e0081","Type":"ContainerDied","Data":"764a70a83d3d2a46d78d1a02fae8473c6772c74e2f887ba3a427223ab08d0cd6"}
Jul 17 17:30:28.600350 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:28.599943    2566 scope.go:117] "RemoveContainer" containerID="50da94fa30244526899ea9c395a04db659f7a54a8e088638d32b8e7b875dba1e"
Jul 17 17:30:28.600350 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:28.600158    2566 scope.go:117] "RemoveContainer" containerID="764a70a83d3d2a46d78d1a02fae8473c6772c74e2f887ba3a427223ab08d0cd6"
Jul 17 17:30:28.600528 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:28.600430    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-vp4tf_odh-ai-gateway-infra(f6ee22fb-306e-4dba-a3b9-08aab54e0081)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf" podUID="f6ee22fb-306e-4dba-a3b9-08aab54e0081"
Jul 17 17:30:29.607805 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:29.607779    2566 scope.go:117] "RemoveContainer" containerID="764a70a83d3d2a46d78d1a02fae8473c6772c74e2f887ba3a427223ab08d0cd6"
Jul 17 17:30:29.608258 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:29.607984    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-vp4tf_odh-ai-gateway-infra(f6ee22fb-306e-4dba-a3b9-08aab54e0081)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf" podUID="f6ee22fb-306e-4dba-a3b9-08aab54e0081"
Jul 17 17:30:33.260186 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:33.260153    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"]
Jul 17 17:30:33.260645 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:33.260423    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf" podUID="12ee698a-0a84-4547-8948-3631f8970baf" containerName="istio-proxy" containerID="cri-o://a765b6fa14a6f430f57ce569537f3fc3249d77da896043d51f1453a0f9fe7b7e" gracePeriod=30
Jul 17 17:30:34.214040 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.214011    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"]
Jul 17 17:30:34.214453 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.214439    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75" containerName="cleanup"
Jul 17 17:30:34.214517 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.214454    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75" containerName="cleanup"
Jul 17 17:30:34.214517 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.214467    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63" containerName="cleanup"
Jul 17 17:30:34.214517 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.214473    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca446cb8-a570-4f8b-ad39-d1c4c24f9a63" containerName="cleanup"
Jul 17 17:30:34.214517 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.214481    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerName="istio-proxy"
Jul 17 17:30:34.214517 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.214486    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3738ff-2e47-4d7b-96fa-8bdd6ff7ad06" containerName="istio-proxy"
Jul 17 17:30:34.214671 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.214548    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="93657b5e-4a8a-4f86-8ddf-5fc62f26ee75" containerName="cleanup"
Jul 17 17:30:34.218940 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.218920    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.221205 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.221186    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-876752-openshift-default-dockercfg-hckxq\""
Jul 17 17:30:34.234590 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.234565    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"]
Jul 17 17:30:34.385847 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.385814    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e88ad8-d263-476f-9381-9fd98e83fed9-istiod-ca-cert\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.386228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.385860    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-envoy\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.386228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.385892    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-credential-socket\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.386228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.385910    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c76q5\" (UniqueName: \"kubernetes.io/projected/19e88ad8-d263-476f-9381-9fd98e83fed9-kube-api-access-c76q5\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.386228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.385944    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-data\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.386228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.385969    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-podinfo\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.386228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.386023    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-token\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.386228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.386043    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-workload-socket\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.386228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.386093    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-workload-certs\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.487164 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.487081    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-token\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.487164 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.487127    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-workload-socket\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.487421 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.487177    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-workload-certs\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.487421 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.487213    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e88ad8-d263-476f-9381-9fd98e83fed9-istiod-ca-cert\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.487421 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.487254    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-envoy\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.487421 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.487290    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-credential-socket\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.487421 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.487308    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c76q5\" (UniqueName: \"kubernetes.io/projected/19e88ad8-d263-476f-9381-9fd98e83fed9-kube-api-access-c76q5\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.487421 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.487395    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-data\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.487730 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.487443    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-podinfo\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.487730 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.487637    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-workload-certs\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.487808 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.487778    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-workload-socket\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.487853 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.487806    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-data\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.487920 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.487858    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-credential-socket\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.488023 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.487956    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e88ad8-d263-476f-9381-9fd98e83fed9-istiod-ca-cert\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.489571 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.489547    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-envoy\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.489775 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.489758    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-podinfo\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.497705 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.497685    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-token\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.500543 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.500516    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c76q5\" (UniqueName: \"kubernetes.io/projected/19e88ad8-d263-476f-9381-9fd98e83fed9-kube-api-access-c76q5\") pod \"e2e-api-a-876752-openshift-default-98f89b8df-47xs7\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") " pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.528986 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.528965    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:34.667190 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.667159    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"]
Jul 17 17:30:34.669215 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:30:34.669187    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e88ad8_d263_476f_9381_9fd98e83fed9.slice/crio-b1dde0b692e1a53cc2b5286b2f5a81139cbf3f25ed21375985c50bc57d3cdeb1 WatchSource:0}: Error finding container b1dde0b692e1a53cc2b5286b2f5a81139cbf3f25ed21375985c50bc57d3cdeb1: Status 404 returned error can't find the container with id b1dde0b692e1a53cc2b5286b2f5a81139cbf3f25ed21375985c50bc57d3cdeb1
Jul 17 17:30:34.671792 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.671760    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:30:34.671892 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.671826    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:30:34.671892 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:34.671853    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:30:35.643200 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:35.643167    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7" event={"ID":"19e88ad8-d263-476f-9381-9fd98e83fed9","Type":"ContainerStarted","Data":"9918960173ee29d00296096e878cc1ac0cd65f0b28cd7c26e23501251fb7b16c"}
Jul 17 17:30:35.643662 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:35.643218    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7" event={"ID":"19e88ad8-d263-476f-9381-9fd98e83fed9","Type":"ContainerStarted","Data":"b1dde0b692e1a53cc2b5286b2f5a81139cbf3f25ed21375985c50bc57d3cdeb1"}
Jul 17 17:30:35.664771 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:35.664724    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7" podStartSLOduration=1.6647108579999998 podStartE2EDuration="1.664710858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:35.66256493 +0000 UTC m=+3884.521693489" watchObservedRunningTime="2026-07-17 17:30:35.664710858 +0000 UTC m=+3884.523839417"
Jul 17 17:30:36.529616 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:36.529585    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:36.534348 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:36.534302    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:36.648605 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:36.648567    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:36.649278 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:36.649262    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:38.352760 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.352723    2566 patch_prober.go:28] interesting pod/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 17 17:30:38.353120 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.352778    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf" podUID="12ee698a-0a84-4547-8948-3631f8970baf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 17 17:30:38.524998 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.524947    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:30:38.626303 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.626276    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-istio-envoy\") pod \"12ee698a-0a84-4547-8948-3631f8970baf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") "
Jul 17 17:30:38.626456 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.626358    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-workload-certs\") pod \"12ee698a-0a84-4547-8948-3631f8970baf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") "
Jul 17 17:30:38.626456 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.626405    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-workload-socket\") pod \"12ee698a-0a84-4547-8948-3631f8970baf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") "
Jul 17 17:30:38.626456 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.626441    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12ee698a-0a84-4547-8948-3631f8970baf-istio-podinfo\") pod \"12ee698a-0a84-4547-8948-3631f8970baf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") "
Jul 17 17:30:38.626635 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.626502    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ngl2\" (UniqueName: \"kubernetes.io/projected/12ee698a-0a84-4547-8948-3631f8970baf-kube-api-access-7ngl2\") pod \"12ee698a-0a84-4547-8948-3631f8970baf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") "
Jul 17 17:30:38.626635 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.626528    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-credential-socket\") pod \"12ee698a-0a84-4547-8948-3631f8970baf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") "
Jul 17 17:30:38.626635 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.626606    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-istio-data\") pod \"12ee698a-0a84-4547-8948-3631f8970baf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") "
Jul 17 17:30:38.626801 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.626705    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12ee698a-0a84-4547-8948-3631f8970baf-istiod-ca-cert\") pod \"12ee698a-0a84-4547-8948-3631f8970baf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") "
Jul 17 17:30:38.627030 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.626911    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12ee698a-0a84-4547-8948-3631f8970baf-istio-token\") pod \"12ee698a-0a84-4547-8948-3631f8970baf\" (UID: \"12ee698a-0a84-4547-8948-3631f8970baf\") "
Jul 17 17:30:38.627030 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.626630    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12ee698a-0a84-4547-8948-3631f8970baf" (UID: "12ee698a-0a84-4547-8948-3631f8970baf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:30:38.627030 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.626701    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12ee698a-0a84-4547-8948-3631f8970baf" (UID: "12ee698a-0a84-4547-8948-3631f8970baf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:30:38.627030 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.626874    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12ee698a-0a84-4547-8948-3631f8970baf" (UID: "12ee698a-0a84-4547-8948-3631f8970baf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:30:38.627291 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.627070    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12ee698a-0a84-4547-8948-3631f8970baf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12ee698a-0a84-4547-8948-3631f8970baf" (UID: "12ee698a-0a84-4547-8948-3631f8970baf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:30:38.627383 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.627302    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-workload-certs\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:38.627383 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.627348    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-workload-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:38.627383 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.627363    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-credential-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:38.627383 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.627378    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12ee698a-0a84-4547-8948-3631f8970baf-istiod-ca-cert\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:38.627727 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.627700    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-istio-data" (OuterVolumeSpecName: "istio-data") pod "12ee698a-0a84-4547-8948-3631f8970baf" (UID: "12ee698a-0a84-4547-8948-3631f8970baf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:30:38.628954 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.628929    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12ee698a-0a84-4547-8948-3631f8970baf" (UID: "12ee698a-0a84-4547-8948-3631f8970baf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:30:38.629209 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.629188    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12ee698a-0a84-4547-8948-3631f8970baf-kube-api-access-7ngl2" (OuterVolumeSpecName: "kube-api-access-7ngl2") pod "12ee698a-0a84-4547-8948-3631f8970baf" (UID: "12ee698a-0a84-4547-8948-3631f8970baf"). InnerVolumeSpecName "kube-api-access-7ngl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:30:38.629307 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.629285    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12ee698a-0a84-4547-8948-3631f8970baf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12ee698a-0a84-4547-8948-3631f8970baf" (UID: "12ee698a-0a84-4547-8948-3631f8970baf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 17:30:38.629793 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.629764    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12ee698a-0a84-4547-8948-3631f8970baf-istio-token" (OuterVolumeSpecName: "istio-token") pod "12ee698a-0a84-4547-8948-3631f8970baf" (UID: "12ee698a-0a84-4547-8948-3631f8970baf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:30:38.660195 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.660169    2566 generic.go:356] "Generic (PLEG): container finished" podID="12ee698a-0a84-4547-8948-3631f8970baf" containerID="a765b6fa14a6f430f57ce569537f3fc3249d77da896043d51f1453a0f9fe7b7e" exitCode=0
Jul 17 17:30:38.660288 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.660225    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"
Jul 17 17:30:38.660288 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.660254    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf" event={"ID":"12ee698a-0a84-4547-8948-3631f8970baf","Type":"ContainerDied","Data":"a765b6fa14a6f430f57ce569537f3fc3249d77da896043d51f1453a0f9fe7b7e"}
Jul 17 17:30:38.660401 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.660305    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf" event={"ID":"12ee698a-0a84-4547-8948-3631f8970baf","Type":"ContainerDied","Data":"da809b5f6bbd27be69452c3e8dfe2d36327fab7b65a12389cba3da7f486a197f"}
Jul 17 17:30:38.660401 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.660340    2566 scope.go:117] "RemoveContainer" containerID="a765b6fa14a6f430f57ce569537f3fc3249d77da896043d51f1453a0f9fe7b7e"
Jul 17 17:30:38.670020 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.670005    2566 scope.go:117] "RemoveContainer" containerID="440290e3f28ea93cddd64c6ccec6a31093d6acb6ad4e2935f5d4c2d0e743fde1"
Jul 17 17:30:38.678001 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.677985    2566 scope.go:117] "RemoveContainer" containerID="a765b6fa14a6f430f57ce569537f3fc3249d77da896043d51f1453a0f9fe7b7e"
Jul 17 17:30:38.678261 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:38.678239    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a765b6fa14a6f430f57ce569537f3fc3249d77da896043d51f1453a0f9fe7b7e\": container with ID starting with a765b6fa14a6f430f57ce569537f3fc3249d77da896043d51f1453a0f9fe7b7e not found: ID does not exist" containerID="a765b6fa14a6f430f57ce569537f3fc3249d77da896043d51f1453a0f9fe7b7e"
Jul 17 17:30:38.678369 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.678266    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a765b6fa14a6f430f57ce569537f3fc3249d77da896043d51f1453a0f9fe7b7e"} err="failed to get container status \"a765b6fa14a6f430f57ce569537f3fc3249d77da896043d51f1453a0f9fe7b7e\": rpc error: code = NotFound desc = could not find container \"a765b6fa14a6f430f57ce569537f3fc3249d77da896043d51f1453a0f9fe7b7e\": container with ID starting with a765b6fa14a6f430f57ce569537f3fc3249d77da896043d51f1453a0f9fe7b7e not found: ID does not exist"
Jul 17 17:30:38.678369 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.678282    2566 scope.go:117] "RemoveContainer" containerID="440290e3f28ea93cddd64c6ccec6a31093d6acb6ad4e2935f5d4c2d0e743fde1"
Jul 17 17:30:38.678529 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:38.678511    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"440290e3f28ea93cddd64c6ccec6a31093d6acb6ad4e2935f5d4c2d0e743fde1\": container with ID starting with 440290e3f28ea93cddd64c6ccec6a31093d6acb6ad4e2935f5d4c2d0e743fde1 not found: ID does not exist" containerID="440290e3f28ea93cddd64c6ccec6a31093d6acb6ad4e2935f5d4c2d0e743fde1"
Jul 17 17:30:38.678569 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.678536    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"440290e3f28ea93cddd64c6ccec6a31093d6acb6ad4e2935f5d4c2d0e743fde1"} err="failed to get container status \"440290e3f28ea93cddd64c6ccec6a31093d6acb6ad4e2935f5d4c2d0e743fde1\": rpc error: code = NotFound desc = could not find container \"440290e3f28ea93cddd64c6ccec6a31093d6acb6ad4e2935f5d4c2d0e743fde1\": container with ID starting with 440290e3f28ea93cddd64c6ccec6a31093d6acb6ad4e2935f5d4c2d0e743fde1 not found: ID does not exist"
Jul 17 17:30:38.682846 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.682825    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"]
Jul 17 17:30:38.689019 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.688998    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f748a7-openshift-default-759bffbbdf-8dshf"]
Jul 17 17:30:38.728647 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.728628    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12ee698a-0a84-4547-8948-3631f8970baf-istio-podinfo\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:38.728647 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.728647    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ngl2\" (UniqueName: \"kubernetes.io/projected/12ee698a-0a84-4547-8948-3631f8970baf-kube-api-access-7ngl2\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:38.728775 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.728657    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-istio-data\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:38.728775 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.728665    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12ee698a-0a84-4547-8948-3631f8970baf-istio-token\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:38.728775 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:38.728673    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12ee698a-0a84-4547-8948-3631f8970baf-istio-envoy\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:39.032526 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:39.032499    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12ee698a-0a84-4547-8948-3631f8970baf" path="/var/lib/kubelet/pods/12ee698a-0a84-4547-8948-3631f8970baf/volumes"
Jul 17 17:30:42.025660 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.025633    2566 scope.go:117] "RemoveContainer" containerID="764a70a83d3d2a46d78d1a02fae8473c6772c74e2f887ba3a427223ab08d0cd6"
Jul 17 17:30:42.684083 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.684053    2566 generic.go:356] "Generic (PLEG): container finished" podID="f6ee22fb-306e-4dba-a3b9-08aab54e0081" containerID="f1a41a52a5480cf069b89480af5afd9a132c38153db063a4d8c1d376360009ae" exitCode=7
Jul 17 17:30:42.684180 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.684109    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf" event={"ID":"f6ee22fb-306e-4dba-a3b9-08aab54e0081","Type":"ContainerDied","Data":"f1a41a52a5480cf069b89480af5afd9a132c38153db063a4d8c1d376360009ae"}
Jul 17 17:30:42.684180 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.684157    2566 scope.go:117] "RemoveContainer" containerID="764a70a83d3d2a46d78d1a02fae8473c6772c74e2f887ba3a427223ab08d0cd6"
Jul 17 17:30:42.684509 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.684486    2566 scope.go:117] "RemoveContainer" containerID="f1a41a52a5480cf069b89480af5afd9a132c38153db063a4d8c1d376360009ae"
Jul 17 17:30:42.684711 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:30:42.684687    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-vp4tf_odh-ai-gateway-infra(f6ee22fb-306e-4dba-a3b9-08aab54e0081)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf" podUID="f6ee22fb-306e-4dba-a3b9-08aab54e0081"
Jul 17 17:30:42.791528 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.791494    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"]
Jul 17 17:30:42.791884 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.791872    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12ee698a-0a84-4547-8948-3631f8970baf" containerName="istio-proxy"
Jul 17 17:30:42.791928 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.791886    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="12ee698a-0a84-4547-8948-3631f8970baf" containerName="istio-proxy"
Jul 17 17:30:42.791979 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.791970    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="12ee698a-0a84-4547-8948-3631f8970baf" containerName="istio-proxy"
Jul 17 17:30:42.792016 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.791981    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="12ee698a-0a84-4547-8948-3631f8970baf" containerName="istio-proxy"
Jul 17 17:30:42.796186 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.796165    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:42.798559 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.798534    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-47d559-openshift-default-dockercfg-hrpw5\""
Jul 17 17:30:42.807923 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.807900    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"]
Jul 17 17:30:42.966557 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.966473    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-podinfo\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:42.966557 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.966525    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-credential-socket\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:42.966771 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.966578    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istiod-ca-cert\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:42.966771 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.966598    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-workload-socket\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:42.966771 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.966623    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-data\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:42.966771 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.966648    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-envoy\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:42.966771 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.966676    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-token\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:42.966771 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.966705    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmprj\" (UniqueName: \"kubernetes.io/projected/943ef924-1751-41ac-ba3f-eb2d4b2d796c-kube-api-access-pmprj\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:42.967006 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:42.966765    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-workload-certs\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.067379 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.067346    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmprj\" (UniqueName: \"kubernetes.io/projected/943ef924-1751-41ac-ba3f-eb2d4b2d796c-kube-api-access-pmprj\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.067785 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.067387    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-workload-certs\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.067785 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.067422    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-podinfo\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.067785 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.067456    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-credential-socket\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.067785 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.067491    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istiod-ca-cert\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.067785 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.067676    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-workload-socket\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.067785 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.067713    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-data\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.067785 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.067744    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-workload-certs\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.067785 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.067759    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-envoy\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.068207 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.067807    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-token\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.068207 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.067808    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-credential-socket\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.068207 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.068110    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-workload-socket\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.068207 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.068188    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-data\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.068436 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.068420    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istiod-ca-cert\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.069833 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.069811    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-envoy\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.070041 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.070023    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-podinfo\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.074863 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.074840    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-token\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.075026 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.075008    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmprj\" (UniqueName: \"kubernetes.io/projected/943ef924-1751-41ac-ba3f-eb2d4b2d796c-kube-api-access-pmprj\") pod \"e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") " pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.107469 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.107438    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:43.244575 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.244545    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"]
Jul 17 17:30:43.246430 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:30:43.246400    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943ef924_1751_41ac_ba3f_eb2d4b2d796c.slice/crio-0ab133788f1b5c05e4fc853c7a28c3e1cb3e3451b9c9770fe46e4c7bf7103537 WatchSource:0}: Error finding container 0ab133788f1b5c05e4fc853c7a28c3e1cb3e3451b9c9770fe46e4c7bf7103537: Status 404 returned error can't find the container with id 0ab133788f1b5c05e4fc853c7a28c3e1cb3e3451b9c9770fe46e4c7bf7103537
Jul 17 17:30:43.248892 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.248859    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:30:43.248982 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.248928    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:30:43.248982 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.248956    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:30:43.691791 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.691753    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5" event={"ID":"943ef924-1751-41ac-ba3f-eb2d4b2d796c","Type":"ContainerStarted","Data":"e4801b0889dda364e0194631684ac36ed8e909a51c2d6b1f8340eea3817b8e81"}
Jul 17 17:30:43.691987 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.691820    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5" event={"ID":"943ef924-1751-41ac-ba3f-eb2d4b2d796c","Type":"ContainerStarted","Data":"0ab133788f1b5c05e4fc853c7a28c3e1cb3e3451b9c9770fe46e4c7bf7103537"}
Jul 17 17:30:43.708000 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.707973    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf"]
Jul 17 17:30:43.710810 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.710758    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5" podStartSLOduration=1.710743101 podStartE2EDuration="1.710743101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:43.70950537 +0000 UTC m=+3892.568633930" watchObservedRunningTime="2026-07-17 17:30:43.710743101 +0000 UTC m=+3892.569871659"
Jul 17 17:30:43.838642 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.838616    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf"
Jul 17 17:30:43.872923 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.872886    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6ee22fb-306e-4dba-a3b9-08aab54e0081-maas-api-service-ca\") pod \"f6ee22fb-306e-4dba-a3b9-08aab54e0081\" (UID: \"f6ee22fb-306e-4dba-a3b9-08aab54e0081\") "
Jul 17 17:30:43.873211 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.873188    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6ee22fb-306e-4dba-a3b9-08aab54e0081-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f6ee22fb-306e-4dba-a3b9-08aab54e0081" (UID: "f6ee22fb-306e-4dba-a3b9-08aab54e0081"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:30:43.873352 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:43.873292    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6ee22fb-306e-4dba-a3b9-08aab54e0081-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:30:44.108420 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:44.108375    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:44.116245 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:44.116203    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:44.715945 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:44.715909    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf"
Jul 17 17:30:44.726345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:44.724281    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf" event={"ID":"f6ee22fb-306e-4dba-a3b9-08aab54e0081","Type":"ContainerDied","Data":"0dd385a3e59c2f38c175dabdd5903e380af5f01c3de4fb081c0d96f451af330d"}
Jul 17 17:30:44.726345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:44.724385    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:44.726345 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:44.724419    2566 scope.go:117] "RemoveContainer" containerID="f1a41a52a5480cf069b89480af5afd9a132c38153db063a4d8c1d376360009ae"
Jul 17 17:30:44.731114 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:44.730613    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:44.764008 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:44.763943    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf"]
Jul 17 17:30:44.766935 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:44.766912    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-vp4tf"]
Jul 17 17:30:45.033216 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:45.033185    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6ee22fb-306e-4dba-a3b9-08aab54e0081" path="/var/lib/kubelet/pods/f6ee22fb-306e-4dba-a3b9-08aab54e0081/volumes"
Jul 17 17:30:51.650361 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:51.650305    2566 patch_prober.go:28] interesting pod/e2e-api-a-876752-openshift-default-98f89b8df-47xs7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 17 17:30:51.650833 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:51.650382    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7" podUID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 17 17:30:51.765263 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:51.765222    2566 generic.go:356] "Generic (PLEG): container finished" podID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerID="9918960173ee29d00296096e878cc1ac0cd65f0b28cd7c26e23501251fb7b16c" exitCode=0
Jul 17 17:30:51.765441 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:51.765283    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7" event={"ID":"19e88ad8-d263-476f-9381-9fd98e83fed9","Type":"ContainerDied","Data":"9918960173ee29d00296096e878cc1ac0cd65f0b28cd7c26e23501251fb7b16c"}
Jul 17 17:30:51.765755 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:51.765740    2566 scope.go:117] "RemoveContainer" containerID="9918960173ee29d00296096e878cc1ac0cd65f0b28cd7c26e23501251fb7b16c"
Jul 17 17:30:51.766755 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:51.766730    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:30:51.766826 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:51.766816    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:30:51.766873 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:51.766860    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:30:52.772353 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:52.772297    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7" event={"ID":"19e88ad8-d263-476f-9381-9fd98e83fed9","Type":"ContainerStarted","Data":"851963a89fabee19fbdd486c3caac111132b716819284f9a8559d9d57b23234f"}
Jul 17 17:30:53.236343 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:53.235550    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:30:53.248344 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:53.247537    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:30:53.530175 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:53.529703    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:53.530175 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:53.529827    2566 patch_prober.go:28] interesting pod/e2e-api-a-876752-openshift-default-98f89b8df-47xs7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 17 17:30:53.530175 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:53.529883    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7" podUID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 17 17:30:54.530514 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:54.530478    2566 patch_prober.go:28] interesting pod/e2e-api-a-876752-openshift-default-98f89b8df-47xs7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 17 17:30:54.531120 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:54.531090    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7" podUID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 17 17:30:55.529580 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:55.529541    2566 patch_prober.go:28] interesting pod/e2e-api-a-876752-openshift-default-98f89b8df-47xs7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 17 17:30:55.530268 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:55.529870    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7" podUID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 17 17:30:56.530024 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:56.529975    2566 patch_prober.go:28] interesting pod/e2e-api-a-876752-openshift-default-98f89b8df-47xs7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 17 17:30:56.530559 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:56.530046    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7" podUID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 17 17:30:57.533906 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:57.533871    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:57.534368 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:57.534350    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:57.535119 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:57.535101    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:30:58.813532 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:58.813499    2566 generic.go:356] "Generic (PLEG): container finished" podID="943ef924-1751-41ac-ba3f-eb2d4b2d796c" containerID="e4801b0889dda364e0194631684ac36ed8e909a51c2d6b1f8340eea3817b8e81" exitCode=0
Jul 17 17:30:58.813942 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:58.813570    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5" event={"ID":"943ef924-1751-41ac-ba3f-eb2d4b2d796c","Type":"ContainerDied","Data":"e4801b0889dda364e0194631684ac36ed8e909a51c2d6b1f8340eea3817b8e81"}
Jul 17 17:30:58.814029 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:58.814013    2566 scope.go:117] "RemoveContainer" containerID="e4801b0889dda364e0194631684ac36ed8e909a51c2d6b1f8340eea3817b8e81"
Jul 17 17:30:58.815011 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:58.814985    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:30:58.815128 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:58.815054    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:30:58.815128 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:58.815087    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:30:59.716428 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:59.716382    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:30:59.826598 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:30:59.826560    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5" event={"ID":"943ef924-1751-41ac-ba3f-eb2d4b2d796c","Type":"ContainerStarted","Data":"796af2034edad43258dda770340b4918ab1b8426f0c0d9cb68be335ff24dd919"}
Jul 17 17:31:00.108329 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:00.108232    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:31:00.109798 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:00.109762    2566 patch_prober.go:28] interesting pod/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 17 17:31:00.109951 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:00.109858    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5" podUID="943ef924-1751-41ac-ba3f-eb2d4b2d796c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 17 17:31:01.108786 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:01.108740    2566 patch_prober.go:28] interesting pod/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 17 17:31:01.109294 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:01.108815    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5" podUID="943ef924-1751-41ac-ba3f-eb2d4b2d796c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 17 17:31:02.108515 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:02.108474    2566 patch_prober.go:28] interesting pod/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 17 17:31:02.108745 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:02.108559    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5" podUID="943ef924-1751-41ac-ba3f-eb2d4b2d796c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 17 17:31:03.108681 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:03.108645    2566 patch_prober.go:28] interesting pod/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 17 17:31:03.109262 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:03.109232    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5" podUID="943ef924-1751-41ac-ba3f-eb2d4b2d796c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 17 17:31:04.112862 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:04.112833    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:31:04.113292 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:04.113188    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:31:04.113921 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:04.113900    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:31:25.080072 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:25.080040    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"]
Jul 17 17:31:25.080669 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:25.080340    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7" podUID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerName="istio-proxy" containerID="cri-o://851963a89fabee19fbdd486c3caac111132b716819284f9a8559d9d57b23234f" gracePeriod=30
Jul 17 17:31:27.536897 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:27.536853    2566 patch_prober.go:28] interesting pod/e2e-api-a-876752-openshift-default-98f89b8df-47xs7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 17:31:27.537394 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:27.536917    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7" podUID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 17:31:30.325964 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.325936    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:31:30.427447 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.427380    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-workload-certs\") pod \"19e88ad8-d263-476f-9381-9fd98e83fed9\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") "
Jul 17 17:31:30.427447 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.427430    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-data\") pod \"19e88ad8-d263-476f-9381-9fd98e83fed9\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") "
Jul 17 17:31:30.427676 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.427451    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e88ad8-d263-476f-9381-9fd98e83fed9-istiod-ca-cert\") pod \"19e88ad8-d263-476f-9381-9fd98e83fed9\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") "
Jul 17 17:31:30.427676 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.427475    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-token\") pod \"19e88ad8-d263-476f-9381-9fd98e83fed9\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") "
Jul 17 17:31:30.427676 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.427512    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-envoy\") pod \"19e88ad8-d263-476f-9381-9fd98e83fed9\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") "
Jul 17 17:31:30.427676 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.427534    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-credential-socket\") pod \"19e88ad8-d263-476f-9381-9fd98e83fed9\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") "
Jul 17 17:31:30.427676 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.427553    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-podinfo\") pod \"19e88ad8-d263-476f-9381-9fd98e83fed9\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") "
Jul 17 17:31:30.427676 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.427585    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c76q5\" (UniqueName: \"kubernetes.io/projected/19e88ad8-d263-476f-9381-9fd98e83fed9-kube-api-access-c76q5\") pod \"19e88ad8-d263-476f-9381-9fd98e83fed9\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") "
Jul 17 17:31:30.427676 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.427635    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-workload-socket\") pod \"19e88ad8-d263-476f-9381-9fd98e83fed9\" (UID: \"19e88ad8-d263-476f-9381-9fd98e83fed9\") "
Jul 17 17:31:30.427676 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.427666    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19e88ad8-d263-476f-9381-9fd98e83fed9" (UID: "19e88ad8-d263-476f-9381-9fd98e83fed9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:31:30.428083 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.427911    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19e88ad8-d263-476f-9381-9fd98e83fed9" (UID: "19e88ad8-d263-476f-9381-9fd98e83fed9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:31:30.428083 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.427954    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-workload-certs\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:30.428183 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.428102    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19e88ad8-d263-476f-9381-9fd98e83fed9" (UID: "19e88ad8-d263-476f-9381-9fd98e83fed9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:31:30.428238 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.428182    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19e88ad8-d263-476f-9381-9fd98e83fed9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19e88ad8-d263-476f-9381-9fd98e83fed9" (UID: "19e88ad8-d263-476f-9381-9fd98e83fed9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:31:30.428421 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.428399    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-data" (OuterVolumeSpecName: "istio-data") pod "19e88ad8-d263-476f-9381-9fd98e83fed9" (UID: "19e88ad8-d263-476f-9381-9fd98e83fed9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:31:30.429762 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.429731    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19e88ad8-d263-476f-9381-9fd98e83fed9" (UID: "19e88ad8-d263-476f-9381-9fd98e83fed9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:31:30.429856 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.429805    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19e88ad8-d263-476f-9381-9fd98e83fed9" (UID: "19e88ad8-d263-476f-9381-9fd98e83fed9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 17:31:30.430098 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.430081    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19e88ad8-d263-476f-9381-9fd98e83fed9-kube-api-access-c76q5" (OuterVolumeSpecName: "kube-api-access-c76q5") pod "19e88ad8-d263-476f-9381-9fd98e83fed9" (UID: "19e88ad8-d263-476f-9381-9fd98e83fed9"). InnerVolumeSpecName "kube-api-access-c76q5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:31:30.430155 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.430095    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-token" (OuterVolumeSpecName: "istio-token") pod "19e88ad8-d263-476f-9381-9fd98e83fed9" (UID: "19e88ad8-d263-476f-9381-9fd98e83fed9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:31:30.528963 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.528926    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-data\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:30.528963 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.528960    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e88ad8-d263-476f-9381-9fd98e83fed9-istiod-ca-cert\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:30.528963 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.528969    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-token\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:30.528963 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.528976    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-envoy\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:30.529188 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.528984    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-credential-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:30.529188 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.528993    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e88ad8-d263-476f-9381-9fd98e83fed9-istio-podinfo\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:30.529188 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.529001    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c76q5\" (UniqueName: \"kubernetes.io/projected/19e88ad8-d263-476f-9381-9fd98e83fed9-kube-api-access-c76q5\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:30.529188 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.529009    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e88ad8-d263-476f-9381-9fd98e83fed9-workload-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:30.988890 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.988858    2566 generic.go:356] "Generic (PLEG): container finished" podID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerID="851963a89fabee19fbdd486c3caac111132b716819284f9a8559d9d57b23234f" exitCode=0
Jul 17 17:31:30.989061 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.988904    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"
Jul 17 17:31:30.989061 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.988909    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7" event={"ID":"19e88ad8-d263-476f-9381-9fd98e83fed9","Type":"ContainerDied","Data":"851963a89fabee19fbdd486c3caac111132b716819284f9a8559d9d57b23234f"}
Jul 17 17:31:30.989061 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.988955    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7" event={"ID":"19e88ad8-d263-476f-9381-9fd98e83fed9","Type":"ContainerDied","Data":"b1dde0b692e1a53cc2b5286b2f5a81139cbf3f25ed21375985c50bc57d3cdeb1"}
Jul 17 17:31:30.989061 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.988981    2566 scope.go:117] "RemoveContainer" containerID="851963a89fabee19fbdd486c3caac111132b716819284f9a8559d9d57b23234f"
Jul 17 17:31:30.998155 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:30.998136    2566 scope.go:117] "RemoveContainer" containerID="9918960173ee29d00296096e878cc1ac0cd65f0b28cd7c26e23501251fb7b16c"
Jul 17 17:31:31.005690 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:31.005673    2566 scope.go:117] "RemoveContainer" containerID="851963a89fabee19fbdd486c3caac111132b716819284f9a8559d9d57b23234f"
Jul 17 17:31:31.005923 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:31:31.005906    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"851963a89fabee19fbdd486c3caac111132b716819284f9a8559d9d57b23234f\": container with ID starting with 851963a89fabee19fbdd486c3caac111132b716819284f9a8559d9d57b23234f not found: ID does not exist" containerID="851963a89fabee19fbdd486c3caac111132b716819284f9a8559d9d57b23234f"
Jul 17 17:31:31.006005 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:31.005935    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"851963a89fabee19fbdd486c3caac111132b716819284f9a8559d9d57b23234f"} err="failed to get container status \"851963a89fabee19fbdd486c3caac111132b716819284f9a8559d9d57b23234f\": rpc error: code = NotFound desc = could not find container \"851963a89fabee19fbdd486c3caac111132b716819284f9a8559d9d57b23234f\": container with ID starting with 851963a89fabee19fbdd486c3caac111132b716819284f9a8559d9d57b23234f not found: ID does not exist"
Jul 17 17:31:31.006005 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:31.005957    2566 scope.go:117] "RemoveContainer" containerID="9918960173ee29d00296096e878cc1ac0cd65f0b28cd7c26e23501251fb7b16c"
Jul 17 17:31:31.006188 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:31:31.006170    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9918960173ee29d00296096e878cc1ac0cd65f0b28cd7c26e23501251fb7b16c\": container with ID starting with 9918960173ee29d00296096e878cc1ac0cd65f0b28cd7c26e23501251fb7b16c not found: ID does not exist" containerID="9918960173ee29d00296096e878cc1ac0cd65f0b28cd7c26e23501251fb7b16c"
Jul 17 17:31:31.006228 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:31.006196    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9918960173ee29d00296096e878cc1ac0cd65f0b28cd7c26e23501251fb7b16c"} err="failed to get container status \"9918960173ee29d00296096e878cc1ac0cd65f0b28cd7c26e23501251fb7b16c\": rpc error: code = NotFound desc = could not find container \"9918960173ee29d00296096e878cc1ac0cd65f0b28cd7c26e23501251fb7b16c\": container with ID starting with 9918960173ee29d00296096e878cc1ac0cd65f0b28cd7c26e23501251fb7b16c not found: ID does not exist"
Jul 17 17:31:31.010032 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:31.010009    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"]
Jul 17 17:31:31.017052 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:31.017033    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-876752-openshift-default-98f89b8df-47xs7"]
Jul 17 17:31:31.032362 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:31.032342    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19e88ad8-d263-476f-9381-9fd98e83fed9" path="/var/lib/kubelet/pods/19e88ad8-d263-476f-9381-9fd98e83fed9/volumes"
Jul 17 17:31:51.872871 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:51.872791    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"]
Jul 17 17:31:51.873403 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:51.873092    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5" podUID="943ef924-1751-41ac-ba3f-eb2d4b2d796c" containerName="istio-proxy" containerID="cri-o://796af2034edad43258dda770340b4918ab1b8426f0c0d9cb68be335ff24dd919" gracePeriod=30
Jul 17 17:31:52.718077 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718046    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"]
Jul 17 17:31:52.718471 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718458    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ee22fb-306e-4dba-a3b9-08aab54e0081" containerName="revoke-keys"
Jul 17 17:31:52.718532 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718472    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ee22fb-306e-4dba-a3b9-08aab54e0081" containerName="revoke-keys"
Jul 17 17:31:52.718532 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718491    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12ee698a-0a84-4547-8948-3631f8970baf" containerName="istio-proxy"
Jul 17 17:31:52.718532 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718497    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="12ee698a-0a84-4547-8948-3631f8970baf" containerName="istio-proxy"
Jul 17 17:31:52.718532 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718503    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerName="istio-proxy"
Jul 17 17:31:52.718532 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718508    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerName="istio-proxy"
Jul 17 17:31:52.718532 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718515    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerName="istio-proxy"
Jul 17 17:31:52.718532 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718520    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerName="istio-proxy"
Jul 17 17:31:52.718532 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718531    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ee22fb-306e-4dba-a3b9-08aab54e0081" containerName="revoke-keys"
Jul 17 17:31:52.718532 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718537    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ee22fb-306e-4dba-a3b9-08aab54e0081" containerName="revoke-keys"
Jul 17 17:31:52.718844 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718590    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6ee22fb-306e-4dba-a3b9-08aab54e0081" containerName="revoke-keys"
Jul 17 17:31:52.718844 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718598    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6ee22fb-306e-4dba-a3b9-08aab54e0081" containerName="revoke-keys"
Jul 17 17:31:52.718844 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718604    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerName="istio-proxy"
Jul 17 17:31:52.718844 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718609    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6ee22fb-306e-4dba-a3b9-08aab54e0081" containerName="revoke-keys"
Jul 17 17:31:52.718844 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.718617    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="19e88ad8-d263-476f-9381-9fd98e83fed9" containerName="istio-proxy"
Jul 17 17:31:52.720718 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.720701    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.723023 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.722997    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-3d4103-openshift-default-dockercfg-mfs8k\""
Jul 17 17:31:52.732389 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.732369    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"]
Jul 17 17:31:52.840218 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.840183    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-workload-certs\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.840218 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.840221    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-credential-socket\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.840448 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.840248    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-envoy\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.840448 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.840276    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-data\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.840448 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.840297    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqjj2\" (UniqueName: \"kubernetes.io/projected/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-kube-api-access-qqjj2\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.840448 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.840370    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-workload-socket\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.840448 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.840386    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-token\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.840448 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.840401    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-podinfo\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.840649 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.840456    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istiod-ca-cert\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.941643 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.941616    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-envoy\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.942042 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.941650    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-data\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.942042 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.941669    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqjj2\" (UniqueName: \"kubernetes.io/projected/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-kube-api-access-qqjj2\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.942042 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.941710    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-workload-socket\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.942042 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.941733    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-token\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.942042 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.941749    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-podinfo\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.942042 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.941789    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istiod-ca-cert\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.942042 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.941844    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-workload-certs\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.942042 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.941892    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-credential-socket\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.942439 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.942159    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-data\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.942439 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.942193    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-workload-socket\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.942439 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.942230    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-credential-socket\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.942537 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.942484    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-workload-certs\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.942613 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.942535    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istiod-ca-cert\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.943896 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.943877    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-envoy\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.944146 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.944126    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-podinfo\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.949756 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.949731    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-token\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:52.949924 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:52.949905    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqjj2\" (UniqueName: \"kubernetes.io/projected/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-kube-api-access-qqjj2\") pod \"e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") " pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:53.034199 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:53.034182    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-3d4103-openshift-default-dockercfg-mfs8k\""
Jul 17 17:31:53.042294 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:53.042274    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:53.178634 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:53.178607    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"]
Jul 17 17:31:53.180297 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:31:53.180267    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9590ee0d_e24d_49ce_b08b_1c36fdbf5338.slice/crio-0e99643ed1ed539ea48ccab925c18fb5e706d2e174f22050ebf4909b0297af9f WatchSource:0}: Error finding container 0e99643ed1ed539ea48ccab925c18fb5e706d2e174f22050ebf4909b0297af9f: Status 404 returned error can't find the container with id 0e99643ed1ed539ea48ccab925c18fb5e706d2e174f22050ebf4909b0297af9f
Jul 17 17:31:53.182489 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:53.182459    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:31:53.182589 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:53.182518    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:31:53.182589 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:53.182547    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:31:54.118874 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:54.118841    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r" event={"ID":"9590ee0d-e24d-49ce-b08b-1c36fdbf5338","Type":"ContainerStarted","Data":"700cef4de315e69557d57c42b9366e2b545fdecfb34cda471ed68bdaaca5aca0"}
Jul 17 17:31:54.119308 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:54.118895    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r" event={"ID":"9590ee0d-e24d-49ce-b08b-1c36fdbf5338","Type":"ContainerStarted","Data":"0e99643ed1ed539ea48ccab925c18fb5e706d2e174f22050ebf4909b0297af9f"}
Jul 17 17:31:54.140527 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:54.140475    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r" podStartSLOduration=2.140462326 podStartE2EDuration="2.140462326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:54.138681885 +0000 UTC m=+3962.997810445" watchObservedRunningTime="2026-07-17 17:31:54.140462326 +0000 UTC m=+3962.999590923"
Jul 17 17:31:55.043385 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:55.043353    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:55.048300 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:55.048275    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:55.124876 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:55.124851    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:55.125664 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:55.125646    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:31:57.136103 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.136039    2566 generic.go:356] "Generic (PLEG): container finished" podID="943ef924-1751-41ac-ba3f-eb2d4b2d796c" containerID="796af2034edad43258dda770340b4918ab1b8426f0c0d9cb68be335ff24dd919" exitCode=0
Jul 17 17:31:57.136478 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.136108    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5" event={"ID":"943ef924-1751-41ac-ba3f-eb2d4b2d796c","Type":"ContainerDied","Data":"796af2034edad43258dda770340b4918ab1b8426f0c0d9cb68be335ff24dd919"}
Jul 17 17:31:57.136478 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.136166    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5" event={"ID":"943ef924-1751-41ac-ba3f-eb2d4b2d796c","Type":"ContainerDied","Data":"0ab133788f1b5c05e4fc853c7a28c3e1cb3e3451b9c9770fe46e4c7bf7103537"}
Jul 17 17:31:57.136478 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.136191    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ab133788f1b5c05e4fc853c7a28c3e1cb3e3451b9c9770fe46e4c7bf7103537"
Jul 17 17:31:57.136478 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.136209    2566 scope.go:117] "RemoveContainer" containerID="e4801b0889dda364e0194631684ac36ed8e909a51c2d6b1f8340eea3817b8e81"
Jul 17 17:31:57.141117 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.141088    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:31:57.282553 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.282525    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-data\") pod \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") "
Jul 17 17:31:57.282714 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.282576    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-podinfo\") pod \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") "
Jul 17 17:31:57.282714 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.282604    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-workload-socket\") pod \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") "
Jul 17 17:31:57.282714 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.282623    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-token\") pod \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") "
Jul 17 17:31:57.282714 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.282656    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-credential-socket\") pod \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") "
Jul 17 17:31:57.282714 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.282678    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmprj\" (UniqueName: \"kubernetes.io/projected/943ef924-1751-41ac-ba3f-eb2d4b2d796c-kube-api-access-pmprj\") pod \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") "
Jul 17 17:31:57.282714 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.282714    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-workload-certs\") pod \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") "
Jul 17 17:31:57.283034 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.282748    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-envoy\") pod \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") "
Jul 17 17:31:57.283034 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.282790    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istiod-ca-cert\") pod \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\" (UID: \"943ef924-1751-41ac-ba3f-eb2d4b2d796c\") "
Jul 17 17:31:57.283034 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.282899    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "943ef924-1751-41ac-ba3f-eb2d4b2d796c" (UID: "943ef924-1751-41ac-ba3f-eb2d4b2d796c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:31:57.283189 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.283116    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "943ef924-1751-41ac-ba3f-eb2d4b2d796c" (UID: "943ef924-1751-41ac-ba3f-eb2d4b2d796c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:31:57.283248 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.283228    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "943ef924-1751-41ac-ba3f-eb2d4b2d796c" (UID: "943ef924-1751-41ac-ba3f-eb2d4b2d796c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:31:57.283312 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.283245    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-workload-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:57.283312 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.283264    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-workload-certs\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:57.283312 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.283100    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "943ef924-1751-41ac-ba3f-eb2d4b2d796c" (UID: "943ef924-1751-41ac-ba3f-eb2d4b2d796c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:31:57.283527 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.283382    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-data" (OuterVolumeSpecName: "istio-data") pod "943ef924-1751-41ac-ba3f-eb2d4b2d796c" (UID: "943ef924-1751-41ac-ba3f-eb2d4b2d796c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:31:57.285095 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.285070    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-token" (OuterVolumeSpecName: "istio-token") pod "943ef924-1751-41ac-ba3f-eb2d4b2d796c" (UID: "943ef924-1751-41ac-ba3f-eb2d4b2d796c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:31:57.285203 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.285151    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "943ef924-1751-41ac-ba3f-eb2d4b2d796c" (UID: "943ef924-1751-41ac-ba3f-eb2d4b2d796c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:31:57.285389 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.285359    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "943ef924-1751-41ac-ba3f-eb2d4b2d796c" (UID: "943ef924-1751-41ac-ba3f-eb2d4b2d796c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 17:31:57.285495 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.285363    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/943ef924-1751-41ac-ba3f-eb2d4b2d796c-kube-api-access-pmprj" (OuterVolumeSpecName: "kube-api-access-pmprj") pod "943ef924-1751-41ac-ba3f-eb2d4b2d796c" (UID: "943ef924-1751-41ac-ba3f-eb2d4b2d796c"). InnerVolumeSpecName "kube-api-access-pmprj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:31:57.384077 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.384051    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-data\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:57.384077 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.384075    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-podinfo\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:57.384303 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.384088    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-token\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:57.384303 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.384099    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-credential-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:57.384303 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.384112    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmprj\" (UniqueName: \"kubernetes.io/projected/943ef924-1751-41ac-ba3f-eb2d4b2d796c-kube-api-access-pmprj\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:57.384303 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.384124    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istio-envoy\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:57.384303 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:57.384136    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/943ef924-1751-41ac-ba3f-eb2d4b2d796c-istiod-ca-cert\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:31:58.142531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:58.142503    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"
Jul 17 17:31:58.177893 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:58.177861    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"]
Jul 17 17:31:58.182885 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:58.182863    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-47d559-openshift-default-64976f68b9-6lzj5"]
Jul 17 17:31:59.032688 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:31:59.032656    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="943ef924-1751-41ac-ba3f-eb2d4b2d796c" path="/var/lib/kubelet/pods/943ef924-1751-41ac-ba3f-eb2d4b2d796c/volumes"
Jul 17 17:32:01.136111 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.136078    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"]
Jul 17 17:32:01.136550 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.136534    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943ef924-1751-41ac-ba3f-eb2d4b2d796c" containerName="istio-proxy"
Jul 17 17:32:01.136550 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.136551    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="943ef924-1751-41ac-ba3f-eb2d4b2d796c" containerName="istio-proxy"
Jul 17 17:32:01.136645 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.136562    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ee22fb-306e-4dba-a3b9-08aab54e0081" containerName="revoke-keys"
Jul 17 17:32:01.136645 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.136568    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ee22fb-306e-4dba-a3b9-08aab54e0081" containerName="revoke-keys"
Jul 17 17:32:01.136645 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.136580    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943ef924-1751-41ac-ba3f-eb2d4b2d796c" containerName="istio-proxy"
Jul 17 17:32:01.136645 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.136586    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="943ef924-1751-41ac-ba3f-eb2d4b2d796c" containerName="istio-proxy"
Jul 17 17:32:01.136783 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.136726    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="943ef924-1751-41ac-ba3f-eb2d4b2d796c" containerName="istio-proxy"
Jul 17 17:32:01.139817 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.139802    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.142183 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.142164    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-4f5e7b-openshift-default-dockercfg-wdh8s\""
Jul 17 17:32:01.153333 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.153291    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"]
Jul 17 17:32:01.318715 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.318682    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-credential-socket\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.318879 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.318749    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zzh7\" (UniqueName: \"kubernetes.io/projected/ade4f59a-8973-4672-a3ae-42668685c03c-kube-api-access-5zzh7\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.318879 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.318780    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-workload-certs\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.318879 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.318821    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-istio-data\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.319011 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.318898    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ade4f59a-8973-4672-a3ae-42668685c03c-istio-podinfo\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.319011 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.318938    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-istio-envoy\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.319011 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.318955    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ade4f59a-8973-4672-a3ae-42668685c03c-istio-token\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.319132 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.319027    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-workload-socket\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.319132 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.319078    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ade4f59a-8973-4672-a3ae-42668685c03c-istiod-ca-cert\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.419942 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.419858    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zzh7\" (UniqueName: \"kubernetes.io/projected/ade4f59a-8973-4672-a3ae-42668685c03c-kube-api-access-5zzh7\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.419942 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.419895    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-workload-certs\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.419942 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.419923    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-istio-data\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.420233 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.419973    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ade4f59a-8973-4672-a3ae-42668685c03c-istio-podinfo\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.420233 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.420023    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-istio-envoy\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.420233 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.420044    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ade4f59a-8973-4672-a3ae-42668685c03c-istio-token\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.420233 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.420076    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-workload-socket\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.420479 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.420285    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-istio-data\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.420479 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.420346    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-workload-certs\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.420479 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.420378    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-workload-socket\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.420479 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.420426    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ade4f59a-8973-4672-a3ae-42668685c03c-istiod-ca-cert\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.420758 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.420511    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-credential-socket\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.420819 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.420788    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-credential-socket\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.421021 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.421001    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ade4f59a-8973-4672-a3ae-42668685c03c-istiod-ca-cert\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.422209 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.422189    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-istio-envoy\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.422445 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.422425    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ade4f59a-8973-4672-a3ae-42668685c03c-istio-podinfo\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.428208 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.428185    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zzh7\" (UniqueName: \"kubernetes.io/projected/ade4f59a-8973-4672-a3ae-42668685c03c-kube-api-access-5zzh7\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.428343 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.428311    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ade4f59a-8973-4672-a3ae-42668685c03c-istio-token\") pod \"e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") " pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.449971 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.449951    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:01.589133 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.589105    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"]
Jul 17 17:32:01.592145 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:32:01.592118    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade4f59a_8973_4672_a3ae_42668685c03c.slice/crio-848367a2fdebd350ae60e8cde08ec6d8ea994ec7f9925b9e56f08773b6cff054 WatchSource:0}: Error finding container 848367a2fdebd350ae60e8cde08ec6d8ea994ec7f9925b9e56f08773b6cff054: Status 404 returned error can't find the container with id 848367a2fdebd350ae60e8cde08ec6d8ea994ec7f9925b9e56f08773b6cff054
Jul 17 17:32:01.597586 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.597551    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:32:01.597675 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.597614    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:32:01.597675 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:01.597642    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:32:02.163613 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:02.163575    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8" event={"ID":"ade4f59a-8973-4672-a3ae-42668685c03c","Type":"ContainerStarted","Data":"259107ea602a821852f041fccb2e11278c399821e4bdca1e17af77e49e8d9276"}
Jul 17 17:32:02.164035 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:02.163644    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8" event={"ID":"ade4f59a-8973-4672-a3ae-42668685c03c","Type":"ContainerStarted","Data":"848367a2fdebd350ae60e8cde08ec6d8ea994ec7f9925b9e56f08773b6cff054"}
Jul 17 17:32:02.206247 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:02.206185    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8" podStartSLOduration=1.20616363 podStartE2EDuration="1.20616363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:32:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:02.205982276 +0000 UTC m=+3971.065110836" watchObservedRunningTime="2026-07-17 17:32:02.20616363 +0000 UTC m=+3971.065292189"
Jul 17 17:32:02.450538 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:02.450440    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:02.455409 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:02.455382    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:03.168466 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:03.168436    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:03.169589 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:03.169572    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:10.127406 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:10.127361    2566 patch_prober.go:28] interesting pod/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 17 17:32:10.127991 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:10.127448    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r" podUID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 17 17:32:10.211775 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:10.211731    2566 generic.go:356] "Generic (PLEG): container finished" podID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" containerID="700cef4de315e69557d57c42b9366e2b545fdecfb34cda471ed68bdaaca5aca0" exitCode=0
Jul 17 17:32:10.213067 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:10.211876    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r" event={"ID":"9590ee0d-e24d-49ce-b08b-1c36fdbf5338","Type":"ContainerDied","Data":"700cef4de315e69557d57c42b9366e2b545fdecfb34cda471ed68bdaaca5aca0"}
Jul 17 17:32:10.213067 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:10.212662    2566 scope.go:117] "RemoveContainer" containerID="700cef4de315e69557d57c42b9366e2b545fdecfb34cda471ed68bdaaca5aca0"
Jul 17 17:32:10.214046 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:10.214010    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:32:10.214154 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:10.214102    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:32:10.214216 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:10.214150    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:32:11.224881 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:11.224179    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r" event={"ID":"9590ee0d-e24d-49ce-b08b-1c36fdbf5338","Type":"ContainerStarted","Data":"0cd8d9efc03bab9a170f2d344653227b38e7774195963510ca564db22c3a4fe0"}
Jul 17 17:32:12.043302 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:12.043263    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:32:12.043609 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:12.043582    2566 patch_prober.go:28] interesting pod/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 17 17:32:12.043780 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:12.043754    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r" podUID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 17 17:32:13.045212 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:13.045163    2566 patch_prober.go:28] interesting pod/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 17 17:32:13.045759 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:13.045242    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r" podUID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 17 17:32:13.963740 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:13.963705    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g"]
Jul 17 17:32:13.964262 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:13.964249    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="943ef924-1751-41ac-ba3f-eb2d4b2d796c" containerName="istio-proxy"
Jul 17 17:32:13.966908 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:13.966883    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g"
Jul 17 17:32:13.969585 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:13.969546    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:32:13.969800 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:13.969779    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:32:13.981237 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:13.981203    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g"]
Jul 17 17:32:14.044344 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:14.043953    2566 patch_prober.go:28] interesting pod/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 17 17:32:14.044344 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:14.044011    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r" podUID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 17 17:32:14.061310 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:14.061283    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c48d03-39b0-4d48-b191-db95ca64f1eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g\" (UID: \"33c48d03-39b0-4d48-b191-db95ca64f1eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g"
Jul 17 17:32:14.162464 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:14.162428    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c48d03-39b0-4d48-b191-db95ca64f1eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g\" (UID: \"33c48d03-39b0-4d48-b191-db95ca64f1eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g"
Jul 17 17:32:14.163061 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:14.163039    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c48d03-39b0-4d48-b191-db95ca64f1eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g\" (UID: \"33c48d03-39b0-4d48-b191-db95ca64f1eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g"
Jul 17 17:32:14.277144 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:14.277049    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g"
Jul 17 17:32:14.472066 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:14.472038    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g"]
Jul 17 17:32:14.474183 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:32:14.474155    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c48d03_39b0_4d48_b191_db95ca64f1eb.slice/crio-76b0fd7f0cddc4a5f0ad294babeb11b8616f24bb39db5e701043f2e39f4ae721 WatchSource:0}: Error finding container 76b0fd7f0cddc4a5f0ad294babeb11b8616f24bb39db5e701043f2e39f4ae721: Status 404 returned error can't find the container with id 76b0fd7f0cddc4a5f0ad294babeb11b8616f24bb39db5e701043f2e39f4ae721
Jul 17 17:32:15.042903 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:15.042865    2566 patch_prober.go:28] interesting pod/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 17 17:32:15.043108 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:15.042922    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r" podUID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 17 17:32:15.255390 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:15.255287    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g" event={"ID":"33c48d03-39b0-4d48-b191-db95ca64f1eb","Type":"ContainerStarted","Data":"eb1e4db1cf745a7dba176335b1e5f87e18f8f4d53a98b5a29e70ec2d1536c8ee"}
Jul 17 17:32:15.255390 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:15.255381    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g" event={"ID":"33c48d03-39b0-4d48-b191-db95ca64f1eb","Type":"ContainerStarted","Data":"76b0fd7f0cddc4a5f0ad294babeb11b8616f24bb39db5e701043f2e39f4ae721"}
Jul 17 17:32:15.273502 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:15.273441    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g" podStartSLOduration=2.273419032 podStartE2EDuration="2.273419032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:32:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:15.269683852 +0000 UTC m=+3984.128812424" watchObservedRunningTime="2026-07-17 17:32:15.273419032 +0000 UTC m=+3984.132547593"
Jul 17 17:32:16.047513 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:16.047476    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:32:16.047808 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:16.047783    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:32:16.048519 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:16.048495    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:32:16.263555 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:16.263522    2566 generic.go:356] "Generic (PLEG): container finished" podID="33c48d03-39b0-4d48-b191-db95ca64f1eb" containerID="eb1e4db1cf745a7dba176335b1e5f87e18f8f4d53a98b5a29e70ec2d1536c8ee" exitCode=7
Jul 17 17:32:16.263971 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:16.263614    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g" event={"ID":"33c48d03-39b0-4d48-b191-db95ca64f1eb","Type":"ContainerDied","Data":"eb1e4db1cf745a7dba176335b1e5f87e18f8f4d53a98b5a29e70ec2d1536c8ee"}
Jul 17 17:32:16.263971 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:16.263793    2566 scope.go:117] "RemoveContainer" containerID="eb1e4db1cf745a7dba176335b1e5f87e18f8f4d53a98b5a29e70ec2d1536c8ee"
Jul 17 17:32:17.272306 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:17.272223    2566 generic.go:356] "Generic (PLEG): container finished" podID="33c48d03-39b0-4d48-b191-db95ca64f1eb" containerID="a6b2b4ef239e0607e69d4f5d1eb237997b6dd87f7b4cd6e22d5855e464d9974a" exitCode=7
Jul 17 17:32:17.272808 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:17.272304    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g" event={"ID":"33c48d03-39b0-4d48-b191-db95ca64f1eb","Type":"ContainerDied","Data":"a6b2b4ef239e0607e69d4f5d1eb237997b6dd87f7b4cd6e22d5855e464d9974a"}
Jul 17 17:32:17.272808 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:17.272392    2566 scope.go:117] "RemoveContainer" containerID="eb1e4db1cf745a7dba176335b1e5f87e18f8f4d53a98b5a29e70ec2d1536c8ee"
Jul 17 17:32:17.272808 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:17.272691    2566 scope.go:117] "RemoveContainer" containerID="a6b2b4ef239e0607e69d4f5d1eb237997b6dd87f7b4cd6e22d5855e464d9974a"
Jul 17 17:32:17.272999 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:32:17.272944    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g_odh-ai-gateway-infra(33c48d03-39b0-4d48-b191-db95ca64f1eb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g" podUID="33c48d03-39b0-4d48-b191-db95ca64f1eb"
Jul 17 17:32:18.170122 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:18.170092    2566 patch_prober.go:28] interesting pod/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 17 17:32:18.170342 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:18.170153    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8" podUID="ade4f59a-8973-4672-a3ae-42668685c03c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 17 17:32:18.279718 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:18.279686    2566 generic.go:356] "Generic (PLEG): container finished" podID="ade4f59a-8973-4672-a3ae-42668685c03c" containerID="259107ea602a821852f041fccb2e11278c399821e4bdca1e17af77e49e8d9276" exitCode=0
Jul 17 17:32:18.280151 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:18.279763    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8" event={"ID":"ade4f59a-8973-4672-a3ae-42668685c03c","Type":"ContainerDied","Data":"259107ea602a821852f041fccb2e11278c399821e4bdca1e17af77e49e8d9276"}
Jul 17 17:32:18.280278 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:18.280260    2566 scope.go:117] "RemoveContainer" containerID="259107ea602a821852f041fccb2e11278c399821e4bdca1e17af77e49e8d9276"
Jul 17 17:32:18.281421 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:18.281394    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:32:18.281504 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:18.281458    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:32:18.281504 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:18.281490    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:32:18.281639 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:18.281627    2566 scope.go:117] "RemoveContainer" containerID="a6b2b4ef239e0607e69d4f5d1eb237997b6dd87f7b4cd6e22d5855e464d9974a"
Jul 17 17:32:18.281800 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:32:18.281784    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g_odh-ai-gateway-infra(33c48d03-39b0-4d48-b191-db95ca64f1eb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g" podUID="33c48d03-39b0-4d48-b191-db95ca64f1eb"
Jul 17 17:32:19.289877 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:19.289841    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8" event={"ID":"ade4f59a-8973-4672-a3ae-42668685c03c","Type":"ContainerStarted","Data":"31687c34b339a46c95808fc9895718e6b6898c4af72d58a709157fd1321249e1"}
Jul 17 17:32:19.450411 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:19.450370    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:19.450635 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:19.450609    2566 patch_prober.go:28] interesting pod/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 17 17:32:19.450693 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:19.450670    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8" podUID="ade4f59a-8973-4672-a3ae-42668685c03c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 17 17:32:20.450965 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:20.450926    2566 patch_prober.go:28] interesting pod/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 17 17:32:20.451418 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:20.450980    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8" podUID="ade4f59a-8973-4672-a3ae-42668685c03c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 17 17:32:21.451288 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:21.451249    2566 patch_prober.go:28] interesting pod/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 17 17:32:21.451751 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:21.451307    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8" podUID="ade4f59a-8973-4672-a3ae-42668685c03c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 17 17:32:22.450846 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:22.450810    2566 patch_prober.go:28] interesting pod/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 17 17:32:22.451035 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:22.450880    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8" podUID="ade4f59a-8973-4672-a3ae-42668685c03c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 17 17:32:23.454108 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:23.454079    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:23.454605 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:23.454454    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:23.455029 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:23.455011    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:32:33.028501 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:33.028472    2566 scope.go:117] "RemoveContainer" containerID="a6b2b4ef239e0607e69d4f5d1eb237997b6dd87f7b4cd6e22d5855e464d9974a"
Jul 17 17:32:33.366751 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:33.366726    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g" event={"ID":"33c48d03-39b0-4d48-b191-db95ca64f1eb","Type":"ContainerStarted","Data":"9164a32ae43cecb5bf4351a786eb90111ee47cfa1cc5f0cea4bf45e6df4b319d"}
Jul 17 17:32:34.373100 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:34.373069    2566 generic.go:356] "Generic (PLEG): container finished" podID="33c48d03-39b0-4d48-b191-db95ca64f1eb" containerID="9164a32ae43cecb5bf4351a786eb90111ee47cfa1cc5f0cea4bf45e6df4b319d" exitCode=7
Jul 17 17:32:34.373607 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:34.373140    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g" event={"ID":"33c48d03-39b0-4d48-b191-db95ca64f1eb","Type":"ContainerDied","Data":"9164a32ae43cecb5bf4351a786eb90111ee47cfa1cc5f0cea4bf45e6df4b319d"}
Jul 17 17:32:34.373607 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:34.373197    2566 scope.go:117] "RemoveContainer" containerID="a6b2b4ef239e0607e69d4f5d1eb237997b6dd87f7b4cd6e22d5855e464d9974a"
Jul 17 17:32:34.374045 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:34.373959    2566 scope.go:117] "RemoveContainer" containerID="9164a32ae43cecb5bf4351a786eb90111ee47cfa1cc5f0cea4bf45e6df4b319d"
Jul 17 17:32:34.374406 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:32:34.374381    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g_odh-ai-gateway-infra(33c48d03-39b0-4d48-b191-db95ca64f1eb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g" podUID="33c48d03-39b0-4d48-b191-db95ca64f1eb"
Jul 17 17:32:34.398495 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:34.398471    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g"]
Jul 17 17:32:35.520362 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:35.520337    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g"
Jul 17 17:32:35.580032 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:35.580000    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c48d03-39b0-4d48-b191-db95ca64f1eb-maas-api-service-ca\") pod \"33c48d03-39b0-4d48-b191-db95ca64f1eb\" (UID: \"33c48d03-39b0-4d48-b191-db95ca64f1eb\") "
Jul 17 17:32:35.580384 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:35.580361    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33c48d03-39b0-4d48-b191-db95ca64f1eb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "33c48d03-39b0-4d48-b191-db95ca64f1eb" (UID: "33c48d03-39b0-4d48-b191-db95ca64f1eb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:32:35.681376 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:35.681286    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c48d03-39b0-4d48-b191-db95ca64f1eb-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:32:36.386203 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:36.386171    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g"
Jul 17 17:32:36.386203 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:36.386185    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g" event={"ID":"33c48d03-39b0-4d48-b191-db95ca64f1eb","Type":"ContainerDied","Data":"76b0fd7f0cddc4a5f0ad294babeb11b8616f24bb39db5e701043f2e39f4ae721"}
Jul 17 17:32:36.386450 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:36.386246    2566 scope.go:117] "RemoveContainer" containerID="9164a32ae43cecb5bf4351a786eb90111ee47cfa1cc5f0cea4bf45e6df4b319d"
Jul 17 17:32:36.407201 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:36.407178    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g"]
Jul 17 17:32:36.414297 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:36.414267    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-f9j5g"]
Jul 17 17:32:37.031446 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:37.031413    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33c48d03-39b0-4d48-b191-db95ca64f1eb" path="/var/lib/kubelet/pods/33c48d03-39b0-4d48-b191-db95ca64f1eb/volumes"
Jul 17 17:32:53.467576 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:32:53.467548    2566 scope.go:117] "RemoveContainer" containerID="e9b816a83a58662b0f0053f9fa2b890dbddd0146a6c6fb7a859ad566d67db6fe"
Jul 17 17:33:06.571873 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.571837    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd"]
Jul 17 17:33:06.572550 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.572233    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33c48d03-39b0-4d48-b191-db95ca64f1eb" containerName="revoke-keys"
Jul 17 17:33:06.572550 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.572245    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="33c48d03-39b0-4d48-b191-db95ca64f1eb" containerName="revoke-keys"
Jul 17 17:33:06.572550 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.572255    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33c48d03-39b0-4d48-b191-db95ca64f1eb" containerName="revoke-keys"
Jul 17 17:33:06.572550 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.572261    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="33c48d03-39b0-4d48-b191-db95ca64f1eb" containerName="revoke-keys"
Jul 17 17:33:06.572550 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.572343    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="33c48d03-39b0-4d48-b191-db95ca64f1eb" containerName="revoke-keys"
Jul 17 17:33:06.572550 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.572354    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="33c48d03-39b0-4d48-b191-db95ca64f1eb" containerName="revoke-keys"
Jul 17 17:33:06.572550 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.572364    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="33c48d03-39b0-4d48-b191-db95ca64f1eb" containerName="revoke-keys"
Jul 17 17:33:06.575335 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.575299    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd"
Jul 17 17:33:06.577647 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.577627    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:33:06.577759 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.577737    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:33:06.584383 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.583925    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd"]
Jul 17 17:33:06.643658 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.643627    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4389cb84-c380-42be-a96f-aaeb64da567b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd\" (UID: \"4389cb84-c380-42be-a96f-aaeb64da567b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd"
Jul 17 17:33:06.744961 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.744921    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4389cb84-c380-42be-a96f-aaeb64da567b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd\" (UID: \"4389cb84-c380-42be-a96f-aaeb64da567b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd"
Jul 17 17:33:06.745588 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.745564    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4389cb84-c380-42be-a96f-aaeb64da567b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd\" (UID: \"4389cb84-c380-42be-a96f-aaeb64da567b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd"
Jul 17 17:33:06.889540 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:06.889450    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd"
Jul 17 17:33:07.034610 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:07.034587    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd"]
Jul 17 17:33:07.037498 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:33:07.037452    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4389cb84_c380_42be_a96f_aaeb64da567b.slice/crio-a539c423bc374fb72379aebd6da0583e1e527865dcc1a6830818fabdccf5423b WatchSource:0}: Error finding container a539c423bc374fb72379aebd6da0583e1e527865dcc1a6830818fabdccf5423b: Status 404 returned error can't find the container with id a539c423bc374fb72379aebd6da0583e1e527865dcc1a6830818fabdccf5423b
Jul 17 17:33:07.555211 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:07.555174    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd" event={"ID":"4389cb84-c380-42be-a96f-aaeb64da567b","Type":"ContainerStarted","Data":"9af322a1c909569b045d9f48f9406d9c3f4898ebc6d50491cd2babc047363631"}
Jul 17 17:33:07.555394 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:07.555238    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd" event={"ID":"4389cb84-c380-42be-a96f-aaeb64da567b","Type":"ContainerStarted","Data":"a539c423bc374fb72379aebd6da0583e1e527865dcc1a6830818fabdccf5423b"}
Jul 17 17:33:07.571914 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:07.571868    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd" podStartSLOduration=1.571853181 podStartE2EDuration="1.571853181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:33:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:33:07.570235503 +0000 UTC m=+4036.429364064" watchObservedRunningTime="2026-07-17 17:33:07.571853181 +0000 UTC m=+4036.430981740"
Jul 17 17:33:08.562726 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:08.562692    2566 generic.go:356] "Generic (PLEG): container finished" podID="4389cb84-c380-42be-a96f-aaeb64da567b" containerID="9af322a1c909569b045d9f48f9406d9c3f4898ebc6d50491cd2babc047363631" exitCode=7
Jul 17 17:33:08.562917 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:08.562781    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd" event={"ID":"4389cb84-c380-42be-a96f-aaeb64da567b","Type":"ContainerDied","Data":"9af322a1c909569b045d9f48f9406d9c3f4898ebc6d50491cd2babc047363631"}
Jul 17 17:33:08.562975 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:08.562960    2566 scope.go:117] "RemoveContainer" containerID="9af322a1c909569b045d9f48f9406d9c3f4898ebc6d50491cd2babc047363631"
Jul 17 17:33:09.570337 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:09.570290    2566 generic.go:356] "Generic (PLEG): container finished" podID="4389cb84-c380-42be-a96f-aaeb64da567b" containerID="1ad40ba010bc56079e60c468f1f93b3614bbad599107fabac04faea56c8ee439" exitCode=7
Jul 17 17:33:09.570756 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:09.570360    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd" event={"ID":"4389cb84-c380-42be-a96f-aaeb64da567b","Type":"ContainerDied","Data":"1ad40ba010bc56079e60c468f1f93b3614bbad599107fabac04faea56c8ee439"}
Jul 17 17:33:09.570756 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:09.570425    2566 scope.go:117] "RemoveContainer" containerID="9af322a1c909569b045d9f48f9406d9c3f4898ebc6d50491cd2babc047363631"
Jul 17 17:33:09.570756 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:09.570589    2566 scope.go:117] "RemoveContainer" containerID="1ad40ba010bc56079e60c468f1f93b3614bbad599107fabac04faea56c8ee439"
Jul 17 17:33:09.570895 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:33:09.570765    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd_odh-ai-gateway-infra(4389cb84-c380-42be-a96f-aaeb64da567b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd" podUID="4389cb84-c380-42be-a96f-aaeb64da567b"
Jul 17 17:33:10.577086 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:10.577060    2566 scope.go:117] "RemoveContainer" containerID="1ad40ba010bc56079e60c468f1f93b3614bbad599107fabac04faea56c8ee439"
Jul 17 17:33:10.577487 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:33:10.577263    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd_odh-ai-gateway-infra(4389cb84-c380-42be-a96f-aaeb64da567b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd" podUID="4389cb84-c380-42be-a96f-aaeb64da567b"
Jul 17 17:33:16.128823 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:16.128795    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj"]
Jul 17 17:33:16.129201 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:16.129179    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33c48d03-39b0-4d48-b191-db95ca64f1eb" containerName="revoke-keys"
Jul 17 17:33:16.129201 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:16.129191    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="33c48d03-39b0-4d48-b191-db95ca64f1eb" containerName="revoke-keys"
Jul 17 17:33:16.132059 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:16.132041    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj"
Jul 17 17:33:16.141162 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:16.141139    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj"]
Jul 17 17:33:16.230711 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:16.230679    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d48211-f6d8-4b44-9d65-88a7d554bafa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-hvdbj\" (UID: \"61d48211-f6d8-4b44-9d65-88a7d554bafa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj"
Jul 17 17:33:16.331294 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:16.331266    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d48211-f6d8-4b44-9d65-88a7d554bafa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-hvdbj\" (UID: \"61d48211-f6d8-4b44-9d65-88a7d554bafa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj"
Jul 17 17:33:16.331892 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:16.331873    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d48211-f6d8-4b44-9d65-88a7d554bafa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-hvdbj\" (UID: \"61d48211-f6d8-4b44-9d65-88a7d554bafa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj"
Jul 17 17:33:16.443879 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:16.443816    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj"
Jul 17 17:33:16.574053 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:16.574030    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj"]
Jul 17 17:33:16.576070 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:33:16.576043    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d48211_f6d8_4b44_9d65_88a7d554bafa.slice/crio-43ebfef7f9e3511bb62c1f33833d34c7aae2694da4e9918905fbcdb29e3cff55 WatchSource:0}: Error finding container 43ebfef7f9e3511bb62c1f33833d34c7aae2694da4e9918905fbcdb29e3cff55: Status 404 returned error can't find the container with id 43ebfef7f9e3511bb62c1f33833d34c7aae2694da4e9918905fbcdb29e3cff55
Jul 17 17:33:16.607727 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:16.607694    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj" event={"ID":"61d48211-f6d8-4b44-9d65-88a7d554bafa","Type":"ContainerStarted","Data":"43ebfef7f9e3511bb62c1f33833d34c7aae2694da4e9918905fbcdb29e3cff55"}
Jul 17 17:33:17.614729 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:17.614693    2566 generic.go:356] "Generic (PLEG): container finished" podID="61d48211-f6d8-4b44-9d65-88a7d554bafa" containerID="67cb1c8c60db5ad85231a9476722887da49ad72a096194732dc55666f7799bb0" exitCode=7
Jul 17 17:33:17.615142 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:17.614783    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj" event={"ID":"61d48211-f6d8-4b44-9d65-88a7d554bafa","Type":"ContainerDied","Data":"67cb1c8c60db5ad85231a9476722887da49ad72a096194732dc55666f7799bb0"}
Jul 17 17:33:17.615142 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:17.614958    2566 scope.go:117] "RemoveContainer" containerID="67cb1c8c60db5ad85231a9476722887da49ad72a096194732dc55666f7799bb0"
Jul 17 17:33:18.621393 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:18.621292    2566 generic.go:356] "Generic (PLEG): container finished" podID="61d48211-f6d8-4b44-9d65-88a7d554bafa" containerID="be2462e163075f9c2ed1840027d48986af7d05f6151dc9be7d8c9839bca91bb9" exitCode=7
Jul 17 17:33:18.621393 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:18.621363    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj" event={"ID":"61d48211-f6d8-4b44-9d65-88a7d554bafa","Type":"ContainerDied","Data":"be2462e163075f9c2ed1840027d48986af7d05f6151dc9be7d8c9839bca91bb9"}
Jul 17 17:33:18.621829 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:18.621424    2566 scope.go:117] "RemoveContainer" containerID="67cb1c8c60db5ad85231a9476722887da49ad72a096194732dc55666f7799bb0"
Jul 17 17:33:18.621829 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:18.621573    2566 scope.go:117] "RemoveContainer" containerID="be2462e163075f9c2ed1840027d48986af7d05f6151dc9be7d8c9839bca91bb9"
Jul 17 17:33:18.621829 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:33:18.621789    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-hvdbj_odh-ai-gateway-infra(61d48211-f6d8-4b44-9d65-88a7d554bafa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj" podUID="61d48211-f6d8-4b44-9d65-88a7d554bafa"
Jul 17 17:33:19.627950 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:19.627926    2566 scope.go:117] "RemoveContainer" containerID="be2462e163075f9c2ed1840027d48986af7d05f6151dc9be7d8c9839bca91bb9"
Jul 17 17:33:19.628333 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:33:19.628134    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-hvdbj_odh-ai-gateway-infra(61d48211-f6d8-4b44-9d65-88a7d554bafa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj" podUID="61d48211-f6d8-4b44-9d65-88a7d554bafa"
Jul 17 17:33:21.529479 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:21.529448    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx"]
Jul 17 17:33:21.533094 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:21.533077    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx"
Jul 17 17:33:21.538993 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:21.538921    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx"]
Jul 17 17:33:21.681401 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:21.681371    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec04c8d1-60f7-4c62-815a-4c466dd4f44a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx\" (UID: \"ec04c8d1-60f7-4c62-815a-4c466dd4f44a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx"
Jul 17 17:33:21.781957 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:21.781885    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec04c8d1-60f7-4c62-815a-4c466dd4f44a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx\" (UID: \"ec04c8d1-60f7-4c62-815a-4c466dd4f44a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx"
Jul 17 17:33:21.782532 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:21.782514    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec04c8d1-60f7-4c62-815a-4c466dd4f44a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx\" (UID: \"ec04c8d1-60f7-4c62-815a-4c466dd4f44a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx"
Jul 17 17:33:21.844402 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:21.844376    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx"
Jul 17 17:33:21.977145 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:21.977116    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx"]
Jul 17 17:33:21.979043 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:33:21.979014    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec04c8d1_60f7_4c62_815a_4c466dd4f44a.slice/crio-7ad3b1c276d0064152e4cb9faa89a1b194c38c742736a95fbbbf1c5e9e38c875 WatchSource:0}: Error finding container 7ad3b1c276d0064152e4cb9faa89a1b194c38c742736a95fbbbf1c5e9e38c875: Status 404 returned error can't find the container with id 7ad3b1c276d0064152e4cb9faa89a1b194c38c742736a95fbbbf1c5e9e38c875
Jul 17 17:33:22.026291 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:22.026273    2566 scope.go:117] "RemoveContainer" containerID="1ad40ba010bc56079e60c468f1f93b3614bbad599107fabac04faea56c8ee439"
Jul 17 17:33:22.645471 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:22.645371    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd" event={"ID":"4389cb84-c380-42be-a96f-aaeb64da567b","Type":"ContainerStarted","Data":"0a4cd300beae6f8c65b3a0ef7a51cf88c7101b7e2e0aa84b519a23bd48567421"}
Jul 17 17:33:22.646778 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:22.646751    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx" event={"ID":"ec04c8d1-60f7-4c62-815a-4c466dd4f44a","Type":"ContainerStarted","Data":"4bbb20db5c950bde555dedd69b408d7b209ef73f5cdc32987b307236bad6066b"}
Jul 17 17:33:22.646893 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:22.646803    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx" event={"ID":"ec04c8d1-60f7-4c62-815a-4c466dd4f44a","Type":"ContainerStarted","Data":"7ad3b1c276d0064152e4cb9faa89a1b194c38c742736a95fbbbf1c5e9e38c875"}
Jul 17 17:33:22.674502 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:22.674461    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx" podStartSLOduration=1.6744494109999999 podStartE2EDuration="1.674449411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:33:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:33:22.672972412 +0000 UTC m=+4051.532100978" watchObservedRunningTime="2026-07-17 17:33:22.674449411 +0000 UTC m=+4051.533577971"
Jul 17 17:33:23.653617 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:23.653576    2566 generic.go:356] "Generic (PLEG): container finished" podID="4389cb84-c380-42be-a96f-aaeb64da567b" containerID="0a4cd300beae6f8c65b3a0ef7a51cf88c7101b7e2e0aa84b519a23bd48567421" exitCode=7
Jul 17 17:33:23.654025 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:23.653651    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd" event={"ID":"4389cb84-c380-42be-a96f-aaeb64da567b","Type":"ContainerDied","Data":"0a4cd300beae6f8c65b3a0ef7a51cf88c7101b7e2e0aa84b519a23bd48567421"}
Jul 17 17:33:23.654025 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:23.653742    2566 scope.go:117] "RemoveContainer" containerID="1ad40ba010bc56079e60c468f1f93b3614bbad599107fabac04faea56c8ee439"
Jul 17 17:33:23.654175 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:23.654038    2566 scope.go:117] "RemoveContainer" containerID="0a4cd300beae6f8c65b3a0ef7a51cf88c7101b7e2e0aa84b519a23bd48567421"
Jul 17 17:33:23.654284 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:33:23.654266    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd_odh-ai-gateway-infra(4389cb84-c380-42be-a96f-aaeb64da567b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd" podUID="4389cb84-c380-42be-a96f-aaeb64da567b"
Jul 17 17:33:23.655221 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:23.655202    2566 generic.go:356] "Generic (PLEG): container finished" podID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a" containerID="4bbb20db5c950bde555dedd69b408d7b209ef73f5cdc32987b307236bad6066b" exitCode=7
Jul 17 17:33:23.655297 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:23.655275    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx" event={"ID":"ec04c8d1-60f7-4c62-815a-4c466dd4f44a","Type":"ContainerDied","Data":"4bbb20db5c950bde555dedd69b408d7b209ef73f5cdc32987b307236bad6066b"}
Jul 17 17:33:23.655444 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:23.655431    2566 scope.go:117] "RemoveContainer" containerID="4bbb20db5c950bde555dedd69b408d7b209ef73f5cdc32987b307236bad6066b"
Jul 17 17:33:23.678334 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:23.678298    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd"]
Jul 17 17:33:24.663807 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:24.663778    2566 generic.go:356] "Generic (PLEG): container finished" podID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a" containerID="1fb1a056f9b65bb57e1bc2c7b9ab3f9383dd2feba93e8926d97a83c8e2458abd" exitCode=7
Jul 17 17:33:24.664087 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:24.663881    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx" event={"ID":"ec04c8d1-60f7-4c62-815a-4c466dd4f44a","Type":"ContainerDied","Data":"1fb1a056f9b65bb57e1bc2c7b9ab3f9383dd2feba93e8926d97a83c8e2458abd"}
Jul 17 17:33:24.664087 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:24.663974    2566 scope.go:117] "RemoveContainer" containerID="4bbb20db5c950bde555dedd69b408d7b209ef73f5cdc32987b307236bad6066b"
Jul 17 17:33:24.664087 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:24.663996    2566 scope.go:117] "RemoveContainer" containerID="1fb1a056f9b65bb57e1bc2c7b9ab3f9383dd2feba93e8926d97a83c8e2458abd"
Jul 17 17:33:24.664256 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:33:24.664233    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx_odh-ai-gateway-infra(ec04c8d1-60f7-4c62-815a-4c466dd4f44a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx" podUID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a"
Jul 17 17:33:24.799011 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:24.798987    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd"
Jul 17 17:33:24.910310 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:24.910265    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4389cb84-c380-42be-a96f-aaeb64da567b-maas-api-service-ca\") pod \"4389cb84-c380-42be-a96f-aaeb64da567b\" (UID: \"4389cb84-c380-42be-a96f-aaeb64da567b\") "
Jul 17 17:33:24.910610 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:24.910587    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4389cb84-c380-42be-a96f-aaeb64da567b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4389cb84-c380-42be-a96f-aaeb64da567b" (UID: "4389cb84-c380-42be-a96f-aaeb64da567b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:33:25.011299 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:25.011223    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4389cb84-c380-42be-a96f-aaeb64da567b-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:33:25.670442 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:25.670413    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd"
Jul 17 17:33:25.670442 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:25.670432    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd" event={"ID":"4389cb84-c380-42be-a96f-aaeb64da567b","Type":"ContainerDied","Data":"a539c423bc374fb72379aebd6da0583e1e527865dcc1a6830818fabdccf5423b"}
Jul 17 17:33:25.670950 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:25.670500    2566 scope.go:117] "RemoveContainer" containerID="0a4cd300beae6f8c65b3a0ef7a51cf88c7101b7e2e0aa84b519a23bd48567421"
Jul 17 17:33:25.672493 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:25.672473    2566 scope.go:117] "RemoveContainer" containerID="1fb1a056f9b65bb57e1bc2c7b9ab3f9383dd2feba93e8926d97a83c8e2458abd"
Jul 17 17:33:25.672760 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:33:25.672735    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx_odh-ai-gateway-infra(ec04c8d1-60f7-4c62-815a-4c466dd4f44a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx" podUID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a"
Jul 17 17:33:25.685477 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:25.685454    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd"]
Jul 17 17:33:25.690982 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:25.690964    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8wncd"]
Jul 17 17:33:27.032893 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:27.032854    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4389cb84-c380-42be-a96f-aaeb64da567b" path="/var/lib/kubelet/pods/4389cb84-c380-42be-a96f-aaeb64da567b/volumes"
Jul 17 17:33:32.026212 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:32.026181    2566 scope.go:117] "RemoveContainer" containerID="be2462e163075f9c2ed1840027d48986af7d05f6151dc9be7d8c9839bca91bb9"
Jul 17 17:33:32.713282 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:32.713234    2566 generic.go:356] "Generic (PLEG): container finished" podID="61d48211-f6d8-4b44-9d65-88a7d554bafa" containerID="a3310e6bf6afecce083854e80c1bba5d0489dd72774f14d15d95712dbe98e604" exitCode=7
Jul 17 17:33:32.713447 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:32.713307    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj" event={"ID":"61d48211-f6d8-4b44-9d65-88a7d554bafa","Type":"ContainerDied","Data":"a3310e6bf6afecce083854e80c1bba5d0489dd72774f14d15d95712dbe98e604"}
Jul 17 17:33:32.713447 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:32.713388    2566 scope.go:117] "RemoveContainer" containerID="be2462e163075f9c2ed1840027d48986af7d05f6151dc9be7d8c9839bca91bb9"
Jul 17 17:33:32.713754 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:32.713737    2566 scope.go:117] "RemoveContainer" containerID="a3310e6bf6afecce083854e80c1bba5d0489dd72774f14d15d95712dbe98e604"
Jul 17 17:33:32.713961 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:33:32.713941    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-hvdbj_odh-ai-gateway-infra(61d48211-f6d8-4b44-9d65-88a7d554bafa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj" podUID="61d48211-f6d8-4b44-9d65-88a7d554bafa"
Jul 17 17:33:33.739063 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:33.739033    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj"]
Jul 17 17:33:33.893098 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:33.893077    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj"
Jul 17 17:33:33.994088 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:33.994018    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d48211-f6d8-4b44-9d65-88a7d554bafa-maas-api-service-ca\") pod \"61d48211-f6d8-4b44-9d65-88a7d554bafa\" (UID: \"61d48211-f6d8-4b44-9d65-88a7d554bafa\") "
Jul 17 17:33:33.994376 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:33.994356    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61d48211-f6d8-4b44-9d65-88a7d554bafa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "61d48211-f6d8-4b44-9d65-88a7d554bafa" (UID: "61d48211-f6d8-4b44-9d65-88a7d554bafa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:33:34.094863 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:34.094833    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d48211-f6d8-4b44-9d65-88a7d554bafa-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:33:34.728756 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:34.728714    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj" event={"ID":"61d48211-f6d8-4b44-9d65-88a7d554bafa","Type":"ContainerDied","Data":"43ebfef7f9e3511bb62c1f33833d34c7aae2694da4e9918905fbcdb29e3cff55"}
Jul 17 17:33:34.728756 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:34.728736    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj"
Jul 17 17:33:34.728997 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:34.728785    2566 scope.go:117] "RemoveContainer" containerID="a3310e6bf6afecce083854e80c1bba5d0489dd72774f14d15d95712dbe98e604"
Jul 17 17:33:34.750423 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:34.750403    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj"]
Jul 17 17:33:34.757237 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:34.756754    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-hvdbj"]
Jul 17 17:33:35.032162 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:35.032127    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61d48211-f6d8-4b44-9d65-88a7d554bafa" path="/var/lib/kubelet/pods/61d48211-f6d8-4b44-9d65-88a7d554bafa/volumes"
Jul 17 17:33:39.032559 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:39.032530    2566 scope.go:117] "RemoveContainer" containerID="1fb1a056f9b65bb57e1bc2c7b9ab3f9383dd2feba93e8926d97a83c8e2458abd"
Jul 17 17:33:39.757736 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:39.757654    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx" event={"ID":"ec04c8d1-60f7-4c62-815a-4c466dd4f44a","Type":"ContainerStarted","Data":"93a7ef5b5bbd8583453a04bb62c712909196a9a9d62d0a91a288c3e8d4f74d2e"}
Jul 17 17:33:40.764439 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:40.764403    2566 generic.go:356] "Generic (PLEG): container finished" podID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a" containerID="93a7ef5b5bbd8583453a04bb62c712909196a9a9d62d0a91a288c3e8d4f74d2e" exitCode=7
Jul 17 17:33:40.764439 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:40.764441    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx" event={"ID":"ec04c8d1-60f7-4c62-815a-4c466dd4f44a","Type":"ContainerDied","Data":"93a7ef5b5bbd8583453a04bb62c712909196a9a9d62d0a91a288c3e8d4f74d2e"}
Jul 17 17:33:40.764971 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:40.764499    2566 scope.go:117] "RemoveContainer" containerID="1fb1a056f9b65bb57e1bc2c7b9ab3f9383dd2feba93e8926d97a83c8e2458abd"
Jul 17 17:33:40.764971 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:40.764751    2566 scope.go:117] "RemoveContainer" containerID="93a7ef5b5bbd8583453a04bb62c712909196a9a9d62d0a91a288c3e8d4f74d2e"
Jul 17 17:33:40.764971 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:33:40.764938    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx_odh-ai-gateway-infra(ec04c8d1-60f7-4c62-815a-4c466dd4f44a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx" podUID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a"
Jul 17 17:33:40.788018 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:40.787993    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx"]
Jul 17 17:33:41.918204 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:41.918178    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx"
Jul 17 17:33:41.965632 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:41.965602    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec04c8d1-60f7-4c62-815a-4c466dd4f44a-maas-api-service-ca\") pod \"ec04c8d1-60f7-4c62-815a-4c466dd4f44a\" (UID: \"ec04c8d1-60f7-4c62-815a-4c466dd4f44a\") "
Jul 17 17:33:41.965921 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:41.965898    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec04c8d1-60f7-4c62-815a-4c466dd4f44a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ec04c8d1-60f7-4c62-815a-4c466dd4f44a" (UID: "ec04c8d1-60f7-4c62-815a-4c466dd4f44a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:33:42.067120 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:42.067098    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec04c8d1-60f7-4c62-815a-4c466dd4f44a-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:33:42.778272 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:42.778239    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx"
Jul 17 17:33:42.778469 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:42.778274    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx" event={"ID":"ec04c8d1-60f7-4c62-815a-4c466dd4f44a","Type":"ContainerDied","Data":"7ad3b1c276d0064152e4cb9faa89a1b194c38c742736a95fbbbf1c5e9e38c875"}
Jul 17 17:33:42.778469 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:42.778352    2566 scope.go:117] "RemoveContainer" containerID="93a7ef5b5bbd8583453a04bb62c712909196a9a9d62d0a91a288c3e8d4f74d2e"
Jul 17 17:33:42.799925 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:42.799892    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx"]
Jul 17 17:33:42.802773 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:42.802751    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-lkxqx"]
Jul 17 17:33:43.031931 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:43.031857    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a" path="/var/lib/kubelet/pods/ec04c8d1-60f7-4c62-815a-4c466dd4f44a/volumes"
Jul 17 17:33:56.609985 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.609949    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg"]
Jul 17 17:33:56.610387 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610347    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4389cb84-c380-42be-a96f-aaeb64da567b" containerName="revoke-keys"
Jul 17 17:33:56.610387 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610359    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4389cb84-c380-42be-a96f-aaeb64da567b" containerName="revoke-keys"
Jul 17 17:33:56.610387 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610371    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a" containerName="revoke-keys"
Jul 17 17:33:56.610387 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610376    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a" containerName="revoke-keys"
Jul 17 17:33:56.610387 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610385    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4389cb84-c380-42be-a96f-aaeb64da567b" containerName="revoke-keys"
Jul 17 17:33:56.610387 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610390    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4389cb84-c380-42be-a96f-aaeb64da567b" containerName="revoke-keys"
Jul 17 17:33:56.610623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610401    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a" containerName="revoke-keys"
Jul 17 17:33:56.610623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610406    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a" containerName="revoke-keys"
Jul 17 17:33:56.610623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610414    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d48211-f6d8-4b44-9d65-88a7d554bafa" containerName="revoke-keys"
Jul 17 17:33:56.610623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610419    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d48211-f6d8-4b44-9d65-88a7d554bafa" containerName="revoke-keys"
Jul 17 17:33:56.610623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610434    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d48211-f6d8-4b44-9d65-88a7d554bafa" containerName="revoke-keys"
Jul 17 17:33:56.610623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610439    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d48211-f6d8-4b44-9d65-88a7d554bafa" containerName="revoke-keys"
Jul 17 17:33:56.610623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610506    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4389cb84-c380-42be-a96f-aaeb64da567b" containerName="revoke-keys"
Jul 17 17:33:56.610623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610513    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="61d48211-f6d8-4b44-9d65-88a7d554bafa" containerName="revoke-keys"
Jul 17 17:33:56.610623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610519    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a" containerName="revoke-keys"
Jul 17 17:33:56.610623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610526    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4389cb84-c380-42be-a96f-aaeb64da567b" containerName="revoke-keys"
Jul 17 17:33:56.610623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610531    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a" containerName="revoke-keys"
Jul 17 17:33:56.610623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610537    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a" containerName="revoke-keys"
Jul 17 17:33:56.610623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610544    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4389cb84-c380-42be-a96f-aaeb64da567b" containerName="revoke-keys"
Jul 17 17:33:56.610623 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.610550    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="61d48211-f6d8-4b44-9d65-88a7d554bafa" containerName="revoke-keys"
Jul 17 17:33:56.613255 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.613237    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg"
Jul 17 17:33:56.615587 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.615567    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:33:56.615702 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.615602    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:33:56.620884 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.620855    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg"]
Jul 17 17:33:56.700224 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.700197    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f13a3826-de32-4d94-bd32-67ba045baaff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg\" (UID: \"f13a3826-de32-4d94-bd32-67ba045baaff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg"
Jul 17 17:33:56.800706 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.800678    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f13a3826-de32-4d94-bd32-67ba045baaff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg\" (UID: \"f13a3826-de32-4d94-bd32-67ba045baaff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg"
Jul 17 17:33:56.801276 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.801239    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f13a3826-de32-4d94-bd32-67ba045baaff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg\" (UID: \"f13a3826-de32-4d94-bd32-67ba045baaff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg"
Jul 17 17:33:56.924898 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:56.924837    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg"
Jul 17 17:33:57.260030 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:57.260004    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg"]
Jul 17 17:33:57.261946 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:33:57.261920    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13a3826_de32_4d94_bd32_67ba045baaff.slice/crio-e883bc480ba77ff79971ac34c4885331d9b4ce365f6cd42d106189335b3fda7b WatchSource:0}: Error finding container e883bc480ba77ff79971ac34c4885331d9b4ce365f6cd42d106189335b3fda7b: Status 404 returned error can't find the container with id e883bc480ba77ff79971ac34c4885331d9b4ce365f6cd42d106189335b3fda7b
Jul 17 17:33:57.862864 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:57.862830    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg" event={"ID":"f13a3826-de32-4d94-bd32-67ba045baaff","Type":"ContainerStarted","Data":"5cd6546ffeafc424588930b1312fdbe7252cb49055990fde11fc5116cf642ddd"}
Jul 17 17:33:57.863232 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:57.862890    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg" event={"ID":"f13a3826-de32-4d94-bd32-67ba045baaff","Type":"ContainerStarted","Data":"e883bc480ba77ff79971ac34c4885331d9b4ce365f6cd42d106189335b3fda7b"}
Jul 17 17:33:57.879062 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:57.879012    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg" podStartSLOduration=1.878997067 podStartE2EDuration="1.878997067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:33:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:33:57.87714501 +0000 UTC m=+4086.736273567" watchObservedRunningTime="2026-07-17 17:33:57.878997067 +0000 UTC m=+4086.738125667"
Jul 17 17:33:58.869664 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:58.869629    2566 generic.go:356] "Generic (PLEG): container finished" podID="f13a3826-de32-4d94-bd32-67ba045baaff" containerID="5cd6546ffeafc424588930b1312fdbe7252cb49055990fde11fc5116cf642ddd" exitCode=7
Jul 17 17:33:58.870062 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:58.869719    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg" event={"ID":"f13a3826-de32-4d94-bd32-67ba045baaff","Type":"ContainerDied","Data":"5cd6546ffeafc424588930b1312fdbe7252cb49055990fde11fc5116cf642ddd"}
Jul 17 17:33:58.870062 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:58.869909    2566 scope.go:117] "RemoveContainer" containerID="5cd6546ffeafc424588930b1312fdbe7252cb49055990fde11fc5116cf642ddd"
Jul 17 17:33:59.877002 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:59.876971    2566 generic.go:356] "Generic (PLEG): container finished" podID="f13a3826-de32-4d94-bd32-67ba045baaff" containerID="c5ce9531b6889c8529a65caab2d7d692301acf30d360de7a992876c6c6cc507d" exitCode=7
Jul 17 17:33:59.877415 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:59.877023    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg" event={"ID":"f13a3826-de32-4d94-bd32-67ba045baaff","Type":"ContainerDied","Data":"c5ce9531b6889c8529a65caab2d7d692301acf30d360de7a992876c6c6cc507d"}
Jul 17 17:33:59.877415 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:59.877070    2566 scope.go:117] "RemoveContainer" containerID="5cd6546ffeafc424588930b1312fdbe7252cb49055990fde11fc5116cf642ddd"
Jul 17 17:33:59.877415 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:33:59.877281    2566 scope.go:117] "RemoveContainer" containerID="c5ce9531b6889c8529a65caab2d7d692301acf30d360de7a992876c6c6cc507d"
Jul 17 17:33:59.877563 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:33:59.877543    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg_odh-ai-gateway-infra(f13a3826-de32-4d94-bd32-67ba045baaff)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg" podUID="f13a3826-de32-4d94-bd32-67ba045baaff"
Jul 17 17:34:00.883553 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:00.883527    2566 scope.go:117] "RemoveContainer" containerID="c5ce9531b6889c8529a65caab2d7d692301acf30d360de7a992876c6c6cc507d"
Jul 17 17:34:00.883927 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:34:00.883738    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg_odh-ai-gateway-infra(f13a3826-de32-4d94-bd32-67ba045baaff)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg" podUID="f13a3826-de32-4d94-bd32-67ba045baaff"
Jul 17 17:34:13.028746 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:13.028712    2566 scope.go:117] "RemoveContainer" containerID="c5ce9531b6889c8529a65caab2d7d692301acf30d360de7a992876c6c6cc507d"
Jul 17 17:34:13.954341 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:13.954291    2566 generic.go:356] "Generic (PLEG): container finished" podID="f13a3826-de32-4d94-bd32-67ba045baaff" containerID="7afa8e711b34c22e17c198371e99783c814f2b3049093ab103f40620a2acd461" exitCode=7
Jul 17 17:34:13.954529 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:13.954352    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg" event={"ID":"f13a3826-de32-4d94-bd32-67ba045baaff","Type":"ContainerDied","Data":"7afa8e711b34c22e17c198371e99783c814f2b3049093ab103f40620a2acd461"}
Jul 17 17:34:13.954529 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:13.954422    2566 scope.go:117] "RemoveContainer" containerID="c5ce9531b6889c8529a65caab2d7d692301acf30d360de7a992876c6c6cc507d"
Jul 17 17:34:13.954760 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:13.954718    2566 scope.go:117] "RemoveContainer" containerID="7afa8e711b34c22e17c198371e99783c814f2b3049093ab103f40620a2acd461"
Jul 17 17:34:13.955026 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:34:13.955000    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg_odh-ai-gateway-infra(f13a3826-de32-4d94-bd32-67ba045baaff)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg" podUID="f13a3826-de32-4d94-bd32-67ba045baaff"
Jul 17 17:34:14.050251 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.050223    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt"]
Jul 17 17:34:14.050737 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.050720    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4389cb84-c380-42be-a96f-aaeb64da567b" containerName="revoke-keys"
Jul 17 17:34:14.050737 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.050738    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4389cb84-c380-42be-a96f-aaeb64da567b" containerName="revoke-keys"
Jul 17 17:34:14.050841 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.050752    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a" containerName="revoke-keys"
Jul 17 17:34:14.050841 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.050760    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec04c8d1-60f7-4c62-815a-4c466dd4f44a" containerName="revoke-keys"
Jul 17 17:34:14.050841 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.050807    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d48211-f6d8-4b44-9d65-88a7d554bafa" containerName="revoke-keys"
Jul 17 17:34:14.050841 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.050817    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d48211-f6d8-4b44-9d65-88a7d554bafa" containerName="revoke-keys"
Jul 17 17:34:14.051040 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.050895    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="61d48211-f6d8-4b44-9d65-88a7d554bafa" containerName="revoke-keys"
Jul 17 17:34:14.055356 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.055334    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt"
Jul 17 17:34:14.060617 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.060556    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt"]
Jul 17 17:34:14.065012 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.064945    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b30f22-e19d-44a0-8d7b-47b35feb3ee6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt\" (UID: \"e5b30f22-e19d-44a0-8d7b-47b35feb3ee6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt"
Jul 17 17:34:14.166304 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.166271    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b30f22-e19d-44a0-8d7b-47b35feb3ee6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt\" (UID: \"e5b30f22-e19d-44a0-8d7b-47b35feb3ee6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt"
Jul 17 17:34:14.166875 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.166857    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b30f22-e19d-44a0-8d7b-47b35feb3ee6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt\" (UID: \"e5b30f22-e19d-44a0-8d7b-47b35feb3ee6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt"
Jul 17 17:34:14.368962 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.368928    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt"
Jul 17 17:34:14.505089 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.505059    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt"]
Jul 17 17:34:14.507795 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:34:14.507763    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b30f22_e19d_44a0_8d7b_47b35feb3ee6.slice/crio-9e9d4b0c10410db54cc0a9e4845d1212df340c5ce3072ade80f3d1db27a8f16e WatchSource:0}: Error finding container 9e9d4b0c10410db54cc0a9e4845d1212df340c5ce3072ade80f3d1db27a8f16e: Status 404 returned error can't find the container with id 9e9d4b0c10410db54cc0a9e4845d1212df340c5ce3072ade80f3d1db27a8f16e
Jul 17 17:34:14.963153 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.963120    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt" event={"ID":"e5b30f22-e19d-44a0-8d7b-47b35feb3ee6","Type":"ContainerStarted","Data":"e0e3b958e0881e8312a95cdd07c8ad9834f7ebcd14399f76cede8675fa3bbc99"}
Jul 17 17:34:14.963347 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.963175    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt" event={"ID":"e5b30f22-e19d-44a0-8d7b-47b35feb3ee6","Type":"ContainerStarted","Data":"9e9d4b0c10410db54cc0a9e4845d1212df340c5ce3072ade80f3d1db27a8f16e"}
Jul 17 17:34:14.978614 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.978516    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt" podStartSLOduration=0.978502109 podStartE2EDuration="978.502109ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:34:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:34:14.977804825 +0000 UTC m=+4103.836933387" watchObservedRunningTime="2026-07-17 17:34:14.978502109 +0000 UTC m=+4103.837630668"
Jul 17 17:34:14.982603 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:14.982574    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg"]
Jul 17 17:34:15.131591 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:15.131563    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg"
Jul 17 17:34:15.177448 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:15.177403    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f13a3826-de32-4d94-bd32-67ba045baaff-maas-api-service-ca\") pod \"f13a3826-de32-4d94-bd32-67ba045baaff\" (UID: \"f13a3826-de32-4d94-bd32-67ba045baaff\") "
Jul 17 17:34:15.177754 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:15.177729    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f13a3826-de32-4d94-bd32-67ba045baaff-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f13a3826-de32-4d94-bd32-67ba045baaff" (UID: "f13a3826-de32-4d94-bd32-67ba045baaff"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:34:15.278780 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:15.278749    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f13a3826-de32-4d94-bd32-67ba045baaff-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:34:15.971131 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:15.971095    2566 generic.go:356] "Generic (PLEG): container finished" podID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6" containerID="e0e3b958e0881e8312a95cdd07c8ad9834f7ebcd14399f76cede8675fa3bbc99" exitCode=7
Jul 17 17:34:15.971362 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:15.971184    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt" event={"ID":"e5b30f22-e19d-44a0-8d7b-47b35feb3ee6","Type":"ContainerDied","Data":"e0e3b958e0881e8312a95cdd07c8ad9834f7ebcd14399f76cede8675fa3bbc99"}
Jul 17 17:34:15.971456 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:15.971387    2566 scope.go:117] "RemoveContainer" containerID="e0e3b958e0881e8312a95cdd07c8ad9834f7ebcd14399f76cede8675fa3bbc99"
Jul 17 17:34:15.972668 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:15.972635    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg"
Jul 17 17:34:15.972668 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:15.972640    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg" event={"ID":"f13a3826-de32-4d94-bd32-67ba045baaff","Type":"ContainerDied","Data":"e883bc480ba77ff79971ac34c4885331d9b4ce365f6cd42d106189335b3fda7b"}
Jul 17 17:34:15.972822 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:15.972687    2566 scope.go:117] "RemoveContainer" containerID="7afa8e711b34c22e17c198371e99783c814f2b3049093ab103f40620a2acd461"
Jul 17 17:34:16.009044 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:16.009017    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg"]
Jul 17 17:34:16.012980 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:16.012960    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-8vqwg"]
Jul 17 17:34:16.979435 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:16.979350    2566 generic.go:356] "Generic (PLEG): container finished" podID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6" containerID="b172c31d502b01d7fed242b5d6c5696d66192225b00bbd36d9ccd71393a8765c" exitCode=7
Jul 17 17:34:16.979855 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:16.979481    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt" event={"ID":"e5b30f22-e19d-44a0-8d7b-47b35feb3ee6","Type":"ContainerDied","Data":"b172c31d502b01d7fed242b5d6c5696d66192225b00bbd36d9ccd71393a8765c"}
Jul 17 17:34:16.979855 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:16.979536    2566 scope.go:117] "RemoveContainer" containerID="e0e3b958e0881e8312a95cdd07c8ad9834f7ebcd14399f76cede8675fa3bbc99"
Jul 17 17:34:16.979855 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:16.979735    2566 scope.go:117] "RemoveContainer" containerID="b172c31d502b01d7fed242b5d6c5696d66192225b00bbd36d9ccd71393a8765c"
Jul 17 17:34:16.979990 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:34:16.979971    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt_odh-ai-gateway-infra(e5b30f22-e19d-44a0-8d7b-47b35feb3ee6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt" podUID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6"
Jul 17 17:34:17.031531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:17.031506    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f13a3826-de32-4d94-bd32-67ba045baaff" path="/var/lib/kubelet/pods/f13a3826-de32-4d94-bd32-67ba045baaff/volumes"
Jul 17 17:34:17.987565 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:17.987542    2566 scope.go:117] "RemoveContainer" containerID="b172c31d502b01d7fed242b5d6c5696d66192225b00bbd36d9ccd71393a8765c"
Jul 17 17:34:17.987921 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:34:17.987725    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt_odh-ai-gateway-infra(e5b30f22-e19d-44a0-8d7b-47b35feb3ee6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt" podUID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6"
Jul 17 17:34:21.575422 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.575389    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn"]
Jul 17 17:34:21.575805 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.575775    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13a3826-de32-4d94-bd32-67ba045baaff" containerName="revoke-keys"
Jul 17 17:34:21.575805 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.575785    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13a3826-de32-4d94-bd32-67ba045baaff" containerName="revoke-keys"
Jul 17 17:34:21.575805 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.575803    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13a3826-de32-4d94-bd32-67ba045baaff" containerName="revoke-keys"
Jul 17 17:34:21.575918 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.575809    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13a3826-de32-4d94-bd32-67ba045baaff" containerName="revoke-keys"
Jul 17 17:34:21.575918 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.575818    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13a3826-de32-4d94-bd32-67ba045baaff" containerName="revoke-keys"
Jul 17 17:34:21.575918 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.575824    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13a3826-de32-4d94-bd32-67ba045baaff" containerName="revoke-keys"
Jul 17 17:34:21.575918 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.575889    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f13a3826-de32-4d94-bd32-67ba045baaff" containerName="revoke-keys"
Jul 17 17:34:21.575918 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.575896    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f13a3826-de32-4d94-bd32-67ba045baaff" containerName="revoke-keys"
Jul 17 17:34:21.580262 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.580246    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn"
Jul 17 17:34:21.586000 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.585966    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn"]
Jul 17 17:34:21.641376 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.641338    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cec2cc29-412f-4eb6-99f8-f6eb25130fe4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn\" (UID: \"cec2cc29-412f-4eb6-99f8-f6eb25130fe4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn"
Jul 17 17:34:21.742926 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.742890    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cec2cc29-412f-4eb6-99f8-f6eb25130fe4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn\" (UID: \"cec2cc29-412f-4eb6-99f8-f6eb25130fe4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn"
Jul 17 17:34:21.743501 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.743484    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cec2cc29-412f-4eb6-99f8-f6eb25130fe4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn\" (UID: \"cec2cc29-412f-4eb6-99f8-f6eb25130fe4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn"
Jul 17 17:34:21.893159 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:21.893071    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn"
Jul 17 17:34:22.029548 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:22.029422    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn"]
Jul 17 17:34:22.032675 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:34:22.032641    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec2cc29_412f_4eb6_99f8_f6eb25130fe4.slice/crio-db291ca328a2a529c2c8d0889b648ae03e7f8861d8e790c227fd600bf9504105 WatchSource:0}: Error finding container db291ca328a2a529c2c8d0889b648ae03e7f8861d8e790c227fd600bf9504105: Status 404 returned error can't find the container with id db291ca328a2a529c2c8d0889b648ae03e7f8861d8e790c227fd600bf9504105
Jul 17 17:34:23.018276 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:23.018186    2566 generic.go:356] "Generic (PLEG): container finished" podID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4" containerID="8fa104de336ca99733015a70738f0c88ac973863dc1a3b7f5b8aa27c583ae216" exitCode=7
Jul 17 17:34:23.018276 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:23.018226    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn" event={"ID":"cec2cc29-412f-4eb6-99f8-f6eb25130fe4","Type":"ContainerDied","Data":"8fa104de336ca99733015a70738f0c88ac973863dc1a3b7f5b8aa27c583ae216"}
Jul 17 17:34:23.018276 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:23.018265    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn" event={"ID":"cec2cc29-412f-4eb6-99f8-f6eb25130fe4","Type":"ContainerStarted","Data":"db291ca328a2a529c2c8d0889b648ae03e7f8861d8e790c227fd600bf9504105"}
Jul 17 17:34:23.018740 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:23.018493    2566 scope.go:117] "RemoveContainer" containerID="8fa104de336ca99733015a70738f0c88ac973863dc1a3b7f5b8aa27c583ae216"
Jul 17 17:34:24.025106 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:24.025020    2566 generic.go:356] "Generic (PLEG): container finished" podID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4" containerID="7c32e9661e8f0f8cd04d15cb0842638c30192540fc1552ca53c7588d14eb398f" exitCode=7
Jul 17 17:34:24.025529 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:24.025104    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn" event={"ID":"cec2cc29-412f-4eb6-99f8-f6eb25130fe4","Type":"ContainerDied","Data":"7c32e9661e8f0f8cd04d15cb0842638c30192540fc1552ca53c7588d14eb398f"}
Jul 17 17:34:24.025529 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:24.025160    2566 scope.go:117] "RemoveContainer" containerID="8fa104de336ca99733015a70738f0c88ac973863dc1a3b7f5b8aa27c583ae216"
Jul 17 17:34:24.025529 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:24.025406    2566 scope.go:117] "RemoveContainer" containerID="7c32e9661e8f0f8cd04d15cb0842638c30192540fc1552ca53c7588d14eb398f"
Jul 17 17:34:24.025656 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:34:24.025616    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn_odh-ai-gateway-infra(cec2cc29-412f-4eb6-99f8-f6eb25130fe4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn" podUID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4"
Jul 17 17:34:25.033925 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:25.033896    2566 scope.go:117] "RemoveContainer" containerID="7c32e9661e8f0f8cd04d15cb0842638c30192540fc1552ca53c7588d14eb398f"
Jul 17 17:34:25.034429 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:34:25.034164    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn_odh-ai-gateway-infra(cec2cc29-412f-4eb6-99f8-f6eb25130fe4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn" podUID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4"
Jul 17 17:34:32.026209 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:32.026183    2566 scope.go:117] "RemoveContainer" containerID="b172c31d502b01d7fed242b5d6c5696d66192225b00bbd36d9ccd71393a8765c"
Jul 17 17:34:33.075939 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:33.075901    2566 generic.go:356] "Generic (PLEG): container finished" podID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6" containerID="f28288123ca6f3a4e7f47d8ef22b7ec193f3613e9f3ec9c68395baaa179f7419" exitCode=7
Jul 17 17:34:33.076355 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:33.075973    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt" event={"ID":"e5b30f22-e19d-44a0-8d7b-47b35feb3ee6","Type":"ContainerDied","Data":"f28288123ca6f3a4e7f47d8ef22b7ec193f3613e9f3ec9c68395baaa179f7419"}
Jul 17 17:34:33.076355 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:33.076034    2566 scope.go:117] "RemoveContainer" containerID="b172c31d502b01d7fed242b5d6c5696d66192225b00bbd36d9ccd71393a8765c"
Jul 17 17:34:33.076355 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:33.076302    2566 scope.go:117] "RemoveContainer" containerID="f28288123ca6f3a4e7f47d8ef22b7ec193f3613e9f3ec9c68395baaa179f7419"
Jul 17 17:34:33.076584 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:34:33.076562    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt_odh-ai-gateway-infra(e5b30f22-e19d-44a0-8d7b-47b35feb3ee6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt" podUID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6"
Jul 17 17:34:34.102774 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:34.102740    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt"]
Jul 17 17:34:34.242173 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:34.242150    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt"
Jul 17 17:34:34.366939 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:34.366850    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b30f22-e19d-44a0-8d7b-47b35feb3ee6-maas-api-service-ca\") pod \"e5b30f22-e19d-44a0-8d7b-47b35feb3ee6\" (UID: \"e5b30f22-e19d-44a0-8d7b-47b35feb3ee6\") "
Jul 17 17:34:34.367236 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:34.367214    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5b30f22-e19d-44a0-8d7b-47b35feb3ee6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e5b30f22-e19d-44a0-8d7b-47b35feb3ee6" (UID: "e5b30f22-e19d-44a0-8d7b-47b35feb3ee6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:34:34.468620 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:34.468584    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b30f22-e19d-44a0-8d7b-47b35feb3ee6-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:34:35.087998 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:35.087967    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt" event={"ID":"e5b30f22-e19d-44a0-8d7b-47b35feb3ee6","Type":"ContainerDied","Data":"9e9d4b0c10410db54cc0a9e4845d1212df340c5ce3072ade80f3d1db27a8f16e"}
Jul 17 17:34:35.088177 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:35.088024    2566 scope.go:117] "RemoveContainer" containerID="f28288123ca6f3a4e7f47d8ef22b7ec193f3613e9f3ec9c68395baaa179f7419"
Jul 17 17:34:35.088177 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:35.087980    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt"
Jul 17 17:34:35.108981 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:35.108946    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt"]
Jul 17 17:34:35.112510 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:35.112482    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-rngzt"]
Jul 17 17:34:37.032538 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:37.032506    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6" path="/var/lib/kubelet/pods/e5b30f22-e19d-44a0-8d7b-47b35feb3ee6/volumes"
Jul 17 17:34:40.026362 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:40.026331    2566 scope.go:117] "RemoveContainer" containerID="7c32e9661e8f0f8cd04d15cb0842638c30192540fc1552ca53c7588d14eb398f"
Jul 17 17:34:41.123472 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:41.123439    2566 generic.go:356] "Generic (PLEG): container finished" podID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4" containerID="8fd122931904e473c5ebe9491d813dafd2e632ee6aafcb4bcc34013709389f3c" exitCode=7
Jul 17 17:34:41.123961 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:41.123507    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn" event={"ID":"cec2cc29-412f-4eb6-99f8-f6eb25130fe4","Type":"ContainerDied","Data":"8fd122931904e473c5ebe9491d813dafd2e632ee6aafcb4bcc34013709389f3c"}
Jul 17 17:34:41.123961 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:41.123576    2566 scope.go:117] "RemoveContainer" containerID="7c32e9661e8f0f8cd04d15cb0842638c30192540fc1552ca53c7588d14eb398f"
Jul 17 17:34:41.123961 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:41.123881    2566 scope.go:117] "RemoveContainer" containerID="8fd122931904e473c5ebe9491d813dafd2e632ee6aafcb4bcc34013709389f3c"
Jul 17 17:34:41.124193 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:34:41.124173    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn_odh-ai-gateway-infra(cec2cc29-412f-4eb6-99f8-f6eb25130fe4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn" podUID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4"
Jul 17 17:34:42.152574 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:42.152536    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn"]
Jul 17 17:34:42.295603 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:42.295578    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn"
Jul 17 17:34:42.446590 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:42.446506    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cec2cc29-412f-4eb6-99f8-f6eb25130fe4-maas-api-service-ca\") pod \"cec2cc29-412f-4eb6-99f8-f6eb25130fe4\" (UID: \"cec2cc29-412f-4eb6-99f8-f6eb25130fe4\") "
Jul 17 17:34:42.446907 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:42.446880    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cec2cc29-412f-4eb6-99f8-f6eb25130fe4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cec2cc29-412f-4eb6-99f8-f6eb25130fe4" (UID: "cec2cc29-412f-4eb6-99f8-f6eb25130fe4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:34:42.547542 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:42.547513    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cec2cc29-412f-4eb6-99f8-f6eb25130fe4-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:34:43.136211 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:43.136187    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn"
Jul 17 17:34:43.136211 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:43.136192    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn" event={"ID":"cec2cc29-412f-4eb6-99f8-f6eb25130fe4","Type":"ContainerDied","Data":"db291ca328a2a529c2c8d0889b648ae03e7f8861d8e790c227fd600bf9504105"}
Jul 17 17:34:43.136439 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:43.136248    2566 scope.go:117] "RemoveContainer" containerID="8fd122931904e473c5ebe9491d813dafd2e632ee6aafcb4bcc34013709389f3c"
Jul 17 17:34:43.151043 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:43.151022    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn"]
Jul 17 17:34:43.161586 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:43.161564    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-sswbn"]
Jul 17 17:34:45.032186 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:45.032145    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4" path="/var/lib/kubelet/pods/cec2cc29-412f-4eb6-99f8-f6eb25130fe4/volumes"
Jul 17 17:34:46.647372 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647336    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5"]
Jul 17 17:34:46.647758 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647727    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4" containerName="revoke-keys"
Jul 17 17:34:46.647758 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647738    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4" containerName="revoke-keys"
Jul 17 17:34:46.647758 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647748    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4" containerName="revoke-keys"
Jul 17 17:34:46.647758 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647754    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4" containerName="revoke-keys"
Jul 17 17:34:46.647894 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647766    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6" containerName="revoke-keys"
Jul 17 17:34:46.647894 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647780    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6" containerName="revoke-keys"
Jul 17 17:34:46.647894 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647787    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4" containerName="revoke-keys"
Jul 17 17:34:46.647894 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647792    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4" containerName="revoke-keys"
Jul 17 17:34:46.647894 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647803    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6" containerName="revoke-keys"
Jul 17 17:34:46.647894 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647808    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6" containerName="revoke-keys"
Jul 17 17:34:46.647894 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647875    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6" containerName="revoke-keys"
Jul 17 17:34:46.647894 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647883    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4" containerName="revoke-keys"
Jul 17 17:34:46.647894 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647890    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4" containerName="revoke-keys"
Jul 17 17:34:46.647894 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647896    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="cec2cc29-412f-4eb6-99f8-f6eb25130fe4" containerName="revoke-keys"
Jul 17 17:34:46.648236 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647902    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f13a3826-de32-4d94-bd32-67ba045baaff" containerName="revoke-keys"
Jul 17 17:34:46.648236 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.647909    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6" containerName="revoke-keys"
Jul 17 17:34:46.652446 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.652427    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5"
Jul 17 17:34:46.654801 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.654778    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:34:46.654912 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.654810    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:34:46.658557 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.658536    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5"]
Jul 17 17:34:46.690062 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.690025    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a921b5f-9c87-4e73-a6ec-3a2b73f225ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5\" (UID: \"1a921b5f-9c87-4e73-a6ec-3a2b73f225ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5"
Jul 17 17:34:46.790806 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.790771    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a921b5f-9c87-4e73-a6ec-3a2b73f225ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5\" (UID: \"1a921b5f-9c87-4e73-a6ec-3a2b73f225ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5"
Jul 17 17:34:46.791385 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.791362    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a921b5f-9c87-4e73-a6ec-3a2b73f225ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5\" (UID: \"1a921b5f-9c87-4e73-a6ec-3a2b73f225ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5"
Jul 17 17:34:46.965727 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:46.965644    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5"
Jul 17 17:34:47.315950 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:47.315923    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5"]
Jul 17 17:34:47.318932 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:34:47.318894    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a921b5f_9c87_4e73_a6ec_3a2b73f225ea.slice/crio-31f13c874254498cee538526de87e7926b00772acbc7dd0aee55582f90780c67 WatchSource:0}: Error finding container 31f13c874254498cee538526de87e7926b00772acbc7dd0aee55582f90780c67: Status 404 returned error can't find the container with id 31f13c874254498cee538526de87e7926b00772acbc7dd0aee55582f90780c67
Jul 17 17:34:48.164241 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:48.164152    2566 generic.go:356] "Generic (PLEG): container finished" podID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea" containerID="9c080388732e4b25528a35ea60f5b4ca333f9c350b6b5699ab2aacdb4c7014c4" exitCode=7
Jul 17 17:34:48.164241 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:48.164226    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5" event={"ID":"1a921b5f-9c87-4e73-a6ec-3a2b73f225ea","Type":"ContainerDied","Data":"9c080388732e4b25528a35ea60f5b4ca333f9c350b6b5699ab2aacdb4c7014c4"}
Jul 17 17:34:48.164675 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:48.164273    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5" event={"ID":"1a921b5f-9c87-4e73-a6ec-3a2b73f225ea","Type":"ContainerStarted","Data":"31f13c874254498cee538526de87e7926b00772acbc7dd0aee55582f90780c67"}
Jul 17 17:34:48.164675 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:48.164450    2566 scope.go:117] "RemoveContainer" containerID="9c080388732e4b25528a35ea60f5b4ca333f9c350b6b5699ab2aacdb4c7014c4"
Jul 17 17:34:49.171566 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:49.171526    2566 generic.go:356] "Generic (PLEG): container finished" podID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea" containerID="0853a7301e2d2e62a2d2246ab8cd1d0bc1137166bed0a93a0c221b792f187c19" exitCode=7
Jul 17 17:34:49.172002 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:49.171607    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5" event={"ID":"1a921b5f-9c87-4e73-a6ec-3a2b73f225ea","Type":"ContainerDied","Data":"0853a7301e2d2e62a2d2246ab8cd1d0bc1137166bed0a93a0c221b792f187c19"}
Jul 17 17:34:49.172002 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:49.171663    2566 scope.go:117] "RemoveContainer" containerID="9c080388732e4b25528a35ea60f5b4ca333f9c350b6b5699ab2aacdb4c7014c4"
Jul 17 17:34:49.172002 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:49.171886    2566 scope.go:117] "RemoveContainer" containerID="0853a7301e2d2e62a2d2246ab8cd1d0bc1137166bed0a93a0c221b792f187c19"
Jul 17 17:34:49.172178 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:34:49.172129    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5_odh-ai-gateway-infra(1a921b5f-9c87-4e73-a6ec-3a2b73f225ea)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5" podUID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea"
Jul 17 17:34:50.179056 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:34:50.179026    2566 scope.go:117] "RemoveContainer" containerID="0853a7301e2d2e62a2d2246ab8cd1d0bc1137166bed0a93a0c221b792f187c19"
Jul 17 17:34:50.179587 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:34:50.179229    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5_odh-ai-gateway-infra(1a921b5f-9c87-4e73-a6ec-3a2b73f225ea)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5" podUID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea"
Jul 17 17:35:05.025711 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:05.025680    2566 scope.go:117] "RemoveContainer" containerID="0853a7301e2d2e62a2d2246ab8cd1d0bc1137166bed0a93a0c221b792f187c19"
Jul 17 17:35:06.210750 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.210716    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c"]
Jul 17 17:35:06.211131 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.211119    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6" containerName="revoke-keys"
Jul 17 17:35:06.211131 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.211132    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6" containerName="revoke-keys"
Jul 17 17:35:06.211216 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.211206    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5b30f22-e19d-44a0-8d7b-47b35feb3ee6" containerName="revoke-keys"
Jul 17 17:35:06.214025 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.214005    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c"
Jul 17 17:35:06.223728 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.223704    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c"]
Jul 17 17:35:06.262594 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.262570    2566 generic.go:356] "Generic (PLEG): container finished" podID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea" containerID="0798ff7d7bea72839d2a056fc84ae798824cb8085090240295382c7d6cc65b80" exitCode=7
Jul 17 17:35:06.262731 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.262638    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5" event={"ID":"1a921b5f-9c87-4e73-a6ec-3a2b73f225ea","Type":"ContainerDied","Data":"0798ff7d7bea72839d2a056fc84ae798824cb8085090240295382c7d6cc65b80"}
Jul 17 17:35:06.262731 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.262694    2566 scope.go:117] "RemoveContainer" containerID="0853a7301e2d2e62a2d2246ab8cd1d0bc1137166bed0a93a0c221b792f187c19"
Jul 17 17:35:06.263005 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.262988    2566 scope.go:117] "RemoveContainer" containerID="0798ff7d7bea72839d2a056fc84ae798824cb8085090240295382c7d6cc65b80"
Jul 17 17:35:06.263201 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:35:06.263183    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5_odh-ai-gateway-infra(1a921b5f-9c87-4e73-a6ec-3a2b73f225ea)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5" podUID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea"
Jul 17 17:35:06.272115 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.272088    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/155e9b24-e8fb-4cb1-adf1-00c47764fafe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-j994c\" (UID: \"155e9b24-e8fb-4cb1-adf1-00c47764fafe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c"
Jul 17 17:35:06.373567 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.373535    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/155e9b24-e8fb-4cb1-adf1-00c47764fafe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-j994c\" (UID: \"155e9b24-e8fb-4cb1-adf1-00c47764fafe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c"
Jul 17 17:35:06.374121 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.374103    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/155e9b24-e8fb-4cb1-adf1-00c47764fafe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-j994c\" (UID: \"155e9b24-e8fb-4cb1-adf1-00c47764fafe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c"
Jul 17 17:35:06.525402 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.525303    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c"
Jul 17 17:35:06.868177 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:06.868153    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c"]
Jul 17 17:35:06.870258 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:35:06.870234    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod155e9b24_e8fb_4cb1_adf1_00c47764fafe.slice/crio-f1b821624d93b43da1dd44a2376d8a2674302c03fdc87b4284ac9cd03cca777e WatchSource:0}: Error finding container f1b821624d93b43da1dd44a2376d8a2674302c03fdc87b4284ac9cd03cca777e: Status 404 returned error can't find the container with id f1b821624d93b43da1dd44a2376d8a2674302c03fdc87b4284ac9cd03cca777e
Jul 17 17:35:07.271170 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:07.271142    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c" event={"ID":"155e9b24-e8fb-4cb1-adf1-00c47764fafe","Type":"ContainerStarted","Data":"a2e2bc87a0c621bd7450bcf1947ee770742f4659738dfdd12219df7c46728419"}
Jul 17 17:35:07.271507 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:07.271193    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c" event={"ID":"155e9b24-e8fb-4cb1-adf1-00c47764fafe","Type":"ContainerStarted","Data":"f1b821624d93b43da1dd44a2376d8a2674302c03fdc87b4284ac9cd03cca777e"}
Jul 17 17:35:07.287866 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:07.287821    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c" podStartSLOduration=1.287808378 podStartE2EDuration="1.287808378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:35:07.285201202 +0000 UTC m=+4156.144329761" watchObservedRunningTime="2026-07-17 17:35:07.287808378 +0000 UTC m=+4156.146936937"
Jul 17 17:35:07.292899 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:07.292875    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5"]
Jul 17 17:35:07.427943 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:07.427920    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5"
Jul 17 17:35:07.485677 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:07.485603    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a921b5f-9c87-4e73-a6ec-3a2b73f225ea-maas-api-service-ca\") pod \"1a921b5f-9c87-4e73-a6ec-3a2b73f225ea\" (UID: \"1a921b5f-9c87-4e73-a6ec-3a2b73f225ea\") "
Jul 17 17:35:07.485940 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:07.485917    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a921b5f-9c87-4e73-a6ec-3a2b73f225ea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1a921b5f-9c87-4e73-a6ec-3a2b73f225ea" (UID: "1a921b5f-9c87-4e73-a6ec-3a2b73f225ea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:35:07.586934 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:07.586909    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a921b5f-9c87-4e73-a6ec-3a2b73f225ea-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:35:08.280380 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:08.280350    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5"
Jul 17 17:35:08.280380 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:08.280360    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5" event={"ID":"1a921b5f-9c87-4e73-a6ec-3a2b73f225ea","Type":"ContainerDied","Data":"31f13c874254498cee538526de87e7926b00772acbc7dd0aee55582f90780c67"}
Jul 17 17:35:08.280904 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:08.280424    2566 scope.go:117] "RemoveContainer" containerID="0798ff7d7bea72839d2a056fc84ae798824cb8085090240295382c7d6cc65b80"
Jul 17 17:35:08.281916 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:08.281892    2566 generic.go:356] "Generic (PLEG): container finished" podID="155e9b24-e8fb-4cb1-adf1-00c47764fafe" containerID="a2e2bc87a0c621bd7450bcf1947ee770742f4659738dfdd12219df7c46728419" exitCode=7
Jul 17 17:35:08.282034 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:08.281971    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c" event={"ID":"155e9b24-e8fb-4cb1-adf1-00c47764fafe","Type":"ContainerDied","Data":"a2e2bc87a0c621bd7450bcf1947ee770742f4659738dfdd12219df7c46728419"}
Jul 17 17:35:08.282211 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:08.282194    2566 scope.go:117] "RemoveContainer" containerID="a2e2bc87a0c621bd7450bcf1947ee770742f4659738dfdd12219df7c46728419"
Jul 17 17:35:08.312238 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:08.312210    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5"]
Jul 17 17:35:08.321116 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:08.321089    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-vkbj5"]
Jul 17 17:35:09.034463 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:09.034426    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea" path="/var/lib/kubelet/pods/1a921b5f-9c87-4e73-a6ec-3a2b73f225ea/volumes"
Jul 17 17:35:09.289770 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:09.289688    2566 generic.go:356] "Generic (PLEG): container finished" podID="155e9b24-e8fb-4cb1-adf1-00c47764fafe" containerID="cfdfc653b3612097a1ea07f114d6195cb08724deaacbc1a27df23a5346fbf639" exitCode=7
Jul 17 17:35:09.289770 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:09.289757    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c" event={"ID":"155e9b24-e8fb-4cb1-adf1-00c47764fafe","Type":"ContainerDied","Data":"cfdfc653b3612097a1ea07f114d6195cb08724deaacbc1a27df23a5346fbf639"}
Jul 17 17:35:09.290245 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:09.289804    2566 scope.go:117] "RemoveContainer" containerID="a2e2bc87a0c621bd7450bcf1947ee770742f4659738dfdd12219df7c46728419"
Jul 17 17:35:09.290245 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:09.290015    2566 scope.go:117] "RemoveContainer" containerID="cfdfc653b3612097a1ea07f114d6195cb08724deaacbc1a27df23a5346fbf639"
Jul 17 17:35:09.290374 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:35:09.290245    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-j994c_odh-ai-gateway-infra(155e9b24-e8fb-4cb1-adf1-00c47764fafe)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c" podUID="155e9b24-e8fb-4cb1-adf1-00c47764fafe"
Jul 17 17:35:10.296748 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:10.296720    2566 scope.go:117] "RemoveContainer" containerID="cfdfc653b3612097a1ea07f114d6195cb08724deaacbc1a27df23a5346fbf639"
Jul 17 17:35:10.297118 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:35:10.296921    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-j994c_odh-ai-gateway-infra(155e9b24-e8fb-4cb1-adf1-00c47764fafe)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c" podUID="155e9b24-e8fb-4cb1-adf1-00c47764fafe"
Jul 17 17:35:14.092866 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:14.092838    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq"]
Jul 17 17:35:14.093267 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:14.093218    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea" containerName="revoke-keys"
Jul 17 17:35:14.093267 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:14.093229    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea" containerName="revoke-keys"
Jul 17 17:35:14.093267 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:14.093245    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea" containerName="revoke-keys"
Jul 17 17:35:14.093267 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:14.093252    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea" containerName="revoke-keys"
Jul 17 17:35:14.093442 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:14.093342    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea" containerName="revoke-keys"
Jul 17 17:35:14.093442 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:14.093352    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea" containerName="revoke-keys"
Jul 17 17:35:14.096497 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:14.096480    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq"
Jul 17 17:35:14.104818 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:14.104789    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq"]
Jul 17 17:35:14.245624 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:14.245588    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/883ecd2b-e918-4e1c-acaf-e98717802ab7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq\" (UID: \"883ecd2b-e918-4e1c-acaf-e98717802ab7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq"
Jul 17 17:35:14.346340 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:14.346252    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/883ecd2b-e918-4e1c-acaf-e98717802ab7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq\" (UID: \"883ecd2b-e918-4e1c-acaf-e98717802ab7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq"
Jul 17 17:35:14.346896 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:14.346878    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/883ecd2b-e918-4e1c-acaf-e98717802ab7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq\" (UID: \"883ecd2b-e918-4e1c-acaf-e98717802ab7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq"
Jul 17 17:35:14.409875 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:14.409844    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq"
Jul 17 17:35:14.546411 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:14.546364    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq"]
Jul 17 17:35:14.550852 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:35:14.550820    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod883ecd2b_e918_4e1c_acaf_e98717802ab7.slice/crio-b9b27f39b890ea459f2a34a1e9cec9614f655d09928a575017af86fd7bbd2226 WatchSource:0}: Error finding container b9b27f39b890ea459f2a34a1e9cec9614f655d09928a575017af86fd7bbd2226: Status 404 returned error can't find the container with id b9b27f39b890ea459f2a34a1e9cec9614f655d09928a575017af86fd7bbd2226
Jul 17 17:35:15.323215 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:15.323183    2566 generic.go:356] "Generic (PLEG): container finished" podID="883ecd2b-e918-4e1c-acaf-e98717802ab7" containerID="35c320db443fed3a794e2db21fe26bb40e05a7e753fe40708134d9c20a457e8d" exitCode=7
Jul 17 17:35:15.323634 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:15.323266    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq" event={"ID":"883ecd2b-e918-4e1c-acaf-e98717802ab7","Type":"ContainerDied","Data":"35c320db443fed3a794e2db21fe26bb40e05a7e753fe40708134d9c20a457e8d"}
Jul 17 17:35:15.323634 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:15.323337    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq" event={"ID":"883ecd2b-e918-4e1c-acaf-e98717802ab7","Type":"ContainerStarted","Data":"b9b27f39b890ea459f2a34a1e9cec9614f655d09928a575017af86fd7bbd2226"}
Jul 17 17:35:15.323634 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:15.323528    2566 scope.go:117] "RemoveContainer" containerID="35c320db443fed3a794e2db21fe26bb40e05a7e753fe40708134d9c20a457e8d"
Jul 17 17:35:16.336401 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:16.336367    2566 generic.go:356] "Generic (PLEG): container finished" podID="883ecd2b-e918-4e1c-acaf-e98717802ab7" containerID="d89cb486245f86f5c7f78c0c8745427b26d37f34a3917c785bea39573542faa4" exitCode=7
Jul 17 17:35:16.336870 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:16.336450    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq" event={"ID":"883ecd2b-e918-4e1c-acaf-e98717802ab7","Type":"ContainerDied","Data":"d89cb486245f86f5c7f78c0c8745427b26d37f34a3917c785bea39573542faa4"}
Jul 17 17:35:16.336870 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:16.336534    2566 scope.go:117] "RemoveContainer" containerID="35c320db443fed3a794e2db21fe26bb40e05a7e753fe40708134d9c20a457e8d"
Jul 17 17:35:16.336870 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:16.336754    2566 scope.go:117] "RemoveContainer" containerID="d89cb486245f86f5c7f78c0c8745427b26d37f34a3917c785bea39573542faa4"
Jul 17 17:35:16.337124 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:35:16.337087    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq_odh-ai-gateway-infra(883ecd2b-e918-4e1c-acaf-e98717802ab7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq" podUID="883ecd2b-e918-4e1c-acaf-e98717802ab7"
Jul 17 17:35:17.342896 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:17.342868    2566 scope.go:117] "RemoveContainer" containerID="d89cb486245f86f5c7f78c0c8745427b26d37f34a3917c785bea39573542faa4"
Jul 17 17:35:17.343279 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:35:17.343070    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq_odh-ai-gateway-infra(883ecd2b-e918-4e1c-acaf-e98717802ab7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq" podUID="883ecd2b-e918-4e1c-acaf-e98717802ab7"
Jul 17 17:35:24.026058 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:24.026027    2566 scope.go:117] "RemoveContainer" containerID="cfdfc653b3612097a1ea07f114d6195cb08724deaacbc1a27df23a5346fbf639"
Jul 17 17:35:24.384614 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:24.384586    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c" event={"ID":"155e9b24-e8fb-4cb1-adf1-00c47764fafe","Type":"ContainerStarted","Data":"d8d34dfb62a52ec9418e95cc0ba05c87e138f9cf0a166b531876dd3219d1559d"}
Jul 17 17:35:25.391990 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:25.391956    2566 generic.go:356] "Generic (PLEG): container finished" podID="155e9b24-e8fb-4cb1-adf1-00c47764fafe" containerID="d8d34dfb62a52ec9418e95cc0ba05c87e138f9cf0a166b531876dd3219d1559d" exitCode=7
Jul 17 17:35:25.392412 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:25.392027    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c" event={"ID":"155e9b24-e8fb-4cb1-adf1-00c47764fafe","Type":"ContainerDied","Data":"d8d34dfb62a52ec9418e95cc0ba05c87e138f9cf0a166b531876dd3219d1559d"}
Jul 17 17:35:25.392412 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:25.392080    2566 scope.go:117] "RemoveContainer" containerID="cfdfc653b3612097a1ea07f114d6195cb08724deaacbc1a27df23a5346fbf639"
Jul 17 17:35:25.392412 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:25.392303    2566 scope.go:117] "RemoveContainer" containerID="d8d34dfb62a52ec9418e95cc0ba05c87e138f9cf0a166b531876dd3219d1559d"
Jul 17 17:35:25.392551 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:35:25.392532    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-j994c_odh-ai-gateway-infra(155e9b24-e8fb-4cb1-adf1-00c47764fafe)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c" podUID="155e9b24-e8fb-4cb1-adf1-00c47764fafe"
Jul 17 17:35:25.420143 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:25.420119    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c"]
Jul 17 17:35:26.538603 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:26.538580    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c"
Jul 17 17:35:26.654672 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:26.654599    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/155e9b24-e8fb-4cb1-adf1-00c47764fafe-maas-api-service-ca\") pod \"155e9b24-e8fb-4cb1-adf1-00c47764fafe\" (UID: \"155e9b24-e8fb-4cb1-adf1-00c47764fafe\") "
Jul 17 17:35:26.655019 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:26.654995    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/155e9b24-e8fb-4cb1-adf1-00c47764fafe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "155e9b24-e8fb-4cb1-adf1-00c47764fafe" (UID: "155e9b24-e8fb-4cb1-adf1-00c47764fafe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:35:26.755548 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:26.755518    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/155e9b24-e8fb-4cb1-adf1-00c47764fafe-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:35:27.404986 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:27.404913    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c"
Jul 17 17:35:27.404986 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:27.404951    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c" event={"ID":"155e9b24-e8fb-4cb1-adf1-00c47764fafe","Type":"ContainerDied","Data":"f1b821624d93b43da1dd44a2376d8a2674302c03fdc87b4284ac9cd03cca777e"}
Jul 17 17:35:27.405198 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:27.405008    2566 scope.go:117] "RemoveContainer" containerID="d8d34dfb62a52ec9418e95cc0ba05c87e138f9cf0a166b531876dd3219d1559d"
Jul 17 17:35:27.422493 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:27.422471    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c"]
Jul 17 17:35:27.427949 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:27.427931    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-j994c"]
Jul 17 17:35:29.032428 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:29.032396    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="155e9b24-e8fb-4cb1-adf1-00c47764fafe" path="/var/lib/kubelet/pods/155e9b24-e8fb-4cb1-adf1-00c47764fafe/volumes"
Jul 17 17:35:30.026353 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:30.026312    2566 scope.go:117] "RemoveContainer" containerID="d89cb486245f86f5c7f78c0c8745427b26d37f34a3917c785bea39573542faa4"
Jul 17 17:35:30.423169 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:30.423140    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq" event={"ID":"883ecd2b-e918-4e1c-acaf-e98717802ab7","Type":"ContainerStarted","Data":"a76a6854e6250bd631073ac838fd4ee2b1a3598d50c2579a67325f38d74fabbf"}
Jul 17 17:35:30.439717 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:30.439673    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq" podStartSLOduration=16.439659662 podStartE2EDuration="16.439659662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:35:30.438457163 +0000 UTC m=+4179.297585722" watchObservedRunningTime="2026-07-17 17:35:30.439659662 +0000 UTC m=+4179.298788220"
Jul 17 17:35:31.430766 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:31.430736    2566 generic.go:356] "Generic (PLEG): container finished" podID="883ecd2b-e918-4e1c-acaf-e98717802ab7" containerID="a76a6854e6250bd631073ac838fd4ee2b1a3598d50c2579a67325f38d74fabbf" exitCode=7
Jul 17 17:35:31.431246 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:31.430805    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq" event={"ID":"883ecd2b-e918-4e1c-acaf-e98717802ab7","Type":"ContainerDied","Data":"a76a6854e6250bd631073ac838fd4ee2b1a3598d50c2579a67325f38d74fabbf"}
Jul 17 17:35:31.431246 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:31.430868    2566 scope.go:117] "RemoveContainer" containerID="d89cb486245f86f5c7f78c0c8745427b26d37f34a3917c785bea39573542faa4"
Jul 17 17:35:31.431246 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:31.431128    2566 scope.go:117] "RemoveContainer" containerID="a76a6854e6250bd631073ac838fd4ee2b1a3598d50c2579a67325f38d74fabbf"
Jul 17 17:35:31.431450 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:35:31.431356    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq_odh-ai-gateway-infra(883ecd2b-e918-4e1c-acaf-e98717802ab7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq" podUID="883ecd2b-e918-4e1c-acaf-e98717802ab7"
Jul 17 17:35:31.447616 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:31.447595    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq"]
Jul 17 17:35:32.578470 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:32.578447    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq"
Jul 17 17:35:32.607357 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:32.607307    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/883ecd2b-e918-4e1c-acaf-e98717802ab7-maas-api-service-ca\") pod \"883ecd2b-e918-4e1c-acaf-e98717802ab7\" (UID: \"883ecd2b-e918-4e1c-acaf-e98717802ab7\") "
Jul 17 17:35:32.607607 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:32.607586    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/883ecd2b-e918-4e1c-acaf-e98717802ab7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "883ecd2b-e918-4e1c-acaf-e98717802ab7" (UID: "883ecd2b-e918-4e1c-acaf-e98717802ab7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:35:32.607715 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:32.607694    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/883ecd2b-e918-4e1c-acaf-e98717802ab7-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:35:33.446990 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:33.446900    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq" event={"ID":"883ecd2b-e918-4e1c-acaf-e98717802ab7","Type":"ContainerDied","Data":"b9b27f39b890ea459f2a34a1e9cec9614f655d09928a575017af86fd7bbd2226"}
Jul 17 17:35:33.446990 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:33.446933    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq"
Jul 17 17:35:33.446990 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:33.446963    2566 scope.go:117] "RemoveContainer" containerID="a76a6854e6250bd631073ac838fd4ee2b1a3598d50c2579a67325f38d74fabbf"
Jul 17 17:35:33.462416 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:33.462395    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq"]
Jul 17 17:35:33.466069 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:33.466048    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-7pfbq"]
Jul 17 17:35:35.032561 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:35.032522    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="883ecd2b-e918-4e1c-acaf-e98717802ab7" path="/var/lib/kubelet/pods/883ecd2b-e918-4e1c-acaf-e98717802ab7/volumes"
Jul 17 17:35:46.687640 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.687608    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws"]
Jul 17 17:35:46.688120 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688104    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea" containerName="revoke-keys"
Jul 17 17:35:46.688205 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688122    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea" containerName="revoke-keys"
Jul 17 17:35:46.688205 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688136    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="155e9b24-e8fb-4cb1-adf1-00c47764fafe" containerName="revoke-keys"
Jul 17 17:35:46.688205 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688145    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="155e9b24-e8fb-4cb1-adf1-00c47764fafe" containerName="revoke-keys"
Jul 17 17:35:46.688205 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688168    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883ecd2b-e918-4e1c-acaf-e98717802ab7" containerName="revoke-keys"
Jul 17 17:35:46.688205 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688178    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="883ecd2b-e918-4e1c-acaf-e98717802ab7" containerName="revoke-keys"
Jul 17 17:35:46.688205 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688197    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="155e9b24-e8fb-4cb1-adf1-00c47764fafe" containerName="revoke-keys"
Jul 17 17:35:46.688205 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688204    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="155e9b24-e8fb-4cb1-adf1-00c47764fafe" containerName="revoke-keys"
Jul 17 17:35:46.688628 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688213    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883ecd2b-e918-4e1c-acaf-e98717802ab7" containerName="revoke-keys"
Jul 17 17:35:46.688628 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688221    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="883ecd2b-e918-4e1c-acaf-e98717802ab7" containerName="revoke-keys"
Jul 17 17:35:46.688628 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688236    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883ecd2b-e918-4e1c-acaf-e98717802ab7" containerName="revoke-keys"
Jul 17 17:35:46.688628 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688244    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="883ecd2b-e918-4e1c-acaf-e98717802ab7" containerName="revoke-keys"
Jul 17 17:35:46.688628 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688351    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="883ecd2b-e918-4e1c-acaf-e98717802ab7" containerName="revoke-keys"
Jul 17 17:35:46.688628 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688365    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="883ecd2b-e918-4e1c-acaf-e98717802ab7" containerName="revoke-keys"
Jul 17 17:35:46.688628 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688375    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="155e9b24-e8fb-4cb1-adf1-00c47764fafe" containerName="revoke-keys"
Jul 17 17:35:46.688628 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688385    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="155e9b24-e8fb-4cb1-adf1-00c47764fafe" containerName="revoke-keys"
Jul 17 17:35:46.688628 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688393    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="883ecd2b-e918-4e1c-acaf-e98717802ab7" containerName="revoke-keys"
Jul 17 17:35:46.688628 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.688404    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a921b5f-9c87-4e73-a6ec-3a2b73f225ea" containerName="revoke-keys"
Jul 17 17:35:46.691560 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.691543    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws"
Jul 17 17:35:46.693986 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.693963    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:35:46.694084 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.694049    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:35:46.697902 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.697876    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws"]
Jul 17 17:35:46.732585 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.732562    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws\" (UID: \"8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws"
Jul 17 17:35:46.833584 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.833556    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws\" (UID: \"8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws"
Jul 17 17:35:46.834200 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:46.834177    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws\" (UID: \"8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws"
Jul 17 17:35:47.004515 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:47.004423    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws"
Jul 17 17:35:47.138543 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:47.138520    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws"]
Jul 17 17:35:47.141182 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:35:47.141152    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a62ccf5_06d7_4216_a5c2_3f96a6be2d4d.slice/crio-1d2843e60ad185a42311c24e6ca2d942ad5974c7bef6a3083bf13a984921b95e WatchSource:0}: Error finding container 1d2843e60ad185a42311c24e6ca2d942ad5974c7bef6a3083bf13a984921b95e: Status 404 returned error can't find the container with id 1d2843e60ad185a42311c24e6ca2d942ad5974c7bef6a3083bf13a984921b95e
Jul 17 17:35:47.520056 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:47.520021    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws" event={"ID":"8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d","Type":"ContainerStarted","Data":"f7eba671e4be2b150a72b4538b19fda0e81d340ad43d2f8befeda4d470c340d2"}
Jul 17 17:35:47.520219 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:47.520112    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws" event={"ID":"8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d","Type":"ContainerStarted","Data":"1d2843e60ad185a42311c24e6ca2d942ad5974c7bef6a3083bf13a984921b95e"}
Jul 17 17:35:47.538070 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:47.538023    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws" podStartSLOduration=1.538008766 podStartE2EDuration="1.538008766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:35:47.535624182 +0000 UTC m=+4196.394752740" watchObservedRunningTime="2026-07-17 17:35:47.538008766 +0000 UTC m=+4196.397137338"
Jul 17 17:35:48.527997 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:48.527958    2566 generic.go:356] "Generic (PLEG): container finished" podID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d" containerID="f7eba671e4be2b150a72b4538b19fda0e81d340ad43d2f8befeda4d470c340d2" exitCode=7
Jul 17 17:35:48.528473 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:48.528054    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws" event={"ID":"8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d","Type":"ContainerDied","Data":"f7eba671e4be2b150a72b4538b19fda0e81d340ad43d2f8befeda4d470c340d2"}
Jul 17 17:35:48.528473 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:48.528265    2566 scope.go:117] "RemoveContainer" containerID="f7eba671e4be2b150a72b4538b19fda0e81d340ad43d2f8befeda4d470c340d2"
Jul 17 17:35:49.535705 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:49.535665    2566 generic.go:356] "Generic (PLEG): container finished" podID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d" containerID="49f8a3c448faea3ac4aaa13c773d11a8d1466fed37780c4d73ea7c3379d8ec2e" exitCode=7
Jul 17 17:35:49.536207 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:49.535788    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws" event={"ID":"8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d","Type":"ContainerDied","Data":"49f8a3c448faea3ac4aaa13c773d11a8d1466fed37780c4d73ea7c3379d8ec2e"}
Jul 17 17:35:49.536207 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:49.535844    2566 scope.go:117] "RemoveContainer" containerID="f7eba671e4be2b150a72b4538b19fda0e81d340ad43d2f8befeda4d470c340d2"
Jul 17 17:35:49.536207 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:49.536045    2566 scope.go:117] "RemoveContainer" containerID="49f8a3c448faea3ac4aaa13c773d11a8d1466fed37780c4d73ea7c3379d8ec2e"
Jul 17 17:35:49.536419 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:35:49.536266    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws_odh-ai-gateway-infra(8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws" podUID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d"
Jul 17 17:35:50.543183 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:50.543154    2566 scope.go:117] "RemoveContainer" containerID="49f8a3c448faea3ac4aaa13c773d11a8d1466fed37780c4d73ea7c3379d8ec2e"
Jul 17 17:35:50.543545 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:35:50.543417    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws_odh-ai-gateway-infra(8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws" podUID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d"
Jul 17 17:35:53.287230 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:53.287200    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:35:53.292061 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:53.292039    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:35:53.534694 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:35:53.534662    2566 scope.go:117] "RemoveContainer" containerID="c7702ae3af167456386d68c3f43bde9d64e56dccc7aeb44bf2100b4fe0c6f61e"
Jul 17 17:36:03.029240 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:03.029212    2566 scope.go:117] "RemoveContainer" containerID="49f8a3c448faea3ac4aaa13c773d11a8d1466fed37780c4d73ea7c3379d8ec2e"
Jul 17 17:36:03.623998 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:03.623966    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws" event={"ID":"8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d","Type":"ContainerStarted","Data":"119a01d1c7435e6a1a83899ab0d42f2034a86a45f7175d7a5ca8e928849275e0"}
Jul 17 17:36:03.624308 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:03.624291    2566 scope.go:117] "RemoveContainer" containerID="119a01d1c7435e6a1a83899ab0d42f2034a86a45f7175d7a5ca8e928849275e0"
Jul 17 17:36:03.624545 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:36:03.624527    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws_odh-ai-gateway-infra(8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws" podUID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d"
Jul 17 17:36:04.631170 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:04.631133    2566 generic.go:356] "Generic (PLEG): container finished" podID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d" containerID="119a01d1c7435e6a1a83899ab0d42f2034a86a45f7175d7a5ca8e928849275e0" exitCode=7
Jul 17 17:36:04.631628 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:04.631179    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws" event={"ID":"8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d","Type":"ContainerDied","Data":"119a01d1c7435e6a1a83899ab0d42f2034a86a45f7175d7a5ca8e928849275e0"}
Jul 17 17:36:04.631628 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:04.631228    2566 scope.go:117] "RemoveContainer" containerID="49f8a3c448faea3ac4aaa13c773d11a8d1466fed37780c4d73ea7c3379d8ec2e"
Jul 17 17:36:04.631628 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:04.631531    2566 scope.go:117] "RemoveContainer" containerID="119a01d1c7435e6a1a83899ab0d42f2034a86a45f7175d7a5ca8e928849275e0"
Jul 17 17:36:04.631806 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:36:04.631782    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws_odh-ai-gateway-infra(8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws" podUID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d"
Jul 17 17:36:04.656639 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:04.656610    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws"]
Jul 17 17:36:05.781221 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:05.781189    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws"
Jul 17 17:36:05.908722 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:05.908639    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d-maas-api-service-ca\") pod \"8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d\" (UID: \"8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d\") "
Jul 17 17:36:05.908973 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:05.908951    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d" (UID: "8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:36:06.009928 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.009897    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:36:06.252098 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.252021    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq"]
Jul 17 17:36:06.252421 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.252408    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d" containerName="revoke-keys"
Jul 17 17:36:06.252470 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.252423    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d" containerName="revoke-keys"
Jul 17 17:36:06.252470 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.252441    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d" containerName="revoke-keys"
Jul 17 17:36:06.252470 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.252447    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d" containerName="revoke-keys"
Jul 17 17:36:06.252470 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.252455    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="155e9b24-e8fb-4cb1-adf1-00c47764fafe" containerName="revoke-keys"
Jul 17 17:36:06.252470 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.252461    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="155e9b24-e8fb-4cb1-adf1-00c47764fafe" containerName="revoke-keys"
Jul 17 17:36:06.252621 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.252475    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d" containerName="revoke-keys"
Jul 17 17:36:06.252621 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.252480    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d" containerName="revoke-keys"
Jul 17 17:36:06.252621 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.252549    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d" containerName="revoke-keys"
Jul 17 17:36:06.252621 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.252560    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="155e9b24-e8fb-4cb1-adf1-00c47764fafe" containerName="revoke-keys"
Jul 17 17:36:06.252621 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.252569    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d" containerName="revoke-keys"
Jul 17 17:36:06.255618 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.255602    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq"
Jul 17 17:36:06.262699 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.262523    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq"]
Jul 17 17:36:06.413767 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.413734    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c92e529-3205-4200-9ce8-f52364fe0a4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-6ddhq\" (UID: \"1c92e529-3205-4200-9ce8-f52364fe0a4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq"
Jul 17 17:36:06.515140 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.515051    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c92e529-3205-4200-9ce8-f52364fe0a4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-6ddhq\" (UID: \"1c92e529-3205-4200-9ce8-f52364fe0a4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq"
Jul 17 17:36:06.515666 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.515647    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c92e529-3205-4200-9ce8-f52364fe0a4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-6ddhq\" (UID: \"1c92e529-3205-4200-9ce8-f52364fe0a4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq"
Jul 17 17:36:06.567693 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.567668    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq"
Jul 17 17:36:06.647133 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.647101    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws" event={"ID":"8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d","Type":"ContainerDied","Data":"1d2843e60ad185a42311c24e6ca2d942ad5974c7bef6a3083bf13a984921b95e"}
Jul 17 17:36:06.647308 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.647160    2566 scope.go:117] "RemoveContainer" containerID="119a01d1c7435e6a1a83899ab0d42f2034a86a45f7175d7a5ca8e928849275e0"
Jul 17 17:36:06.647308 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.647223    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws"
Jul 17 17:36:06.675015 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.674992    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws"]
Jul 17 17:36:06.678534 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.678510    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-f6qws"]
Jul 17 17:36:06.705428 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:06.705381    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq"]
Jul 17 17:36:06.707782 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:36:06.707756    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c92e529_3205_4200_9ce8_f52364fe0a4c.slice/crio-2ce765daa69f14d12621da0ab7f49d7c4e96eae6cc0f09a3e78a5b8f087af5e3 WatchSource:0}: Error finding container 2ce765daa69f14d12621da0ab7f49d7c4e96eae6cc0f09a3e78a5b8f087af5e3: Status 404 returned error can't find the container with id 2ce765daa69f14d12621da0ab7f49d7c4e96eae6cc0f09a3e78a5b8f087af5e3
Jul 17 17:36:07.031661 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:07.031635    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d" path="/var/lib/kubelet/pods/8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d/volumes"
Jul 17 17:36:07.655130 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:07.655047    2566 generic.go:356] "Generic (PLEG): container finished" podID="1c92e529-3205-4200-9ce8-f52364fe0a4c" containerID="90b923ac8b1af5d86b2f5b5ccbd6b59d552bcc3f29fbfb8bbc6a43c3cc64645d" exitCode=7
Jul 17 17:36:07.655270 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:07.655129    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq" event={"ID":"1c92e529-3205-4200-9ce8-f52364fe0a4c","Type":"ContainerDied","Data":"90b923ac8b1af5d86b2f5b5ccbd6b59d552bcc3f29fbfb8bbc6a43c3cc64645d"}
Jul 17 17:36:07.655270 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:07.655178    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq" event={"ID":"1c92e529-3205-4200-9ce8-f52364fe0a4c","Type":"ContainerStarted","Data":"2ce765daa69f14d12621da0ab7f49d7c4e96eae6cc0f09a3e78a5b8f087af5e3"}
Jul 17 17:36:07.655386 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:07.655286    2566 scope.go:117] "RemoveContainer" containerID="90b923ac8b1af5d86b2f5b5ccbd6b59d552bcc3f29fbfb8bbc6a43c3cc64645d"
Jul 17 17:36:08.661937 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:08.661906    2566 generic.go:356] "Generic (PLEG): container finished" podID="1c92e529-3205-4200-9ce8-f52364fe0a4c" containerID="10ba7f4da2d2161fab91d0c6fdfe654e76d082731ac59925c765b6c0bd3315ef" exitCode=7
Jul 17 17:36:08.662386 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:08.661945    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq" event={"ID":"1c92e529-3205-4200-9ce8-f52364fe0a4c","Type":"ContainerDied","Data":"10ba7f4da2d2161fab91d0c6fdfe654e76d082731ac59925c765b6c0bd3315ef"}
Jul 17 17:36:08.662386 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:08.662016    2566 scope.go:117] "RemoveContainer" containerID="90b923ac8b1af5d86b2f5b5ccbd6b59d552bcc3f29fbfb8bbc6a43c3cc64645d"
Jul 17 17:36:08.662386 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:08.662182    2566 scope.go:117] "RemoveContainer" containerID="10ba7f4da2d2161fab91d0c6fdfe654e76d082731ac59925c765b6c0bd3315ef"
Jul 17 17:36:08.662545 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:36:08.662448    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-6ddhq_odh-ai-gateway-infra(1c92e529-3205-4200-9ce8-f52364fe0a4c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq" podUID="1c92e529-3205-4200-9ce8-f52364fe0a4c"
Jul 17 17:36:09.668674 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:09.668648    2566 scope.go:117] "RemoveContainer" containerID="10ba7f4da2d2161fab91d0c6fdfe654e76d082731ac59925c765b6c0bd3315ef"
Jul 17 17:36:09.669061 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:36:09.668863    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-6ddhq_odh-ai-gateway-infra(1c92e529-3205-4200-9ce8-f52364fe0a4c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq" podUID="1c92e529-3205-4200-9ce8-f52364fe0a4c"
Jul 17 17:36:11.662591 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:11.662558    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh"]
Jul 17 17:36:11.663091 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:11.663075    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a62ccf5-06d7-4216-a5c2-3f96a6be2d4d" containerName="revoke-keys"
Jul 17 17:36:11.666314 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:11.666298    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh"
Jul 17 17:36:11.671940 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:11.671915    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh"]
Jul 17 17:36:11.763936 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:11.763905    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f956fc-5270-4cbb-8d79-212cdd13889c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh\" (UID: \"a4f956fc-5270-4cbb-8d79-212cdd13889c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh"
Jul 17 17:36:11.864743 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:11.864704    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f956fc-5270-4cbb-8d79-212cdd13889c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh\" (UID: \"a4f956fc-5270-4cbb-8d79-212cdd13889c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh"
Jul 17 17:36:11.865351 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:11.865334    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f956fc-5270-4cbb-8d79-212cdd13889c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh\" (UID: \"a4f956fc-5270-4cbb-8d79-212cdd13889c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh"
Jul 17 17:36:11.979654 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:11.979563    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh"
Jul 17 17:36:12.322911 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:12.322886    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh"]
Jul 17 17:36:12.324541 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:36:12.324516    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f956fc_5270_4cbb_8d79_212cdd13889c.slice/crio-f5df77bb7ff7b8c6950c06ede95a112e10dc06789af19f661d1a1b19015b4bca WatchSource:0}: Error finding container f5df77bb7ff7b8c6950c06ede95a112e10dc06789af19f661d1a1b19015b4bca: Status 404 returned error can't find the container with id f5df77bb7ff7b8c6950c06ede95a112e10dc06789af19f661d1a1b19015b4bca
Jul 17 17:36:12.688361 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:12.688308    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh" event={"ID":"a4f956fc-5270-4cbb-8d79-212cdd13889c","Type":"ContainerStarted","Data":"097d2de84b7ddd93bf9b046f29bdc2388673c4fbcaa6ce4b64ce9a8905b4ab08"}
Jul 17 17:36:12.688731 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:12.688390    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh" event={"ID":"a4f956fc-5270-4cbb-8d79-212cdd13889c","Type":"ContainerStarted","Data":"f5df77bb7ff7b8c6950c06ede95a112e10dc06789af19f661d1a1b19015b4bca"}
Jul 17 17:36:12.703783 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:12.703722    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh" podStartSLOduration=1.7037013810000001 podStartE2EDuration="1.703701381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:36:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:36:12.702394026 +0000 UTC m=+4221.561522583" watchObservedRunningTime="2026-07-17 17:36:12.703701381 +0000 UTC m=+4221.562829941"
Jul 17 17:36:13.695449 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:13.695369    2566 generic.go:356] "Generic (PLEG): container finished" podID="a4f956fc-5270-4cbb-8d79-212cdd13889c" containerID="097d2de84b7ddd93bf9b046f29bdc2388673c4fbcaa6ce4b64ce9a8905b4ab08" exitCode=7
Jul 17 17:36:13.695449 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:13.695410    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh" event={"ID":"a4f956fc-5270-4cbb-8d79-212cdd13889c","Type":"ContainerDied","Data":"097d2de84b7ddd93bf9b046f29bdc2388673c4fbcaa6ce4b64ce9a8905b4ab08"}
Jul 17 17:36:13.695851 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:13.695595    2566 scope.go:117] "RemoveContainer" containerID="097d2de84b7ddd93bf9b046f29bdc2388673c4fbcaa6ce4b64ce9a8905b4ab08"
Jul 17 17:36:14.703162 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:14.703070    2566 generic.go:356] "Generic (PLEG): container finished" podID="a4f956fc-5270-4cbb-8d79-212cdd13889c" containerID="e2a37e7a5db530cf52031e15c2764563bb8acdebebe25e2e73eca8e67d465791" exitCode=7
Jul 17 17:36:14.703162 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:14.703136    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh" event={"ID":"a4f956fc-5270-4cbb-8d79-212cdd13889c","Type":"ContainerDied","Data":"e2a37e7a5db530cf52031e15c2764563bb8acdebebe25e2e73eca8e67d465791"}
Jul 17 17:36:14.703688 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:14.703182    2566 scope.go:117] "RemoveContainer" containerID="097d2de84b7ddd93bf9b046f29bdc2388673c4fbcaa6ce4b64ce9a8905b4ab08"
Jul 17 17:36:14.703688 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:14.703416    2566 scope.go:117] "RemoveContainer" containerID="e2a37e7a5db530cf52031e15c2764563bb8acdebebe25e2e73eca8e67d465791"
Jul 17 17:36:14.703688 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:36:14.703625    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh_odh-ai-gateway-infra(a4f956fc-5270-4cbb-8d79-212cdd13889c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh" podUID="a4f956fc-5270-4cbb-8d79-212cdd13889c"
Jul 17 17:36:15.711653 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:15.711623    2566 scope.go:117] "RemoveContainer" containerID="e2a37e7a5db530cf52031e15c2764563bb8acdebebe25e2e73eca8e67d465791"
Jul 17 17:36:15.712092 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:36:15.711834    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh_odh-ai-gateway-infra(a4f956fc-5270-4cbb-8d79-212cdd13889c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh" podUID="a4f956fc-5270-4cbb-8d79-212cdd13889c"
Jul 17 17:36:24.026575 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:24.026546    2566 scope.go:117] "RemoveContainer" containerID="10ba7f4da2d2161fab91d0c6fdfe654e76d082731ac59925c765b6c0bd3315ef"
Jul 17 17:36:24.764938 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:24.764902    2566 generic.go:356] "Generic (PLEG): container finished" podID="1c92e529-3205-4200-9ce8-f52364fe0a4c" containerID="65ee781393c5a288f31af0d1e9397b539e393332a7ad5e56a07edfb9a1a16ecb" exitCode=7
Jul 17 17:36:24.765087 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:24.764975    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq" event={"ID":"1c92e529-3205-4200-9ce8-f52364fe0a4c","Type":"ContainerDied","Data":"65ee781393c5a288f31af0d1e9397b539e393332a7ad5e56a07edfb9a1a16ecb"}
Jul 17 17:36:24.765087 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:24.765036    2566 scope.go:117] "RemoveContainer" containerID="10ba7f4da2d2161fab91d0c6fdfe654e76d082731ac59925c765b6c0bd3315ef"
Jul 17 17:36:24.765311 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:24.765294    2566 scope.go:117] "RemoveContainer" containerID="65ee781393c5a288f31af0d1e9397b539e393332a7ad5e56a07edfb9a1a16ecb"
Jul 17 17:36:24.765582 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:36:24.765558    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-6ddhq_odh-ai-gateway-infra(1c92e529-3205-4200-9ce8-f52364fe0a4c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq" podUID="1c92e529-3205-4200-9ce8-f52364fe0a4c"
Jul 17 17:36:25.789670 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:25.789638    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq"]
Jul 17 17:36:25.926285 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:25.926256    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq"
Jul 17 17:36:25.997931 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:25.997904    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c92e529-3205-4200-9ce8-f52364fe0a4c-maas-api-service-ca\") pod \"1c92e529-3205-4200-9ce8-f52364fe0a4c\" (UID: \"1c92e529-3205-4200-9ce8-f52364fe0a4c\") "
Jul 17 17:36:25.998223 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:25.998202    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c92e529-3205-4200-9ce8-f52364fe0a4c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1c92e529-3205-4200-9ce8-f52364fe0a4c" (UID: "1c92e529-3205-4200-9ce8-f52364fe0a4c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:36:26.099828 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:26.099745    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c92e529-3205-4200-9ce8-f52364fe0a4c-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:36:26.780421 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:26.780388    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq" event={"ID":"1c92e529-3205-4200-9ce8-f52364fe0a4c","Type":"ContainerDied","Data":"2ce765daa69f14d12621da0ab7f49d7c4e96eae6cc0f09a3e78a5b8f087af5e3"}
Jul 17 17:36:26.780421 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:26.780410    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq"
Jul 17 17:36:26.780692 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:26.780458    2566 scope.go:117] "RemoveContainer" containerID="65ee781393c5a288f31af0d1e9397b539e393332a7ad5e56a07edfb9a1a16ecb"
Jul 17 17:36:26.803025 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:26.802998    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq"]
Jul 17 17:36:26.808874 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:26.808853    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-6ddhq"]
Jul 17 17:36:27.032679 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:27.032602    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c92e529-3205-4200-9ce8-f52364fe0a4c" path="/var/lib/kubelet/pods/1c92e529-3205-4200-9ce8-f52364fe0a4c/volumes"
Jul 17 17:36:30.026109 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:30.026079    2566 scope.go:117] "RemoveContainer" containerID="e2a37e7a5db530cf52031e15c2764563bb8acdebebe25e2e73eca8e67d465791"
Jul 17 17:36:30.806490 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:30.806460    2566 generic.go:356] "Generic (PLEG): container finished" podID="a4f956fc-5270-4cbb-8d79-212cdd13889c" containerID="eea7fc0538f014be7ea1cbf10e52cc1a1c3ab9d2347e795f7445048310c1731a" exitCode=7
Jul 17 17:36:30.806666 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:30.806538    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh" event={"ID":"a4f956fc-5270-4cbb-8d79-212cdd13889c","Type":"ContainerDied","Data":"eea7fc0538f014be7ea1cbf10e52cc1a1c3ab9d2347e795f7445048310c1731a"}
Jul 17 17:36:30.806666 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:30.806598    2566 scope.go:117] "RemoveContainer" containerID="e2a37e7a5db530cf52031e15c2764563bb8acdebebe25e2e73eca8e67d465791"
Jul 17 17:36:30.806964 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:30.806947    2566 scope.go:117] "RemoveContainer" containerID="eea7fc0538f014be7ea1cbf10e52cc1a1c3ab9d2347e795f7445048310c1731a"
Jul 17 17:36:30.807180 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:36:30.807161    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh_odh-ai-gateway-infra(a4f956fc-5270-4cbb-8d79-212cdd13889c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh" podUID="a4f956fc-5270-4cbb-8d79-212cdd13889c"
Jul 17 17:36:31.832502 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:31.832464    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh"]
Jul 17 17:36:31.968816 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:31.968795    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh"
Jul 17 17:36:32.054782 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.054755    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f956fc-5270-4cbb-8d79-212cdd13889c-maas-api-service-ca\") pod \"a4f956fc-5270-4cbb-8d79-212cdd13889c\" (UID: \"a4f956fc-5270-4cbb-8d79-212cdd13889c\") "
Jul 17 17:36:32.055119 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.055099    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4f956fc-5270-4cbb-8d79-212cdd13889c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4f956fc-5270-4cbb-8d79-212cdd13889c" (UID: "a4f956fc-5270-4cbb-8d79-212cdd13889c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:36:32.155613 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.155542    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f956fc-5270-4cbb-8d79-212cdd13889c-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:36:32.602897 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.602858    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"]
Jul 17 17:36:32.603307 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603293    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f956fc-5270-4cbb-8d79-212cdd13889c" containerName="revoke-keys"
Jul 17 17:36:32.603379 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603309    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f956fc-5270-4cbb-8d79-212cdd13889c" containerName="revoke-keys"
Jul 17 17:36:32.603379 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603336    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c92e529-3205-4200-9ce8-f52364fe0a4c" containerName="revoke-keys"
Jul 17 17:36:32.603379 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603345    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c92e529-3205-4200-9ce8-f52364fe0a4c" containerName="revoke-keys"
Jul 17 17:36:32.603379 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603358    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c92e529-3205-4200-9ce8-f52364fe0a4c" containerName="revoke-keys"
Jul 17 17:36:32.603379 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603367    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c92e529-3205-4200-9ce8-f52364fe0a4c" containerName="revoke-keys"
Jul 17 17:36:32.603379 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603378    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f956fc-5270-4cbb-8d79-212cdd13889c" containerName="revoke-keys"
Jul 17 17:36:32.603379 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603384    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f956fc-5270-4cbb-8d79-212cdd13889c" containerName="revoke-keys"
Jul 17 17:36:32.603617 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603408    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f956fc-5270-4cbb-8d79-212cdd13889c" containerName="revoke-keys"
Jul 17 17:36:32.603617 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603414    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f956fc-5270-4cbb-8d79-212cdd13889c" containerName="revoke-keys"
Jul 17 17:36:32.603617 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603486    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c92e529-3205-4200-9ce8-f52364fe0a4c" containerName="revoke-keys"
Jul 17 17:36:32.603617 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603493    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c92e529-3205-4200-9ce8-f52364fe0a4c" containerName="revoke-keys"
Jul 17 17:36:32.603617 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603499    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f956fc-5270-4cbb-8d79-212cdd13889c" containerName="revoke-keys"
Jul 17 17:36:32.603617 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603505    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f956fc-5270-4cbb-8d79-212cdd13889c" containerName="revoke-keys"
Jul 17 17:36:32.603617 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.603510    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f956fc-5270-4cbb-8d79-212cdd13889c" containerName="revoke-keys"
Jul 17 17:36:32.606595 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.606578    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.609710 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.609685    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3d4103\"/\"default-dockercfg-plhjz\""
Jul 17 17:36:32.609710 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.609707    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3d4103\"/\"kube-root-ca.crt\""
Jul 17 17:36:32.609870 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.609778    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3d4103\"/\"openshift-service-ca.crt\""
Jul 17 17:36:32.609870 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.609814    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3d4103\"/\"rate-test-model-3d4103-kserve-self-signed-certs\""
Jul 17 17:36:32.615081 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.615036    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"]
Jul 17 17:36:32.660217 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.660193    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-home\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.660351 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.660242    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-tmp-dir\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.660351 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.660271    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drh8n\" (UniqueName: \"kubernetes.io/projected/ae2864d0-f60e-460b-9511-210a7eb26187-kube-api-access-drh8n\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.660351 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.660306    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2864d0-f60e-460b-9511-210a7eb26187-tls-certs\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.660525 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.660396    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-model-cache\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.660525 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.660441    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-dshm\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.760869 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.760843    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-tmp-dir\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.760969 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.760880    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drh8n\" (UniqueName: \"kubernetes.io/projected/ae2864d0-f60e-460b-9511-210a7eb26187-kube-api-access-drh8n\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.760969 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.760928    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2864d0-f60e-460b-9511-210a7eb26187-tls-certs\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.760969 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.760959    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-model-cache\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.761070 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.760990    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-dshm\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.761070 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.761027    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-home\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.761360 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.761310    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-tmp-dir\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.761459 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.761339    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-model-cache\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.761459 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.761414    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-home\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.763331 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.763291    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-dshm\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.763439 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.763422    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2864d0-f60e-460b-9511-210a7eb26187-tls-certs\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.767899 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.767873    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drh8n\" (UniqueName: \"kubernetes.io/projected/ae2864d0-f60e-460b-9511-210a7eb26187-kube-api-access-drh8n\") pod \"rate-test-model-3d4103-kserve-5496cdf9f5-nwj66\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") " pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:32.820567 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.820543    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh" event={"ID":"a4f956fc-5270-4cbb-8d79-212cdd13889c","Type":"ContainerDied","Data":"f5df77bb7ff7b8c6950c06ede95a112e10dc06789af19f661d1a1b19015b4bca"}
Jul 17 17:36:32.820669 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.820579    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh"
Jul 17 17:36:32.820669 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.820595    2566 scope.go:117] "RemoveContainer" containerID="eea7fc0538f014be7ea1cbf10e52cc1a1c3ab9d2347e795f7445048310c1731a"
Jul 17 17:36:32.845151 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.845128    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh"]
Jul 17 17:36:32.850963 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.850940    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6vmmh"]
Jul 17 17:36:32.916908 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:32.916814    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:33.033746 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:33.033717    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4f956fc-5270-4cbb-8d79-212cdd13889c" path="/var/lib/kubelet/pods/a4f956fc-5270-4cbb-8d79-212cdd13889c/volumes"
Jul 17 17:36:33.051859 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:33.051840    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"]
Jul 17 17:36:33.053986 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:36:33.053961    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae2864d0_f60e_460b_9511_210a7eb26187.slice/crio-e2a07e7d5d51d7c5e0acfd08d07e60cba527ef94723296ddc252020b6b9831f7 WatchSource:0}: Error finding container e2a07e7d5d51d7c5e0acfd08d07e60cba527ef94723296ddc252020b6b9831f7: Status 404 returned error can't find the container with id e2a07e7d5d51d7c5e0acfd08d07e60cba527ef94723296ddc252020b6b9831f7
Jul 17 17:36:33.828531 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:33.828496    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66" event={"ID":"ae2864d0-f60e-460b-9511-210a7eb26187","Type":"ContainerStarted","Data":"330c2913dcdf1fd9aa63ab5cdcf86d731d96c30372cc5d287ac65047c5931436"}
Jul 17 17:36:33.828701 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:33.828536    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66" event={"ID":"ae2864d0-f60e-460b-9511-210a7eb26187","Type":"ContainerStarted","Data":"e2a07e7d5d51d7c5e0acfd08d07e60cba527ef94723296ddc252020b6b9831f7"}
Jul 17 17:36:33.846148 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:33.846105    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66" podStartSLOduration=1.8460901330000001 podStartE2EDuration="1.846090133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:36:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:36:33.844561151 +0000 UTC m=+4242.703689745" watchObservedRunningTime="2026-07-17 17:36:33.846090133 +0000 UTC m=+4242.705218688"
Jul 17 17:36:42.917700 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:42.917669    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:42.918158 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:42.917736    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:42.930031 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:42.930013    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:36:43.908167 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:36:43.908140    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:37:50.293926 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:37:50.293848    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"]
Jul 17 17:37:53.585750 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:37:53.585713    2566 scope.go:117] "RemoveContainer" containerID="796af2034edad43258dda770340b4918ab1b8426f0c0d9cb68be335ff24dd919"
Jul 17 17:38:05.314518 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.314471    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66" podUID="ae2864d0-f60e-460b-9511-210a7eb26187" containerName="main" containerID="cri-o://330c2913dcdf1fd9aa63ab5cdcf86d731d96c30372cc5d287ac65047c5931436" gracePeriod=45
Jul 17 17:38:05.580983 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.580918    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:38:05.729513 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.729476    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2864d0-f60e-460b-9511-210a7eb26187-tls-certs\") pod \"ae2864d0-f60e-460b-9511-210a7eb26187\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") "
Jul 17 17:38:05.729728 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.729535    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-tmp-dir\") pod \"ae2864d0-f60e-460b-9511-210a7eb26187\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") "
Jul 17 17:38:05.729728 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.729581    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drh8n\" (UniqueName: \"kubernetes.io/projected/ae2864d0-f60e-460b-9511-210a7eb26187-kube-api-access-drh8n\") pod \"ae2864d0-f60e-460b-9511-210a7eb26187\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") "
Jul 17 17:38:05.729728 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.729639    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-model-cache\") pod \"ae2864d0-f60e-460b-9511-210a7eb26187\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") "
Jul 17 17:38:05.729728 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.729681    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-home\") pod \"ae2864d0-f60e-460b-9511-210a7eb26187\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") "
Jul 17 17:38:05.729728 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.729706    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-dshm\") pod \"ae2864d0-f60e-460b-9511-210a7eb26187\" (UID: \"ae2864d0-f60e-460b-9511-210a7eb26187\") "
Jul 17 17:38:05.730012 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.729793    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ae2864d0-f60e-460b-9511-210a7eb26187" (UID: "ae2864d0-f60e-460b-9511-210a7eb26187"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:38:05.730012 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.729915    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-model-cache" (OuterVolumeSpecName: "model-cache") pod "ae2864d0-f60e-460b-9511-210a7eb26187" (UID: "ae2864d0-f60e-460b-9511-210a7eb26187"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:38:05.730012 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.729932    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-home" (OuterVolumeSpecName: "home") pod "ae2864d0-f60e-460b-9511-210a7eb26187" (UID: "ae2864d0-f60e-460b-9511-210a7eb26187"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:38:05.730152 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.730076    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-model-cache\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:05.730152 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.730094    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-home\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:05.730152 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.730107    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-tmp-dir\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:05.731903 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.731878    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae2864d0-f60e-460b-9511-210a7eb26187-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ae2864d0-f60e-460b-9511-210a7eb26187" (UID: "ae2864d0-f60e-460b-9511-210a7eb26187"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 17:38:05.731903 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.731887    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-dshm" (OuterVolumeSpecName: "dshm") pod "ae2864d0-f60e-460b-9511-210a7eb26187" (UID: "ae2864d0-f60e-460b-9511-210a7eb26187"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:38:05.732037 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.731920    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae2864d0-f60e-460b-9511-210a7eb26187-kube-api-access-drh8n" (OuterVolumeSpecName: "kube-api-access-drh8n") pod "ae2864d0-f60e-460b-9511-210a7eb26187" (UID: "ae2864d0-f60e-460b-9511-210a7eb26187"). InnerVolumeSpecName "kube-api-access-drh8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:38:05.830895 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.830841    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drh8n\" (UniqueName: \"kubernetes.io/projected/ae2864d0-f60e-460b-9511-210a7eb26187-kube-api-access-drh8n\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:05.830895 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.830888    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae2864d0-f60e-460b-9511-210a7eb26187-dshm\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:05.830895 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:05.830905    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2864d0-f60e-460b-9511-210a7eb26187-tls-certs\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:06.345062 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.345022    2566 generic.go:356] "Generic (PLEG): container finished" podID="ae2864d0-f60e-460b-9511-210a7eb26187" containerID="330c2913dcdf1fd9aa63ab5cdcf86d731d96c30372cc5d287ac65047c5931436" exitCode=0
Jul 17 17:38:06.345062 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.345058    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"
Jul 17 17:38:06.345592 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.345116    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66" event={"ID":"ae2864d0-f60e-460b-9511-210a7eb26187","Type":"ContainerDied","Data":"330c2913dcdf1fd9aa63ab5cdcf86d731d96c30372cc5d287ac65047c5931436"}
Jul 17 17:38:06.345592 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.345177    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66" event={"ID":"ae2864d0-f60e-460b-9511-210a7eb26187","Type":"ContainerDied","Data":"e2a07e7d5d51d7c5e0acfd08d07e60cba527ef94723296ddc252020b6b9831f7"}
Jul 17 17:38:06.345592 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.345214    2566 scope.go:117] "RemoveContainer" containerID="330c2913dcdf1fd9aa63ab5cdcf86d731d96c30372cc5d287ac65047c5931436"
Jul 17 17:38:06.354908 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.354890    2566 scope.go:117] "RemoveContainer" containerID="330c2913dcdf1fd9aa63ab5cdcf86d731d96c30372cc5d287ac65047c5931436"
Jul 17 17:38:06.355192 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:38:06.355174    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"330c2913dcdf1fd9aa63ab5cdcf86d731d96c30372cc5d287ac65047c5931436\": container with ID starting with 330c2913dcdf1fd9aa63ab5cdcf86d731d96c30372cc5d287ac65047c5931436 not found: ID does not exist" containerID="330c2913dcdf1fd9aa63ab5cdcf86d731d96c30372cc5d287ac65047c5931436"
Jul 17 17:38:06.355267 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.355201    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"330c2913dcdf1fd9aa63ab5cdcf86d731d96c30372cc5d287ac65047c5931436"} err="failed to get container status \"330c2913dcdf1fd9aa63ab5cdcf86d731d96c30372cc5d287ac65047c5931436\": rpc error: code = NotFound desc = could not find container \"330c2913dcdf1fd9aa63ab5cdcf86d731d96c30372cc5d287ac65047c5931436\": container with ID starting with 330c2913dcdf1fd9aa63ab5cdcf86d731d96c30372cc5d287ac65047c5931436 not found: ID does not exist"
Jul 17 17:38:06.370838 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.370809    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"]
Jul 17 17:38:06.374170 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.374147    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx"]
Jul 17 17:38:06.374591 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.374576    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c92e529-3205-4200-9ce8-f52364fe0a4c" containerName="revoke-keys"
Jul 17 17:38:06.374591 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.374591    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c92e529-3205-4200-9ce8-f52364fe0a4c" containerName="revoke-keys"
Jul 17 17:38:06.374725 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.374603    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae2864d0-f60e-460b-9511-210a7eb26187" containerName="main"
Jul 17 17:38:06.374725 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.374610    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae2864d0-f60e-460b-9511-210a7eb26187" containerName="main"
Jul 17 17:38:06.374725 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.374694    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae2864d0-f60e-460b-9511-210a7eb26187" containerName="main"
Jul 17 17:38:06.374725 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.374706    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c92e529-3205-4200-9ce8-f52364fe0a4c" containerName="revoke-keys"
Jul 17 17:38:06.379230 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.379210    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx"
Jul 17 17:38:06.379845 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.379827    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3d4103/rate-test-model-3d4103-kserve-5496cdf9f5-nwj66"]
Jul 17 17:38:06.381545 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.381530    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:38:06.381618 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.381572    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:38:06.386418 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.386387    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx"]
Jul 17 17:38:06.536574 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.536541    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11be2111-7e22-4651-8067-cc76c4a53af0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-r69rx\" (UID: \"11be2111-7e22-4651-8067-cc76c4a53af0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx"
Jul 17 17:38:06.637857 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.637764    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11be2111-7e22-4651-8067-cc76c4a53af0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-r69rx\" (UID: \"11be2111-7e22-4651-8067-cc76c4a53af0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx"
Jul 17 17:38:06.638396 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.638374    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11be2111-7e22-4651-8067-cc76c4a53af0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-r69rx\" (UID: \"11be2111-7e22-4651-8067-cc76c4a53af0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx"
Jul 17 17:38:06.690555 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.690518    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx"
Jul 17 17:38:06.827922 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:06.827893    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx"]
Jul 17 17:38:06.830028 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:38:06.829995    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11be2111_7e22_4651_8067_cc76c4a53af0.slice/crio-d6f46438785fd556d31aec8a564b99cf80de2d774bb314fac997286a55e6b37d WatchSource:0}: Error finding container d6f46438785fd556d31aec8a564b99cf80de2d774bb314fac997286a55e6b37d: Status 404 returned error can't find the container with id d6f46438785fd556d31aec8a564b99cf80de2d774bb314fac997286a55e6b37d
Jul 17 17:38:07.032592 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:07.032559    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae2864d0-f60e-460b-9511-210a7eb26187" path="/var/lib/kubelet/pods/ae2864d0-f60e-460b-9511-210a7eb26187/volumes"
Jul 17 17:38:07.351717 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:07.351683    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx" event={"ID":"11be2111-7e22-4651-8067-cc76c4a53af0","Type":"ContainerStarted","Data":"1a0bcdb8437e0f1b73b2c14a3633613998b3a8141074b8e4c74362f297aaebb4"}
Jul 17 17:38:07.352201 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:07.351734    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx" event={"ID":"11be2111-7e22-4651-8067-cc76c4a53af0","Type":"ContainerStarted","Data":"d6f46438785fd556d31aec8a564b99cf80de2d774bb314fac997286a55e6b37d"}
Jul 17 17:38:07.369185 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:07.369104    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx" podStartSLOduration=1.369085712 podStartE2EDuration="1.369085712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:38:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:38:07.36769269 +0000 UTC m=+4336.226821248" watchObservedRunningTime="2026-07-17 17:38:07.369085712 +0000 UTC m=+4336.228214309"
Jul 17 17:38:08.359130 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:08.359096    2566 generic.go:356] "Generic (PLEG): container finished" podID="11be2111-7e22-4651-8067-cc76c4a53af0" containerID="1a0bcdb8437e0f1b73b2c14a3633613998b3a8141074b8e4c74362f297aaebb4" exitCode=7
Jul 17 17:38:08.359588 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:08.359182    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx" event={"ID":"11be2111-7e22-4651-8067-cc76c4a53af0","Type":"ContainerDied","Data":"1a0bcdb8437e0f1b73b2c14a3633613998b3a8141074b8e4c74362f297aaebb4"}
Jul 17 17:38:08.359588 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:08.359365    2566 scope.go:117] "RemoveContainer" containerID="1a0bcdb8437e0f1b73b2c14a3633613998b3a8141074b8e4c74362f297aaebb4"
Jul 17 17:38:09.366841 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:09.366805    2566 generic.go:356] "Generic (PLEG): container finished" podID="11be2111-7e22-4651-8067-cc76c4a53af0" containerID="04384df0569f81b734fcbe4b1b7b68dfa56bbf416fa0cdae312243625716dcc1" exitCode=7
Jul 17 17:38:09.367243 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:09.366891    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx" event={"ID":"11be2111-7e22-4651-8067-cc76c4a53af0","Type":"ContainerDied","Data":"04384df0569f81b734fcbe4b1b7b68dfa56bbf416fa0cdae312243625716dcc1"}
Jul 17 17:38:09.367243 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:09.366948    2566 scope.go:117] "RemoveContainer" containerID="1a0bcdb8437e0f1b73b2c14a3633613998b3a8141074b8e4c74362f297aaebb4"
Jul 17 17:38:09.367243 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:09.367161    2566 scope.go:117] "RemoveContainer" containerID="04384df0569f81b734fcbe4b1b7b68dfa56bbf416fa0cdae312243625716dcc1"
Jul 17 17:38:09.367457 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:38:09.367436    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-r69rx_odh-ai-gateway-infra(11be2111-7e22-4651-8067-cc76c4a53af0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx" podUID="11be2111-7e22-4651-8067-cc76c4a53af0"
Jul 17 17:38:10.373463 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:10.373434    2566 scope.go:117] "RemoveContainer" containerID="04384df0569f81b734fcbe4b1b7b68dfa56bbf416fa0cdae312243625716dcc1"
Jul 17 17:38:10.373841 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:38:10.373652    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-r69rx_odh-ai-gateway-infra(11be2111-7e22-4651-8067-cc76c4a53af0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx" podUID="11be2111-7e22-4651-8067-cc76c4a53af0"
Jul 17 17:38:26.026678 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:26.026647    2566 scope.go:117] "RemoveContainer" containerID="04384df0569f81b734fcbe4b1b7b68dfa56bbf416fa0cdae312243625716dcc1"
Jul 17 17:38:26.458046 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:26.458001    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx" event={"ID":"11be2111-7e22-4651-8067-cc76c4a53af0","Type":"ContainerStarted","Data":"56041eb300a02cb974154291d6755d9d1984a33bd58cf8a374527b00abd5756c"}
Jul 17 17:38:27.465190 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:27.465154    2566 generic.go:356] "Generic (PLEG): container finished" podID="11be2111-7e22-4651-8067-cc76c4a53af0" containerID="56041eb300a02cb974154291d6755d9d1984a33bd58cf8a374527b00abd5756c" exitCode=7
Jul 17 17:38:27.465698 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:27.465243    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx" event={"ID":"11be2111-7e22-4651-8067-cc76c4a53af0","Type":"ContainerDied","Data":"56041eb300a02cb974154291d6755d9d1984a33bd58cf8a374527b00abd5756c"}
Jul 17 17:38:27.465698 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:27.465309    2566 scope.go:117] "RemoveContainer" containerID="04384df0569f81b734fcbe4b1b7b68dfa56bbf416fa0cdae312243625716dcc1"
Jul 17 17:38:27.465698 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:27.465582    2566 scope.go:117] "RemoveContainer" containerID="56041eb300a02cb974154291d6755d9d1984a33bd58cf8a374527b00abd5756c"
Jul 17 17:38:27.465881 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:38:27.465855    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-r69rx_odh-ai-gateway-infra(11be2111-7e22-4651-8067-cc76c4a53af0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx" podUID="11be2111-7e22-4651-8067-cc76c4a53af0"
Jul 17 17:38:27.510058 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:27.510017    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx"]
Jul 17 17:38:28.611661 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:28.611638    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx"
Jul 17 17:38:28.649562 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:28.649534    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11be2111-7e22-4651-8067-cc76c4a53af0-maas-api-service-ca\") pod \"11be2111-7e22-4651-8067-cc76c4a53af0\" (UID: \"11be2111-7e22-4651-8067-cc76c4a53af0\") "
Jul 17 17:38:28.649885 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:28.649863    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11be2111-7e22-4651-8067-cc76c4a53af0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "11be2111-7e22-4651-8067-cc76c4a53af0" (UID: "11be2111-7e22-4651-8067-cc76c4a53af0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:38:28.750933 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:28.750841    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11be2111-7e22-4651-8067-cc76c4a53af0-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:29.478106 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:29.478014    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx"
Jul 17 17:38:29.478106 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:29.478053    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx" event={"ID":"11be2111-7e22-4651-8067-cc76c4a53af0","Type":"ContainerDied","Data":"d6f46438785fd556d31aec8a564b99cf80de2d774bb314fac997286a55e6b37d"}
Jul 17 17:38:29.478383 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:29.478127    2566 scope.go:117] "RemoveContainer" containerID="56041eb300a02cb974154291d6755d9d1984a33bd58cf8a374527b00abd5756c"
Jul 17 17:38:29.499207 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:29.499172    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx"]
Jul 17 17:38:29.505143 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:29.505113    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-r69rx"]
Jul 17 17:38:31.032449 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:31.032414    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11be2111-7e22-4651-8067-cc76c4a53af0" path="/var/lib/kubelet/pods/11be2111-7e22-4651-8067-cc76c4a53af0/volumes"
Jul 17 17:38:33.216252 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:33.216217    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"]
Jul 17 17:38:33.216669 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:33.216446    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r" podUID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" containerName="istio-proxy" containerID="cri-o://0cd8d9efc03bab9a170f2d344653227b38e7774195963510ca564db22c3a4fe0" gracePeriod=30
Jul 17 17:38:38.475079 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.475056    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:38:38.534303 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.534268    2566 generic.go:356] "Generic (PLEG): container finished" podID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" containerID="0cd8d9efc03bab9a170f2d344653227b38e7774195963510ca564db22c3a4fe0" exitCode=0
Jul 17 17:38:38.534476 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.534360    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"
Jul 17 17:38:38.534476 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.534357    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r" event={"ID":"9590ee0d-e24d-49ce-b08b-1c36fdbf5338","Type":"ContainerDied","Data":"0cd8d9efc03bab9a170f2d344653227b38e7774195963510ca564db22c3a4fe0"}
Jul 17 17:38:38.534599 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.534516    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r" event={"ID":"9590ee0d-e24d-49ce-b08b-1c36fdbf5338","Type":"ContainerDied","Data":"0e99643ed1ed539ea48ccab925c18fb5e706d2e174f22050ebf4909b0297af9f"}
Jul 17 17:38:38.534599 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.534552    2566 scope.go:117] "RemoveContainer" containerID="0cd8d9efc03bab9a170f2d344653227b38e7774195963510ca564db22c3a4fe0"
Jul 17 17:38:38.543100 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.543084    2566 scope.go:117] "RemoveContainer" containerID="700cef4de315e69557d57c42b9366e2b545fdecfb34cda471ed68bdaaca5aca0"
Jul 17 17:38:38.550372 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.550353    2566 scope.go:117] "RemoveContainer" containerID="0cd8d9efc03bab9a170f2d344653227b38e7774195963510ca564db22c3a4fe0"
Jul 17 17:38:38.550573 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.550551    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-token\") pod \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") "
Jul 17 17:38:38.550675 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.550605    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqjj2\" (UniqueName: \"kubernetes.io/projected/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-kube-api-access-qqjj2\") pod \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") "
Jul 17 17:38:38.550675 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:38:38.550612    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cd8d9efc03bab9a170f2d344653227b38e7774195963510ca564db22c3a4fe0\": container with ID starting with 0cd8d9efc03bab9a170f2d344653227b38e7774195963510ca564db22c3a4fe0 not found: ID does not exist" containerID="0cd8d9efc03bab9a170f2d344653227b38e7774195963510ca564db22c3a4fe0"
Jul 17 17:38:38.550675 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.550640    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-data\") pod \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") "
Jul 17 17:38:38.550675 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.550640    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd8d9efc03bab9a170f2d344653227b38e7774195963510ca564db22c3a4fe0"} err="failed to get container status \"0cd8d9efc03bab9a170f2d344653227b38e7774195963510ca564db22c3a4fe0\": rpc error: code = NotFound desc = could not find container \"0cd8d9efc03bab9a170f2d344653227b38e7774195963510ca564db22c3a4fe0\": container with ID starting with 0cd8d9efc03bab9a170f2d344653227b38e7774195963510ca564db22c3a4fe0 not found: ID does not exist"
Jul 17 17:38:38.550675 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.550663    2566 scope.go:117] "RemoveContainer" containerID="700cef4de315e69557d57c42b9366e2b545fdecfb34cda471ed68bdaaca5aca0"
Jul 17 17:38:38.551455 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.550695    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-workload-socket\") pod \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") "
Jul 17 17:38:38.551455 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.550729    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-envoy\") pod \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") "
Jul 17 17:38:38.551455 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.550754    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-podinfo\") pod \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") "
Jul 17 17:38:38.551455 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.550798    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istiod-ca-cert\") pod \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") "
Jul 17 17:38:38.551455 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.550847    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-workload-certs\") pod \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") "
Jul 17 17:38:38.551455 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.550917    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-credential-socket\") pod \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\" (UID: \"9590ee0d-e24d-49ce-b08b-1c36fdbf5338\") "
Jul 17 17:38:38.551455 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:38:38.550930    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"700cef4de315e69557d57c42b9366e2b545fdecfb34cda471ed68bdaaca5aca0\": container with ID starting with 700cef4de315e69557d57c42b9366e2b545fdecfb34cda471ed68bdaaca5aca0 not found: ID does not exist" containerID="700cef4de315e69557d57c42b9366e2b545fdecfb34cda471ed68bdaaca5aca0"
Jul 17 17:38:38.551455 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.550954    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9590ee0d-e24d-49ce-b08b-1c36fdbf5338" (UID: "9590ee0d-e24d-49ce-b08b-1c36fdbf5338"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:38:38.551455 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.550964    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"700cef4de315e69557d57c42b9366e2b545fdecfb34cda471ed68bdaaca5aca0"} err="failed to get container status \"700cef4de315e69557d57c42b9366e2b545fdecfb34cda471ed68bdaaca5aca0\": rpc error: code = NotFound desc = could not find container \"700cef4de315e69557d57c42b9366e2b545fdecfb34cda471ed68bdaaca5aca0\": container with ID starting with 700cef4de315e69557d57c42b9366e2b545fdecfb34cda471ed68bdaaca5aca0 not found: ID does not exist"
Jul 17 17:38:38.551455 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.551176    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9590ee0d-e24d-49ce-b08b-1c36fdbf5338" (UID: "9590ee0d-e24d-49ce-b08b-1c36fdbf5338"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:38:38.551455 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.551237    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-workload-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:38.551455 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.551269    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9590ee0d-e24d-49ce-b08b-1c36fdbf5338" (UID: "9590ee0d-e24d-49ce-b08b-1c36fdbf5338"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:38:38.551455 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.551418    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9590ee0d-e24d-49ce-b08b-1c36fdbf5338" (UID: "9590ee0d-e24d-49ce-b08b-1c36fdbf5338"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:38:38.552185 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.551639    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-data" (OuterVolumeSpecName: "istio-data") pod "9590ee0d-e24d-49ce-b08b-1c36fdbf5338" (UID: "9590ee0d-e24d-49ce-b08b-1c36fdbf5338"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:38:38.553124 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.553098    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-token" (OuterVolumeSpecName: "istio-token") pod "9590ee0d-e24d-49ce-b08b-1c36fdbf5338" (UID: "9590ee0d-e24d-49ce-b08b-1c36fdbf5338"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:38:38.553217 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.553193    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-kube-api-access-qqjj2" (OuterVolumeSpecName: "kube-api-access-qqjj2") pod "9590ee0d-e24d-49ce-b08b-1c36fdbf5338" (UID: "9590ee0d-e24d-49ce-b08b-1c36fdbf5338"). InnerVolumeSpecName "kube-api-access-qqjj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:38:38.553350 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.553297    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9590ee0d-e24d-49ce-b08b-1c36fdbf5338" (UID: "9590ee0d-e24d-49ce-b08b-1c36fdbf5338"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:38:38.553350 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.553306    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9590ee0d-e24d-49ce-b08b-1c36fdbf5338" (UID: "9590ee0d-e24d-49ce-b08b-1c36fdbf5338"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 17:38:38.651707 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.651683    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqjj2\" (UniqueName: \"kubernetes.io/projected/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-kube-api-access-qqjj2\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:38.651707 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.651708    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-data\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:38.651863 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.651716    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-envoy\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:38.651863 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.651724    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-podinfo\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:38.651863 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.651733    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istiod-ca-cert\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:38.651863 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.651741    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-workload-certs\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:38.651863 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.651749    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-credential-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:38.651863 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.651756    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9590ee0d-e24d-49ce-b08b-1c36fdbf5338-istio-token\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:38:38.858929 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.858898    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"]
Jul 17 17:38:38.862883 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:38.862858    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-3d4103-openshift-default-847c794f5f-ggc7r"]
Jul 17 17:38:39.033615 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:39.033584    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" path="/var/lib/kubelet/pods/9590ee0d-e24d-49ce-b08b-1c36fdbf5338/volumes"
Jul 17 17:38:44.304251 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.304208    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl"]
Jul 17 17:38:44.304829 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.304813    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11be2111-7e22-4651-8067-cc76c4a53af0" containerName="revoke-keys"
Jul 17 17:38:44.304880 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.304832    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="11be2111-7e22-4651-8067-cc76c4a53af0" containerName="revoke-keys"
Jul 17 17:38:44.304880 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.304852    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11be2111-7e22-4651-8067-cc76c4a53af0" containerName="revoke-keys"
Jul 17 17:38:44.304880 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.304861    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="11be2111-7e22-4651-8067-cc76c4a53af0" containerName="revoke-keys"
Jul 17 17:38:44.304991 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.304884    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11be2111-7e22-4651-8067-cc76c4a53af0" containerName="revoke-keys"
Jul 17 17:38:44.304991 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.304893    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="11be2111-7e22-4651-8067-cc76c4a53af0" containerName="revoke-keys"
Jul 17 17:38:44.304991 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.304910    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" containerName="istio-proxy"
Jul 17 17:38:44.304991 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.304918    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" containerName="istio-proxy"
Jul 17 17:38:44.304991 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.304938    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" containerName="istio-proxy"
Jul 17 17:38:44.304991 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.304946    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" containerName="istio-proxy"
Jul 17 17:38:44.305182 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.305025    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" containerName="istio-proxy"
Jul 17 17:38:44.305182 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.305036    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="11be2111-7e22-4651-8067-cc76c4a53af0" containerName="revoke-keys"
Jul 17 17:38:44.305182 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.305050    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="11be2111-7e22-4651-8067-cc76c4a53af0" containerName="revoke-keys"
Jul 17 17:38:44.308659 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.308638    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl"
Jul 17 17:38:44.311128 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.311098    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:38:44.311542 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.311523    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:38:44.320364 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.320313    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl"]
Jul 17 17:38:44.406408 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.406368    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7288a934-1604-4ede-9949-074e43ac3d42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl\" (UID: \"7288a934-1604-4ede-9949-074e43ac3d42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl"
Jul 17 17:38:44.507294 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.507248    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7288a934-1604-4ede-9949-074e43ac3d42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl\" (UID: \"7288a934-1604-4ede-9949-074e43ac3d42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl"
Jul 17 17:38:44.507926 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.507906    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7288a934-1604-4ede-9949-074e43ac3d42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl\" (UID: \"7288a934-1604-4ede-9949-074e43ac3d42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl"
Jul 17 17:38:44.620187 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.620103    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl"
Jul 17 17:38:44.774579 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:44.774527    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl"]
Jul 17 17:38:44.777057 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:38:44.777017    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7288a934_1604_4ede_9949_074e43ac3d42.slice/crio-c6db10dc698e860cdf309429a73771c9606ec32f853937287f17bb1443d8fe54 WatchSource:0}: Error finding container c6db10dc698e860cdf309429a73771c9606ec32f853937287f17bb1443d8fe54: Status 404 returned error can't find the container with id c6db10dc698e860cdf309429a73771c9606ec32f853937287f17bb1443d8fe54
Jul 17 17:38:45.574886 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:45.574850    2566 generic.go:356] "Generic (PLEG): container finished" podID="7288a934-1604-4ede-9949-074e43ac3d42" containerID="259c91778a3b7b079a051dd21ec5da04cb2a29cd6a3b6ae094ccf0ae5a229da8" exitCode=7
Jul 17 17:38:45.575240 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:45.574934    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl" event={"ID":"7288a934-1604-4ede-9949-074e43ac3d42","Type":"ContainerDied","Data":"259c91778a3b7b079a051dd21ec5da04cb2a29cd6a3b6ae094ccf0ae5a229da8"}
Jul 17 17:38:45.575240 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:45.574989    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl" event={"ID":"7288a934-1604-4ede-9949-074e43ac3d42","Type":"ContainerStarted","Data":"c6db10dc698e860cdf309429a73771c9606ec32f853937287f17bb1443d8fe54"}
Jul 17 17:38:45.575240 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:45.575094    2566 scope.go:117] "RemoveContainer" containerID="259c91778a3b7b079a051dd21ec5da04cb2a29cd6a3b6ae094ccf0ae5a229da8"
Jul 17 17:38:46.581657 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:46.581566    2566 generic.go:356] "Generic (PLEG): container finished" podID="7288a934-1604-4ede-9949-074e43ac3d42" containerID="36dc09787d34cecca7a0b788ba0dfa862abc7bbe987a2ce6f2eca96237059a39" exitCode=7
Jul 17 17:38:46.581657 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:46.581632    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl" event={"ID":"7288a934-1604-4ede-9949-074e43ac3d42","Type":"ContainerDied","Data":"36dc09787d34cecca7a0b788ba0dfa862abc7bbe987a2ce6f2eca96237059a39"}
Jul 17 17:38:46.582079 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:46.581679    2566 scope.go:117] "RemoveContainer" containerID="259c91778a3b7b079a051dd21ec5da04cb2a29cd6a3b6ae094ccf0ae5a229da8"
Jul 17 17:38:46.582079 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:46.581906    2566 scope.go:117] "RemoveContainer" containerID="36dc09787d34cecca7a0b788ba0dfa862abc7bbe987a2ce6f2eca96237059a39"
Jul 17 17:38:46.582166 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:38:46.582097    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl_odh-ai-gateway-infra(7288a934-1604-4ede-9949-074e43ac3d42)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl" podUID="7288a934-1604-4ede-9949-074e43ac3d42"
Jul 17 17:38:47.588290 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:47.588264    2566 scope.go:117] "RemoveContainer" containerID="36dc09787d34cecca7a0b788ba0dfa862abc7bbe987a2ce6f2eca96237059a39"
Jul 17 17:38:47.588699 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:38:47.588531    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl_odh-ai-gateway-infra(7288a934-1604-4ede-9949-074e43ac3d42)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl" podUID="7288a934-1604-4ede-9949-074e43ac3d42"
Jul 17 17:38:56.680173 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:56.680141    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"]
Jul 17 17:38:56.680666 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:56.680382    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8" podUID="ade4f59a-8973-4672-a3ae-42668685c03c" containerName="istio-proxy" containerID="cri-o://31687c34b339a46c95808fc9895718e6b6898c4af72d58a709157fd1321249e1" gracePeriod=30
Jul 17 17:38:57.406034 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:38:57.406001    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5488795fc6-2n9z4_413ce04c-b00c-4b02-9d9f-db66279ad755/authorino/0.log"
Jul 17 17:39:01.026143 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.026112    2566 scope.go:117] "RemoveContainer" containerID="36dc09787d34cecca7a0b788ba0dfa862abc7bbe987a2ce6f2eca96237059a39"
Jul 17 17:39:01.667703 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.667674    2566 generic.go:356] "Generic (PLEG): container finished" podID="7288a934-1604-4ede-9949-074e43ac3d42" containerID="2d1166dfe946990570988d13ce9bb5b4209feac720b1588d2b903054a3a55de0" exitCode=7
Jul 17 17:39:01.667831 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.667748    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl" event={"ID":"7288a934-1604-4ede-9949-074e43ac3d42","Type":"ContainerDied","Data":"2d1166dfe946990570988d13ce9bb5b4209feac720b1588d2b903054a3a55de0"}
Jul 17 17:39:01.667877 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.667831    2566 scope.go:117] "RemoveContainer" containerID="36dc09787d34cecca7a0b788ba0dfa862abc7bbe987a2ce6f2eca96237059a39"
Jul 17 17:39:01.668086 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.668070    2566 scope.go:117] "RemoveContainer" containerID="2d1166dfe946990570988d13ce9bb5b4209feac720b1588d2b903054a3a55de0"
Jul 17 17:39:01.668298 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:01.668280    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl_odh-ai-gateway-infra(7288a934-1604-4ede-9949-074e43ac3d42)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl" podUID="7288a934-1604-4ede-9949-074e43ac3d42"
Jul 17 17:39:01.934671 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.934648    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:39:01.968602 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.968568    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-istio-envoy\") pod \"ade4f59a-8973-4672-a3ae-42668685c03c\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") "
Jul 17 17:39:01.968770 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.968629    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ade4f59a-8973-4672-a3ae-42668685c03c-istio-podinfo\") pod \"ade4f59a-8973-4672-a3ae-42668685c03c\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") "
Jul 17 17:39:01.968770 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.968661    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-credential-socket\") pod \"ade4f59a-8973-4672-a3ae-42668685c03c\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") "
Jul 17 17:39:01.968770 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.968694    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-workload-socket\") pod \"ade4f59a-8973-4672-a3ae-42668685c03c\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") "
Jul 17 17:39:01.968770 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.968727    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-istio-data\") pod \"ade4f59a-8973-4672-a3ae-42668685c03c\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") "
Jul 17 17:39:01.969017 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.968796    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-workload-certs\") pod \"ade4f59a-8973-4672-a3ae-42668685c03c\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") "
Jul 17 17:39:01.969017 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.968827    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zzh7\" (UniqueName: \"kubernetes.io/projected/ade4f59a-8973-4672-a3ae-42668685c03c-kube-api-access-5zzh7\") pod \"ade4f59a-8973-4672-a3ae-42668685c03c\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") "
Jul 17 17:39:01.969017 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.968881    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ade4f59a-8973-4672-a3ae-42668685c03c-istio-token\") pod \"ade4f59a-8973-4672-a3ae-42668685c03c\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") "
Jul 17 17:39:01.969191 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.968995    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ade4f59a-8973-4672-a3ae-42668685c03c" (UID: "ade4f59a-8973-4672-a3ae-42668685c03c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:39:01.969191 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.969175    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-credential-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:39:01.969656 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.969383    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ade4f59a-8973-4672-a3ae-42668685c03c" (UID: "ade4f59a-8973-4672-a3ae-42668685c03c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:39:01.969656 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.969588    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ade4f59a-8973-4672-a3ae-42668685c03c" (UID: "ade4f59a-8973-4672-a3ae-42668685c03c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:39:01.969826 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.969781    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-istio-data" (OuterVolumeSpecName: "istio-data") pod "ade4f59a-8973-4672-a3ae-42668685c03c" (UID: "ade4f59a-8973-4672-a3ae-42668685c03c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:39:01.971343 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.971302    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ade4f59a-8973-4672-a3ae-42668685c03c" (UID: "ade4f59a-8973-4672-a3ae-42668685c03c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:39:01.971520 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.971486    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ade4f59a-8973-4672-a3ae-42668685c03c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ade4f59a-8973-4672-a3ae-42668685c03c" (UID: "ade4f59a-8973-4672-a3ae-42668685c03c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 17:39:01.971630 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.971527    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ade4f59a-8973-4672-a3ae-42668685c03c-istio-token" (OuterVolumeSpecName: "istio-token") pod "ade4f59a-8973-4672-a3ae-42668685c03c" (UID: "ade4f59a-8973-4672-a3ae-42668685c03c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:39:01.971630 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:01.971575    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ade4f59a-8973-4672-a3ae-42668685c03c-kube-api-access-5zzh7" (OuterVolumeSpecName: "kube-api-access-5zzh7") pod "ade4f59a-8973-4672-a3ae-42668685c03c" (UID: "ade4f59a-8973-4672-a3ae-42668685c03c"). InnerVolumeSpecName "kube-api-access-5zzh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:39:02.069512 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.069487    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ade4f59a-8973-4672-a3ae-42668685c03c-istiod-ca-cert\") pod \"ade4f59a-8973-4672-a3ae-42668685c03c\" (UID: \"ade4f59a-8973-4672-a3ae-42668685c03c\") "
Jul 17 17:39:02.069825 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.069801    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-workload-certs\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:39:02.069825 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.069821    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zzh7\" (UniqueName: \"kubernetes.io/projected/ade4f59a-8973-4672-a3ae-42668685c03c-kube-api-access-5zzh7\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:39:02.069909 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.069829    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ade4f59a-8973-4672-a3ae-42668685c03c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ade4f59a-8973-4672-a3ae-42668685c03c" (UID: "ade4f59a-8973-4672-a3ae-42668685c03c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:39:02.069909 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.069835    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ade4f59a-8973-4672-a3ae-42668685c03c-istio-token\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:39:02.069909 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.069866    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-istio-envoy\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:39:02.069909 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.069878    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ade4f59a-8973-4672-a3ae-42668685c03c-istio-podinfo\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:39:02.069909 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.069886    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-workload-socket\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:39:02.069909 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.069894    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ade4f59a-8973-4672-a3ae-42668685c03c-istio-data\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:39:02.170489 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.170412    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ade4f59a-8973-4672-a3ae-42668685c03c-istiod-ca-cert\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:39:02.674429 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.674398    2566 generic.go:356] "Generic (PLEG): container finished" podID="ade4f59a-8973-4672-a3ae-42668685c03c" containerID="31687c34b339a46c95808fc9895718e6b6898c4af72d58a709157fd1321249e1" exitCode=0
Jul 17 17:39:02.674627 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.674436    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"
Jul 17 17:39:02.674627 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.674481    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8" event={"ID":"ade4f59a-8973-4672-a3ae-42668685c03c","Type":"ContainerDied","Data":"31687c34b339a46c95808fc9895718e6b6898c4af72d58a709157fd1321249e1"}
Jul 17 17:39:02.674627 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.674533    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8" event={"ID":"ade4f59a-8973-4672-a3ae-42668685c03c","Type":"ContainerDied","Data":"848367a2fdebd350ae60e8cde08ec6d8ea994ec7f9925b9e56f08773b6cff054"}
Jul 17 17:39:02.674627 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.674561    2566 scope.go:117] "RemoveContainer" containerID="31687c34b339a46c95808fc9895718e6b6898c4af72d58a709157fd1321249e1"
Jul 17 17:39:02.684053 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.684037    2566 scope.go:117] "RemoveContainer" containerID="259107ea602a821852f041fccb2e11278c399821e4bdca1e17af77e49e8d9276"
Jul 17 17:39:02.692838 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.692816    2566 scope.go:117] "RemoveContainer" containerID="31687c34b339a46c95808fc9895718e6b6898c4af72d58a709157fd1321249e1"
Jul 17 17:39:02.693077 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:02.693055    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31687c34b339a46c95808fc9895718e6b6898c4af72d58a709157fd1321249e1\": container with ID starting with 31687c34b339a46c95808fc9895718e6b6898c4af72d58a709157fd1321249e1 not found: ID does not exist" containerID="31687c34b339a46c95808fc9895718e6b6898c4af72d58a709157fd1321249e1"
Jul 17 17:39:02.693174 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.693082    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31687c34b339a46c95808fc9895718e6b6898c4af72d58a709157fd1321249e1"} err="failed to get container status \"31687c34b339a46c95808fc9895718e6b6898c4af72d58a709157fd1321249e1\": rpc error: code = NotFound desc = could not find container \"31687c34b339a46c95808fc9895718e6b6898c4af72d58a709157fd1321249e1\": container with ID starting with 31687c34b339a46c95808fc9895718e6b6898c4af72d58a709157fd1321249e1 not found: ID does not exist"
Jul 17 17:39:02.693174 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.693099    2566 scope.go:117] "RemoveContainer" containerID="259107ea602a821852f041fccb2e11278c399821e4bdca1e17af77e49e8d9276"
Jul 17 17:39:02.693375 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:02.693357    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"259107ea602a821852f041fccb2e11278c399821e4bdca1e17af77e49e8d9276\": container with ID starting with 259107ea602a821852f041fccb2e11278c399821e4bdca1e17af77e49e8d9276 not found: ID does not exist" containerID="259107ea602a821852f041fccb2e11278c399821e4bdca1e17af77e49e8d9276"
Jul 17 17:39:02.693437 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.693384    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"259107ea602a821852f041fccb2e11278c399821e4bdca1e17af77e49e8d9276"} err="failed to get container status \"259107ea602a821852f041fccb2e11278c399821e4bdca1e17af77e49e8d9276\": rpc error: code = NotFound desc = could not find container \"259107ea602a821852f041fccb2e11278c399821e4bdca1e17af77e49e8d9276\": container with ID starting with 259107ea602a821852f041fccb2e11278c399821e4bdca1e17af77e49e8d9276 not found: ID does not exist"
Jul 17 17:39:02.697949 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.697926    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl"]
Jul 17 17:39:02.704569 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.704536    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"]
Jul 17 17:39:02.716473 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.716453    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-4f5e7b-openshift-default-864d9485ff-xb4s8"]
Jul 17 17:39:02.835040 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.835018    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl"
Jul 17 17:39:02.874928 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.874902    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7288a934-1604-4ede-9949-074e43ac3d42-maas-api-service-ca\") pod \"7288a934-1604-4ede-9949-074e43ac3d42\" (UID: \"7288a934-1604-4ede-9949-074e43ac3d42\") "
Jul 17 17:39:02.875200 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.875181    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7288a934-1604-4ede-9949-074e43ac3d42-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7288a934-1604-4ede-9949-074e43ac3d42" (UID: "7288a934-1604-4ede-9949-074e43ac3d42"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:39:02.975541 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:02.975476    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7288a934-1604-4ede-9949-074e43ac3d42-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:39:03.031314 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:03.031285    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ade4f59a-8973-4672-a3ae-42668685c03c" path="/var/lib/kubelet/pods/ade4f59a-8973-4672-a3ae-42668685c03c/volumes"
Jul 17 17:39:03.683255 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:03.683223    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl"
Jul 17 17:39:03.683255 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:03.683226    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl" event={"ID":"7288a934-1604-4ede-9949-074e43ac3d42","Type":"ContainerDied","Data":"c6db10dc698e860cdf309429a73771c9606ec32f853937287f17bb1443d8fe54"}
Jul 17 17:39:03.683780 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:03.683285    2566 scope.go:117] "RemoveContainer" containerID="2d1166dfe946990570988d13ce9bb5b4209feac720b1588d2b903054a3a55de0"
Jul 17 17:39:03.700291 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:03.700266    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl"]
Jul 17 17:39:03.705166 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:03.705145    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-vxkwl"]
Jul 17 17:39:04.327120 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:04.327093    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc76599b9-f8rr2_d881fe92-2ba0-4342-8393-1ec14706fde6/copy-manifests/0.log"
Jul 17 17:39:04.343440 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:04.343417    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc76599b9-f8rr2_d881fe92-2ba0-4342-8393-1ec14706fde6/manager/0.log"
Jul 17 17:39:05.032258 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:05.032227    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7288a934-1604-4ede-9949-074e43ac3d42" path="/var/lib/kubelet/pods/7288a934-1604-4ede-9949-074e43ac3d42/volumes"
Jul 17 17:39:06.514375 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514342    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl"]
Jul 17 17:39:06.514742 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514716    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7288a934-1604-4ede-9949-074e43ac3d42" containerName="revoke-keys"
Jul 17 17:39:06.514742 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514727    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7288a934-1604-4ede-9949-074e43ac3d42" containerName="revoke-keys"
Jul 17 17:39:06.514742 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514743    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ade4f59a-8973-4672-a3ae-42668685c03c" containerName="istio-proxy"
Jul 17 17:39:06.514874 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514748    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ade4f59a-8973-4672-a3ae-42668685c03c" containerName="istio-proxy"
Jul 17 17:39:06.514874 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514761    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ade4f59a-8973-4672-a3ae-42668685c03c" containerName="istio-proxy"
Jul 17 17:39:06.514874 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514766    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ade4f59a-8973-4672-a3ae-42668685c03c" containerName="istio-proxy"
Jul 17 17:39:06.514874 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514779    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7288a934-1604-4ede-9949-074e43ac3d42" containerName="revoke-keys"
Jul 17 17:39:06.514874 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514784    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7288a934-1604-4ede-9949-074e43ac3d42" containerName="revoke-keys"
Jul 17 17:39:06.514874 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514851    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7288a934-1604-4ede-9949-074e43ac3d42" containerName="revoke-keys"
Jul 17 17:39:06.514874 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514859    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7288a934-1604-4ede-9949-074e43ac3d42" containerName="revoke-keys"
Jul 17 17:39:06.514874 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514865    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="11be2111-7e22-4651-8067-cc76c4a53af0" containerName="revoke-keys"
Jul 17 17:39:06.514874 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514873    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ade4f59a-8973-4672-a3ae-42668685c03c" containerName="istio-proxy"
Jul 17 17:39:06.515174 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514879    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9590ee0d-e24d-49ce-b08b-1c36fdbf5338" containerName="istio-proxy"
Jul 17 17:39:06.515174 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.514888    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ade4f59a-8973-4672-a3ae-42668685c03c" containerName="istio-proxy"
Jul 17 17:39:06.519231 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.519215    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl"
Jul 17 17:39:06.525433 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.525413    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 17:39:06.525577 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.525545    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 17:39:06.534520 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.534492    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl"]
Jul 17 17:39:06.601110 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.601082    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/120cd7d7-6807-4721-9974-caa304a03021-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-v6kwl\" (UID: \"120cd7d7-6807-4721-9974-caa304a03021\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl"
Jul 17 17:39:06.702481 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.702456    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/120cd7d7-6807-4721-9974-caa304a03021-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-v6kwl\" (UID: \"120cd7d7-6807-4721-9974-caa304a03021\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl"
Jul 17 17:39:06.703106 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.703081    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/120cd7d7-6807-4721-9974-caa304a03021-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8c607776-v6kwl\" (UID: \"120cd7d7-6807-4721-9974-caa304a03021\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl"
Jul 17 17:39:06.829967 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.829942    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl"
Jul 17 17:39:06.965739 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:06.965695    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl"]
Jul 17 17:39:06.972121 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:39:06.972093    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120cd7d7_6807_4721_9974_caa304a03021.slice/crio-2837a3dd60c1555d382a30ada36b9f06a1634bc30b61f245ce83ee298fd0cb52 WatchSource:0}: Error finding container 2837a3dd60c1555d382a30ada36b9f06a1634bc30b61f245ce83ee298fd0cb52: Status 404 returned error can't find the container with id 2837a3dd60c1555d382a30ada36b9f06a1634bc30b61f245ce83ee298fd0cb52
Jul 17 17:39:07.335658 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:07.335635    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5488795fc6-2n9z4_413ce04c-b00c-4b02-9d9f-db66279ad755/authorino/0.log"
Jul 17 17:39:07.593835 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:07.593806    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2fz9g_f61f09b6-e8c3-4472-9304-5a5ae852cc1e/manager/0.log"
Jul 17 17:39:07.706116 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:07.706088    2566 generic.go:356] "Generic (PLEG): container finished" podID="120cd7d7-6807-4721-9974-caa304a03021" containerID="17e20eac6559f07eb8a259b55ebc3ed5d1925c42f085d29e6906c2a7ae1eeee1" exitCode=7
Jul 17 17:39:07.706272 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:07.706156    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl" event={"ID":"120cd7d7-6807-4721-9974-caa304a03021","Type":"ContainerDied","Data":"17e20eac6559f07eb8a259b55ebc3ed5d1925c42f085d29e6906c2a7ae1eeee1"}
Jul 17 17:39:07.706272 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:07.706206    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl" event={"ID":"120cd7d7-6807-4721-9974-caa304a03021","Type":"ContainerStarted","Data":"2837a3dd60c1555d382a30ada36b9f06a1634bc30b61f245ce83ee298fd0cb52"}
Jul 17 17:39:07.706412 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:07.706347    2566 scope.go:117] "RemoveContainer" containerID="17e20eac6559f07eb8a259b55ebc3ed5d1925c42f085d29e6906c2a7ae1eeee1"
Jul 17 17:39:07.906422 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:07.906356    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zxvzl_b31624ed-b741-4593-bc1d-bbc4ff03ef38/registry-server/0.log"
Jul 17 17:39:08.074559 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:08.074537    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-nwfl6_96778d09-76db-49ca-adcf-9a37fe3c9e05/manager/0.log"
Jul 17 17:39:08.352243 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:08.352214    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-thrm2_8a4f39cd-f267-4d9e-884b-fa6184c368a8/manager/0.log"
Jul 17 17:39:08.713415 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:08.713337    2566 generic.go:356] "Generic (PLEG): container finished" podID="120cd7d7-6807-4721-9974-caa304a03021" containerID="058162635c7ea6531f05cf253037b2924d7bca10c6a70f76553183675758e831" exitCode=7
Jul 17 17:39:08.713834 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:08.713411    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl" event={"ID":"120cd7d7-6807-4721-9974-caa304a03021","Type":"ContainerDied","Data":"058162635c7ea6531f05cf253037b2924d7bca10c6a70f76553183675758e831"}
Jul 17 17:39:08.713834 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:08.713464    2566 scope.go:117] "RemoveContainer" containerID="17e20eac6559f07eb8a259b55ebc3ed5d1925c42f085d29e6906c2a7ae1eeee1"
Jul 17 17:39:08.713834 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:08.713665    2566 scope.go:117] "RemoveContainer" containerID="058162635c7ea6531f05cf253037b2924d7bca10c6a70f76553183675758e831"
Jul 17 17:39:08.713998 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:08.713880    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-v6kwl_odh-ai-gateway-infra(120cd7d7-6807-4721-9974-caa304a03021)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl" podUID="120cd7d7-6807-4721-9974-caa304a03021"
Jul 17 17:39:08.763502 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:08.763484    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6782wt76_93053b78-3b7b-4f0e-950f-0fb6da559f33/istio-proxy/0.log"
Jul 17 17:39:09.296592 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:09.296561    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-nccbk_1d72e7b3-283b-45d6-b427-d70193a9eefe/istio-proxy/1.log"
Jul 17 17:39:09.691062 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:09.690980    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7559574b98-mjpbg_306ced93-2032-4527-8bad-8bba168bbcf5/router/0.log"
Jul 17 17:39:09.719949 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:09.719925    2566 scope.go:117] "RemoveContainer" containerID="058162635c7ea6531f05cf253037b2924d7bca10c6a70f76553183675758e831"
Jul 17 17:39:09.720276 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:09.720088    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-v6kwl_odh-ai-gateway-infra(120cd7d7-6807-4721-9974-caa304a03021)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl" podUID="120cd7d7-6807-4721-9974-caa304a03021"
Jul 17 17:39:10.190936 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:10.190905    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-6x6x2_415e7a42-3e01-4326-b9d0-4209f6f0a55b/main/0.log"
Jul 17 17:39:10.338579 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:10.338544    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-k7rqr_58ec5999-e7d4-4fb7-9836-094369e4937d/main/0.log"
Jul 17 17:39:11.819481 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:11.819447    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v"]
Jul 17 17:39:11.819859 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:11.819846    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7288a934-1604-4ede-9949-074e43ac3d42" containerName="revoke-keys"
Jul 17 17:39:11.819859 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:11.819860    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7288a934-1604-4ede-9949-074e43ac3d42" containerName="revoke-keys"
Jul 17 17:39:11.819943 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:11.819925    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7288a934-1604-4ede-9949-074e43ac3d42" containerName="revoke-keys"
Jul 17 17:39:11.822859 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:11.822841    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v"
Jul 17 17:39:11.833096 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:11.833072    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v"]
Jul 17 17:39:11.842007 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:11.841984    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea6b022-c5e2-4cb9-8948-97fdcbab50d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v\" (UID: \"0ea6b022-c5e2-4cb9-8948-97fdcbab50d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v"
Jul 17 17:39:11.943244 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:11.943216    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea6b022-c5e2-4cb9-8948-97fdcbab50d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v\" (UID: \"0ea6b022-c5e2-4cb9-8948-97fdcbab50d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v"
Jul 17 17:39:11.943781 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:11.943764    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea6b022-c5e2-4cb9-8948-97fdcbab50d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v\" (UID: \"0ea6b022-c5e2-4cb9-8948-97fdcbab50d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v"
Jul 17 17:39:12.133502 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:12.133418    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v"
Jul 17 17:39:12.267268 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:12.267243    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v"]
Jul 17 17:39:12.269638 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:39:12.269610    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea6b022_c5e2_4cb9_8948_97fdcbab50d7.slice/crio-b6f9f92df628654563fd53e4d82abe03e6c1544f76f7a66c1eda33466c8f14d2 WatchSource:0}: Error finding container b6f9f92df628654563fd53e4d82abe03e6c1544f76f7a66c1eda33466c8f14d2: Status 404 returned error can't find the container with id b6f9f92df628654563fd53e4d82abe03e6c1544f76f7a66c1eda33466c8f14d2
Jul 17 17:39:12.735977 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:12.735940    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v" event={"ID":"0ea6b022-c5e2-4cb9-8948-97fdcbab50d7","Type":"ContainerStarted","Data":"86a206497223e7d444be8242ea4196638b018ab496adaa0be7f271c63b225b41"}
Jul 17 17:39:12.736167 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:12.735998    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v" event={"ID":"0ea6b022-c5e2-4cb9-8948-97fdcbab50d7","Type":"ContainerStarted","Data":"b6f9f92df628654563fd53e4d82abe03e6c1544f76f7a66c1eda33466c8f14d2"}
Jul 17 17:39:12.763099 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:12.763052    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v" podStartSLOduration=1.763036753 podStartE2EDuration="1.763036753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:39:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:12.76124795 +0000 UTC m=+4401.620376491" watchObservedRunningTime="2026-07-17 17:39:12.763036753 +0000 UTC m=+4401.622165311"
Jul 17 17:39:13.742883 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:13.742799    2566 generic.go:356] "Generic (PLEG): container finished" podID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7" containerID="86a206497223e7d444be8242ea4196638b018ab496adaa0be7f271c63b225b41" exitCode=7
Jul 17 17:39:13.742883 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:13.742871    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v" event={"ID":"0ea6b022-c5e2-4cb9-8948-97fdcbab50d7","Type":"ContainerDied","Data":"86a206497223e7d444be8242ea4196638b018ab496adaa0be7f271c63b225b41"}
Jul 17 17:39:13.743361 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:13.743105    2566 scope.go:117] "RemoveContainer" containerID="86a206497223e7d444be8242ea4196638b018ab496adaa0be7f271c63b225b41"
Jul 17 17:39:14.749639 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:14.749553    2566 generic.go:356] "Generic (PLEG): container finished" podID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7" containerID="f19e616ac765911ef830f95ae1b33ec4c8f1ef7a48eb6d2ee8eeabfdbf7a8a1c" exitCode=7
Jul 17 17:39:14.749639 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:14.749628    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v" event={"ID":"0ea6b022-c5e2-4cb9-8948-97fdcbab50d7","Type":"ContainerDied","Data":"f19e616ac765911ef830f95ae1b33ec4c8f1ef7a48eb6d2ee8eeabfdbf7a8a1c"}
Jul 17 17:39:14.750122 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:14.749689    2566 scope.go:117] "RemoveContainer" containerID="86a206497223e7d444be8242ea4196638b018ab496adaa0be7f271c63b225b41"
Jul 17 17:39:14.750122 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:14.749869    2566 scope.go:117] "RemoveContainer" containerID="f19e616ac765911ef830f95ae1b33ec4c8f1ef7a48eb6d2ee8eeabfdbf7a8a1c"
Jul 17 17:39:14.750206 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:14.750126    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v_odh-ai-gateway-infra(0ea6b022-c5e2-4cb9-8948-97fdcbab50d7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v" podUID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7"
Jul 17 17:39:15.755952 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:15.755929    2566 scope.go:117] "RemoveContainer" containerID="f19e616ac765911ef830f95ae1b33ec4c8f1ef7a48eb6d2ee8eeabfdbf7a8a1c"
Jul 17 17:39:15.756374 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:15.756107    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v_odh-ai-gateway-infra(0ea6b022-c5e2-4cb9-8948-97fdcbab50d7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v" podUID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7"
Jul 17 17:39:20.460841 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:20.460814    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2h942_a98da8bd-6084-493e-bc85-56ec89e8c692/global-pull-secret-syncer/0.log"
Jul 17 17:39:20.808805 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:20.808780    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hwgtx_2a459d8a-1925-4d20-a34e-8f3a06eccd45/konnectivity-agent/0.log"
Jul 17 17:39:20.885460 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:20.885432    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-95.ec2.internal_aed273ced1ec685d701d62f08b5ef72e/haproxy/0.log"
Jul 17 17:39:23.028230 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:23.028205    2566 scope.go:117] "RemoveContainer" containerID="058162635c7ea6531f05cf253037b2924d7bca10c6a70f76553183675758e831"
Jul 17 17:39:23.796300 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:23.796268    2566 generic.go:356] "Generic (PLEG): container finished" podID="120cd7d7-6807-4721-9974-caa304a03021" containerID="2d8caa12939df92f6b187aa27a6c7ca9375e4c7b4d498034cb75ef9f18046850" exitCode=7
Jul 17 17:39:23.796467 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:23.796350    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl" event={"ID":"120cd7d7-6807-4721-9974-caa304a03021","Type":"ContainerDied","Data":"2d8caa12939df92f6b187aa27a6c7ca9375e4c7b4d498034cb75ef9f18046850"}
Jul 17 17:39:23.796467 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:23.796410    2566 scope.go:117] "RemoveContainer" containerID="058162635c7ea6531f05cf253037b2924d7bca10c6a70f76553183675758e831"
Jul 17 17:39:23.796727 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:23.796708    2566 scope.go:117] "RemoveContainer" containerID="2d8caa12939df92f6b187aa27a6c7ca9375e4c7b4d498034cb75ef9f18046850"
Jul 17 17:39:23.796991 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:23.796972    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8c607776-v6kwl_odh-ai-gateway-infra(120cd7d7-6807-4721-9974-caa304a03021)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl" podUID="120cd7d7-6807-4721-9974-caa304a03021"
Jul 17 17:39:24.832624 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:24.832584    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl"]
Jul 17 17:39:24.967185 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:24.967161    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl"
Jul 17 17:39:25.061782 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:25.061752    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/120cd7d7-6807-4721-9974-caa304a03021-maas-api-service-ca\") pod \"120cd7d7-6807-4721-9974-caa304a03021\" (UID: \"120cd7d7-6807-4721-9974-caa304a03021\") "
Jul 17 17:39:25.062110 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:25.062090    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/120cd7d7-6807-4721-9974-caa304a03021-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "120cd7d7-6807-4721-9974-caa304a03021" (UID: "120cd7d7-6807-4721-9974-caa304a03021"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:39:25.163094 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:25.163014    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/120cd7d7-6807-4721-9974-caa304a03021-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:39:25.808947 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:25.808919    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl"
Jul 17 17:39:25.809157 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:25.808948    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl" event={"ID":"120cd7d7-6807-4721-9974-caa304a03021","Type":"ContainerDied","Data":"2837a3dd60c1555d382a30ada36b9f06a1634bc30b61f245ce83ee298fd0cb52"}
Jul 17 17:39:25.809157 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:25.809001    2566 scope.go:117] "RemoveContainer" containerID="2d8caa12939df92f6b187aa27a6c7ca9375e4c7b4d498034cb75ef9f18046850"
Jul 17 17:39:25.836220 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:25.836195    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl"]
Jul 17 17:39:25.840500 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:25.840478    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8c607776-v6kwl"]
Jul 17 17:39:26.284208 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.284183    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5488795fc6-2n9z4_413ce04c-b00c-4b02-9d9f-db66279ad755/authorino/0.log"
Jul 17 17:39:26.417152 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.417122    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2fz9g_f61f09b6-e8c3-4472-9304-5a5ae852cc1e/manager/0.log"
Jul 17 17:39:26.508308 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.508281    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zxvzl_b31624ed-b741-4593-bc1d-bbc4ff03ef38/registry-server/0.log"
Jul 17 17:39:26.625656 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.625576    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-nwfl6_96778d09-76db-49ca-adcf-9a37fe3c9e05/manager/0.log"
Jul 17 17:39:26.715050 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.715027    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-thrm2_8a4f39cd-f267-4d9e-884b-fa6184c368a8/manager/0.log"
Jul 17 17:39:26.916066 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.915992    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n"]
Jul 17 17:39:26.916442 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.916428    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="120cd7d7-6807-4721-9974-caa304a03021" containerName="revoke-keys"
Jul 17 17:39:26.916495 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.916444    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="120cd7d7-6807-4721-9974-caa304a03021" containerName="revoke-keys"
Jul 17 17:39:26.916495 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.916460    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="120cd7d7-6807-4721-9974-caa304a03021" containerName="revoke-keys"
Jul 17 17:39:26.916495 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.916466    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="120cd7d7-6807-4721-9974-caa304a03021" containerName="revoke-keys"
Jul 17 17:39:26.916495 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.916474    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="120cd7d7-6807-4721-9974-caa304a03021" containerName="revoke-keys"
Jul 17 17:39:26.916495 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.916480    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="120cd7d7-6807-4721-9974-caa304a03021" containerName="revoke-keys"
Jul 17 17:39:26.916644 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.916546    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="120cd7d7-6807-4721-9974-caa304a03021" containerName="revoke-keys"
Jul 17 17:39:26.916644 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.916555    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="120cd7d7-6807-4721-9974-caa304a03021" containerName="revoke-keys"
Jul 17 17:39:26.916644 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.916564    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="120cd7d7-6807-4721-9974-caa304a03021" containerName="revoke-keys"
Jul 17 17:39:26.920890 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.920872    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n"
Jul 17 17:39:26.932726 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.932706    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n"]
Jul 17 17:39:26.978758 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:26.978737    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n\" (UID: \"6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n"
Jul 17 17:39:27.032274 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:27.032249    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="120cd7d7-6807-4721-9974-caa304a03021" path="/var/lib/kubelet/pods/120cd7d7-6807-4721-9974-caa304a03021/volumes"
Jul 17 17:39:27.079951 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:27.079928    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n\" (UID: \"6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n"
Jul 17 17:39:27.080677 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:27.080658    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n\" (UID: \"6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n"
Jul 17 17:39:27.231830 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:27.231777    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n"
Jul 17 17:39:27.370994 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:27.370974    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n"]
Jul 17 17:39:27.373504 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:39:27.373476    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7fa91c_e49e_4d84_ac84_5c0dce02e5f2.slice/crio-c60941ed2d3d1e5aff8e053784fa2c4344deb569f306fed16d34983287a0568b WatchSource:0}: Error finding container c60941ed2d3d1e5aff8e053784fa2c4344deb569f306fed16d34983287a0568b: Status 404 returned error can't find the container with id c60941ed2d3d1e5aff8e053784fa2c4344deb569f306fed16d34983287a0568b
Jul 17 17:39:27.822073 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:27.822032    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n" event={"ID":"6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2","Type":"ContainerStarted","Data":"63a637a00ff193090f30b67ca446af0a2ed67dc1670defd1f215bfae3510166c"}
Jul 17 17:39:27.822246 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:27.822092    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n" event={"ID":"6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2","Type":"ContainerStarted","Data":"c60941ed2d3d1e5aff8e053784fa2c4344deb569f306fed16d34983287a0568b"}
Jul 17 17:39:28.494108 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:28.494079    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09b59f0c-59ad-4a7e-9431-8ae978993f3c/alertmanager/0.log"
Jul 17 17:39:28.530178 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:28.530153    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09b59f0c-59ad-4a7e-9431-8ae978993f3c/config-reloader/0.log"
Jul 17 17:39:28.566590 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:28.566560    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09b59f0c-59ad-4a7e-9431-8ae978993f3c/kube-rbac-proxy-web/0.log"
Jul 17 17:39:28.599542 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:28.599521    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09b59f0c-59ad-4a7e-9431-8ae978993f3c/kube-rbac-proxy/0.log"
Jul 17 17:39:28.631127 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:28.631108    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09b59f0c-59ad-4a7e-9431-8ae978993f3c/kube-rbac-proxy-metric/0.log"
Jul 17 17:39:28.663157 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:28.663139    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09b59f0c-59ad-4a7e-9431-8ae978993f3c/prom-label-proxy/0.log"
Jul 17 17:39:28.709415 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:28.709394    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09b59f0c-59ad-4a7e-9431-8ae978993f3c/init-config-reloader/0.log"
Jul 17 17:39:28.762713 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:28.762661    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-mzfjl_5d24761b-ec84-4596-8784-16fb8394b3ac/cluster-monitoring-operator/0.log"
Jul 17 17:39:28.829458 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:28.829433    2566 generic.go:356] "Generic (PLEG): container finished" podID="6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2" containerID="63a637a00ff193090f30b67ca446af0a2ed67dc1670defd1f215bfae3510166c" exitCode=7
Jul 17 17:39:28.829602 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:28.829555    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n" event={"ID":"6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2","Type":"ContainerDied","Data":"63a637a00ff193090f30b67ca446af0a2ed67dc1670defd1f215bfae3510166c"}
Jul 17 17:39:28.829734 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:28.829717    2566 scope.go:117] "RemoveContainer" containerID="63a637a00ff193090f30b67ca446af0a2ed67dc1670defd1f215bfae3510166c"
Jul 17 17:39:29.388076 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:29.388050    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wslpj_07d6a2b8-ca86-499c-b6e1-813c91d87e15/node-exporter/0.log"
Jul 17 17:39:29.412238 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:29.412218    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wslpj_07d6a2b8-ca86-499c-b6e1-813c91d87e15/kube-rbac-proxy/0.log"
Jul 17 17:39:29.443920 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:29.443897    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wslpj_07d6a2b8-ca86-499c-b6e1-813c91d87e15/init-textfile/0.log"
Jul 17 17:39:29.835919 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:29.835883    2566 generic.go:356] "Generic (PLEG): container finished" podID="6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2" containerID="3e37b65d072939c510104fc667ccd1b344a302018949089ef3ed5f25399593cc" exitCode=7
Jul 17 17:39:29.836354 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:29.835955    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n" event={"ID":"6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2","Type":"ContainerDied","Data":"3e37b65d072939c510104fc667ccd1b344a302018949089ef3ed5f25399593cc"}
Jul 17 17:39:29.836354 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:29.836007    2566 scope.go:117] "RemoveContainer" containerID="63a637a00ff193090f30b67ca446af0a2ed67dc1670defd1f215bfae3510166c"
Jul 17 17:39:29.836354 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:29.836166    2566 scope.go:117] "RemoveContainer" containerID="3e37b65d072939c510104fc667ccd1b344a302018949089ef3ed5f25399593cc"
Jul 17 17:39:29.836538 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:29.836386    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n_odh-ai-gateway-infra(6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n" podUID="6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2"
Jul 17 17:39:30.019991 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.019961    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cbddbd754-zczcb_ee325963-6213-4dd6-aecd-2d76e82ed15a/telemeter-client/0.log"
Jul 17 17:39:30.026505 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.026480    2566 scope.go:117] "RemoveContainer" containerID="f19e616ac765911ef830f95ae1b33ec4c8f1ef7a48eb6d2ee8eeabfdbf7a8a1c"
Jul 17 17:39:30.069080 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.069064    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cbddbd754-zczcb_ee325963-6213-4dd6-aecd-2d76e82ed15a/reload/0.log"
Jul 17 17:39:30.105665 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.105609    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cbddbd754-zczcb_ee325963-6213-4dd6-aecd-2d76e82ed15a/kube-rbac-proxy/0.log"
Jul 17 17:39:30.140926 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.140901    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"]
Jul 17 17:39:30.145875 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.145860    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.156352 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:30.156299    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"perf-node-gather-daemonset-s7n97\" is forbidden: User \"system:node:ip-10-0-130-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-h2l68\": no relationship found between node 'ip-10-0-130-95.ec2.internal' and this object" podUID="d280135a-815d-48cb-8cf4-fe5762ab7d9b" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.156352 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:30.156306    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-95.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-must-gather-h2l68\": no relationship found between node 'ip-10-0-130-95.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-h2l68\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 17 17:39:30.156482 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:30.156348    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-95.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-must-gather-h2l68\": no relationship found between node 'ip-10-0-130-95.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-h2l68\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 17 17:39:30.156482 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:30.156352    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-nhlfh\" is forbidden: User \"system:node:ip-10-0-130-95.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-must-gather-h2l68\": no relationship found between node 'ip-10-0-130-95.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-h2l68\"/\"default-dockercfg-nhlfh\"" type="*v1.Secret"
Jul 17 17:39:30.203544 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.203524    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"]
Jul 17 17:39:30.205536 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.205515    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d280135a-815d-48cb-8cf4-fe5762ab7d9b-lib-modules\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.205659 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.205546    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d280135a-815d-48cb-8cf4-fe5762ab7d9b-podres\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.205659 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.205575    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d280135a-815d-48cb-8cf4-fe5762ab7d9b-proc\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.205659 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.205599    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mplc\" (UniqueName: \"kubernetes.io/projected/d280135a-815d-48cb-8cf4-fe5762ab7d9b-kube-api-access-7mplc\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.205841 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.205686    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d280135a-815d-48cb-8cf4-fe5762ab7d9b-sys\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.307105 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.307077    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d280135a-815d-48cb-8cf4-fe5762ab7d9b-lib-modules\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.307230 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.307115    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d280135a-815d-48cb-8cf4-fe5762ab7d9b-podres\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.307230 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.307145    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d280135a-815d-48cb-8cf4-fe5762ab7d9b-proc\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.307230 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.307177    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mplc\" (UniqueName: \"kubernetes.io/projected/d280135a-815d-48cb-8cf4-fe5762ab7d9b-kube-api-access-7mplc\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.307230 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.307211    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d280135a-815d-48cb-8cf4-fe5762ab7d9b-sys\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.307432 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.307250    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d280135a-815d-48cb-8cf4-fe5762ab7d9b-lib-modules\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.307432 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.307254    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d280135a-815d-48cb-8cf4-fe5762ab7d9b-podres\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.307432 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.307286    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d280135a-815d-48cb-8cf4-fe5762ab7d9b-sys\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.307432 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.307281    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d280135a-815d-48cb-8cf4-fe5762ab7d9b-proc\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:30.842451 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.842423    2566 scope.go:117] "RemoveContainer" containerID="3e37b65d072939c510104fc667ccd1b344a302018949089ef3ed5f25399593cc"
Jul 17 17:39:30.842872 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:30.842630    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n_odh-ai-gateway-infra(6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n" podUID="6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2"
Jul 17 17:39:30.844174 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.844152    2566 generic.go:356] "Generic (PLEG): container finished" podID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7" containerID="6a2820cf7436b3b07a0bc156160c2202f7e1c538f4981cb8f1f219337288a48b" exitCode=7
Jul 17 17:39:30.844300 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.844207    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v" event={"ID":"0ea6b022-c5e2-4cb9-8948-97fdcbab50d7","Type":"ContainerDied","Data":"6a2820cf7436b3b07a0bc156160c2202f7e1c538f4981cb8f1f219337288a48b"}
Jul 17 17:39:30.844300 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.844249    2566 scope.go:117] "RemoveContainer" containerID="f19e616ac765911ef830f95ae1b33ec4c8f1ef7a48eb6d2ee8eeabfdbf7a8a1c"
Jul 17 17:39:30.844512 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:30.844485    2566 scope.go:117] "RemoveContainer" containerID="6a2820cf7436b3b07a0bc156160c2202f7e1c538f4981cb8f1f219337288a48b"
Jul 17 17:39:30.844652 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:30.844633    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v_odh-ai-gateway-infra(0ea6b022-c5e2-4cb9-8948-97fdcbab50d7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v" podUID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7"
Jul 17 17:39:31.023889 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:31.023861    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h2l68\"/\"kube-root-ca.crt\""
Jul 17 17:39:31.029534 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:31.029516    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h2l68\"/\"openshift-service-ca.crt\""
Jul 17 17:39:31.041499 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:31.041469    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mplc\" (UniqueName: \"kubernetes.io/projected/d280135a-815d-48cb-8cf4-fe5762ab7d9b-kube-api-access-7mplc\") pod \"perf-node-gather-daemonset-s7n97\" (UID: \"d280135a-815d-48cb-8cf4-fe5762ab7d9b\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:31.198702 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:31.198644    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h2l68\"/\"default-dockercfg-nhlfh\""
Jul 17 17:39:31.205990 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:31.205966    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:31.348376 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:31.348350    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"]
Jul 17 17:39:31.349261 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:39:31.349228    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd280135a_815d_48cb_8cf4_fe5762ab7d9b.slice/crio-3f4cfe187d046c682ec41995f5e3e1f94828b30321ba20513b50826689a3bb5b WatchSource:0}: Error finding container 3f4cfe187d046c682ec41995f5e3e1f94828b30321ba20513b50826689a3bb5b: Status 404 returned error can't find the container with id 3f4cfe187d046c682ec41995f5e3e1f94828b30321ba20513b50826689a3bb5b
Jul 17 17:39:31.559626 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:31.559604    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-5hbc5_b3eb41d7-86a9-45d5-a13b-81ce258f9fde/networking-console-plugin/0.log"
Jul 17 17:39:31.858985 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:31.858904    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97" event={"ID":"d280135a-815d-48cb-8cf4-fe5762ab7d9b","Type":"ContainerStarted","Data":"5a5edf9c6b6324b242f4d6fbb8038b8b4b85515d7a29af0b18245abbefd62b4c"}
Jul 17 17:39:31.859390 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:31.858992    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:31.859390 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:31.859020    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97" event={"ID":"d280135a-815d-48cb-8cf4-fe5762ab7d9b","Type":"ContainerStarted","Data":"3f4cfe187d046c682ec41995f5e3e1f94828b30321ba20513b50826689a3bb5b"}
Jul 17 17:39:31.891577 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:31.891528    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97" podStartSLOduration=1.891514269 podStartE2EDuration="1.891514269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:31.888249441 +0000 UTC m=+4420.747377991" watchObservedRunningTime="2026-07-17 17:39:31.891514269 +0000 UTC m=+4420.750642827"
Jul 17 17:39:31.930268 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:31.930240    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v"]
Jul 17 17:39:32.064258 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:32.064234    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v"
Jul 17 17:39:32.122253 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:32.122183    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea6b022-c5e2-4cb9-8948-97fdcbab50d7-maas-api-service-ca\") pod \"0ea6b022-c5e2-4cb9-8948-97fdcbab50d7\" (UID: \"0ea6b022-c5e2-4cb9-8948-97fdcbab50d7\") "
Jul 17 17:39:32.122544 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:32.122522    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ea6b022-c5e2-4cb9-8948-97fdcbab50d7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0ea6b022-c5e2-4cb9-8948-97fdcbab50d7" (UID: "0ea6b022-c5e2-4cb9-8948-97fdcbab50d7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:39:32.134886 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:32.134862    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/1.log"
Jul 17 17:39:32.139973 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:32.139957    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-k8z54_394cfdf6-9ca2-44ee-9728-118b029b5a30/console-operator/2.log"
Jul 17 17:39:32.223285 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:32.223263    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea6b022-c5e2-4cb9-8948-97fdcbab50d7-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:39:32.866755 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:32.866725    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v"
Jul 17 17:39:32.867213 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:32.866765    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v" event={"ID":"0ea6b022-c5e2-4cb9-8948-97fdcbab50d7","Type":"ContainerDied","Data":"b6f9f92df628654563fd53e4d82abe03e6c1544f76f7a66c1eda33466c8f14d2"}
Jul 17 17:39:32.867213 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:32.866835    2566 scope.go:117] "RemoveContainer" containerID="6a2820cf7436b3b07a0bc156160c2202f7e1c538f4981cb8f1f219337288a48b"
Jul 17 17:39:32.887951 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:32.887928    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v"]
Jul 17 17:39:32.894416 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:32.894395    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d4fd87f-6k24v"]
Jul 17 17:39:33.032619 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:33.032585    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7" path="/var/lib/kubelet/pods/0ea6b022-c5e2-4cb9-8948-97fdcbab50d7/volumes"
Jul 17 17:39:33.330665 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:33.330636    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-btp2x_1b03ece1-dd5e-421c-9f0d-d2c2dde17654/volume-data-source-validator/0.log"
Jul 17 17:39:34.371831 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.371798    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s"]
Jul 17 17:39:34.372201 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.372164    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7" containerName="revoke-keys"
Jul 17 17:39:34.372201 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.372174    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7" containerName="revoke-keys"
Jul 17 17:39:34.372201 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.372184    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7" containerName="revoke-keys"
Jul 17 17:39:34.372201 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.372190    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7" containerName="revoke-keys"
Jul 17 17:39:34.372201 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.372202    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7" containerName="revoke-keys"
Jul 17 17:39:34.372408 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.372208    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7" containerName="revoke-keys"
Jul 17 17:39:34.372408 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.372275    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7" containerName="revoke-keys"
Jul 17 17:39:34.372408 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.372287    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ea6b022-c5e2-4cb9-8948-97fdcbab50d7" containerName="revoke-keys"
Jul 17 17:39:34.376614 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.376596    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s"
Jul 17 17:39:34.401166 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.401140    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s"]
Jul 17 17:39:34.439288 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.439263    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5743a6d-bc58-4b3f-9dc2-8bf31cd78128-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s\" (UID: \"c5743a6d-bc58-4b3f-9dc2-8bf31cd78128\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s"
Jul 17 17:39:34.540422 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.540397    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5743a6d-bc58-4b3f-9dc2-8bf31cd78128-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s\" (UID: \"c5743a6d-bc58-4b3f-9dc2-8bf31cd78128\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s"
Jul 17 17:39:34.540994 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.540973    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5743a6d-bc58-4b3f-9dc2-8bf31cd78128-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s\" (UID: \"c5743a6d-bc58-4b3f-9dc2-8bf31cd78128\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s"
Jul 17 17:39:34.662580 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.662515    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4r4v_5e9b8ff7-d39a-4284-a2df-48e0e0052267/dns/0.log"
Jul 17 17:39:34.686087 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.686064    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s"
Jul 17 17:39:34.691357 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.691341    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4r4v_5e9b8ff7-d39a-4284-a2df-48e0e0052267/kube-rbac-proxy/0.log"
Jul 17 17:39:34.728615 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.728592    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2fdh7_47d0c172-df3f-43c6-a05e-d482e3d05f5a/dns-node-resolver/0.log"
Jul 17 17:39:34.820534 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.820511    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s"]
Jul 17 17:39:34.821956 ip-10-0-130-95 kubenswrapper[2566]: W0717 17:39:34.821934    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5743a6d_bc58_4b3f_9dc2_8bf31cd78128.slice/crio-b8a15a9effb0292396bba51d20ac96961f53817a73a6d5a105f27ad268ecc44b WatchSource:0}: Error finding container b8a15a9effb0292396bba51d20ac96961f53817a73a6d5a105f27ad268ecc44b: Status 404 returned error can't find the container with id b8a15a9effb0292396bba51d20ac96961f53817a73a6d5a105f27ad268ecc44b
Jul 17 17:39:34.878361 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:34.878337    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s" event={"ID":"c5743a6d-bc58-4b3f-9dc2-8bf31cd78128","Type":"ContainerStarted","Data":"b8a15a9effb0292396bba51d20ac96961f53817a73a6d5a105f27ad268ecc44b"}
Jul 17 17:39:35.440393 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:35.440371    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jncft_085fe0bb-1721-4665-af0f-1ac3b8ad2e97/node-ca/0.log"
Jul 17 17:39:35.884624 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:35.884588    2566 generic.go:356] "Generic (PLEG): container finished" podID="c5743a6d-bc58-4b3f-9dc2-8bf31cd78128" containerID="c497099429a60a5af91f4b54cd9a2030d080e8ef06adf2d93003eb70cf04c8ae" exitCode=7
Jul 17 17:39:35.884776 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:35.884669    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s" event={"ID":"c5743a6d-bc58-4b3f-9dc2-8bf31cd78128","Type":"ContainerDied","Data":"c497099429a60a5af91f4b54cd9a2030d080e8ef06adf2d93003eb70cf04c8ae"}
Jul 17 17:39:35.884835 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:35.884820    2566 scope.go:117] "RemoveContainer" containerID="c497099429a60a5af91f4b54cd9a2030d080e8ef06adf2d93003eb70cf04c8ae"
Jul 17 17:39:36.532293 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:36.532272    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6782wt76_93053b78-3b7b-4f0e-950f-0fb6da559f33/istio-proxy/0.log"
Jul 17 17:39:36.786733 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:36.786705    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-nccbk_1d72e7b3-283b-45d6-b427-d70193a9eefe/istio-proxy/0.log"
Jul 17 17:39:36.815105 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:36.815081    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-nccbk_1d72e7b3-283b-45d6-b427-d70193a9eefe/istio-proxy/1.log"
Jul 17 17:39:36.890935 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:36.890912    2566 generic.go:356] "Generic (PLEG): container finished" podID="c5743a6d-bc58-4b3f-9dc2-8bf31cd78128" containerID="0e7b66112a18c98f60ea38f25388c9dbf89f308af54e08af939d69bce706a9a7" exitCode=7
Jul 17 17:39:36.891067 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:36.891001    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s" event={"ID":"c5743a6d-bc58-4b3f-9dc2-8bf31cd78128","Type":"ContainerDied","Data":"0e7b66112a18c98f60ea38f25388c9dbf89f308af54e08af939d69bce706a9a7"}
Jul 17 17:39:36.891117 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:36.891093    2566 scope.go:117] "RemoveContainer" containerID="c497099429a60a5af91f4b54cd9a2030d080e8ef06adf2d93003eb70cf04c8ae"
Jul 17 17:39:36.891154 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:36.891144    2566 scope.go:117] "RemoveContainer" containerID="0e7b66112a18c98f60ea38f25388c9dbf89f308af54e08af939d69bce706a9a7"
Jul 17 17:39:36.891385 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:36.891364    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s_odh-ai-gateway-infra(c5743a6d-bc58-4b3f-9dc2-8bf31cd78128)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s" podUID="c5743a6d-bc58-4b3f-9dc2-8bf31cd78128"
Jul 17 17:39:36.955916 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:36.955892    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7559574b98-mjpbg_306ced93-2032-4527-8bad-8bba168bbcf5/router/0.log"
Jul 17 17:39:37.700419 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:37.700389    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zwg7q_a553f30c-cb45-4cc1-a83b-55aaf03da15d/serve-healthcheck-canary/0.log"
Jul 17 17:39:37.877292 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:37.877265    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-s7n97"
Jul 17 17:39:37.897597 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:37.897570    2566 scope.go:117] "RemoveContainer" containerID="0e7b66112a18c98f60ea38f25388c9dbf89f308af54e08af939d69bce706a9a7"
Jul 17 17:39:37.897779 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:37.897761    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s_odh-ai-gateway-infra(c5743a6d-bc58-4b3f-9dc2-8bf31cd78128)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4cb0f3bd-jpx2s" podUID="c5743a6d-bc58-4b3f-9dc2-8bf31cd78128"
Jul 17 17:39:38.179513 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:38.179488    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-5gsh8_82c7f60e-1ba3-4fe2-8661-6c6ebc698b05/insights-operator/0.log"
Jul 17 17:39:38.181054 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:38.181038    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-5gsh8_82c7f60e-1ba3-4fe2-8661-6c6ebc698b05/insights-operator/1.log"
Jul 17 17:39:38.379758 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:38.379726    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7s6s_89d0a6b7-cb49-43b9-9f91-767b6089bc91/kube-rbac-proxy/0.log"
Jul 17 17:39:38.404212 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:38.404184    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7s6s_89d0a6b7-cb49-43b9-9f91-767b6089bc91/exporter/0.log"
Jul 17 17:39:38.433784 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:38.433721    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7s6s_89d0a6b7-cb49-43b9-9f91-767b6089bc91/extractor/0.log"
Jul 17 17:39:41.095795 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:41.095764    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6782wt76_93053b78-3b7b-4f0e-950f-0fb6da559f33/istio-proxy/0.log"
Jul 17 17:39:41.325669 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:41.325643    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-nccbk_1d72e7b3-283b-45d6-b427-d70193a9eefe/istio-proxy/0.log"
Jul 17 17:39:41.361084 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:41.361000    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-nccbk_1d72e7b3-283b-45d6-b427-d70193a9eefe/istio-proxy/1.log"
Jul 17 17:39:41.426332 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:41.426302    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7559574b98-mjpbg_306ced93-2032-4527-8bad-8bba168bbcf5/router/0.log"
Jul 17 17:39:41.580364 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:41.580339    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc76599b9-f8rr2_d881fe92-2ba0-4342-8393-1ec14706fde6/manager/0.log"
Jul 17 17:39:41.596117 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:41.596092    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc76599b9-f8rr2_d881fe92-2ba0-4342-8393-1ec14706fde6/copy-manifests/0.log"
Jul 17 17:39:42.610279 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:42.610254    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6782wt76_93053b78-3b7b-4f0e-950f-0fb6da559f33/istio-proxy/0.log"
Jul 17 17:39:42.794133 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:42.794105    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-nccbk_1d72e7b3-283b-45d6-b427-d70193a9eefe/istio-proxy/0.log"
Jul 17 17:39:42.828555 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:42.828516    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-nccbk_1d72e7b3-283b-45d6-b427-d70193a9eefe/istio-proxy/1.log"
Jul 17 17:39:42.828830 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:42.828811    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-64bdb655c8-lw8zr_ac0fb846-36cc-4329-8d84-da8889b4246c/manager/0.log"
Jul 17 17:39:42.887972 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:42.887886    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-slx42_8ec91a46-9d9f-49c8-bd0f-256962cf2335/openshift-lws-operator/0.log"
Jul 17 17:39:42.889934 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:42.889906    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7559574b98-mjpbg_306ced93-2032-4527-8bad-8bba168bbcf5/router/0.log"
Jul 17 17:39:44.026292 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:44.026257    2566 scope.go:117] "RemoveContainer" containerID="3e37b65d072939c510104fc667ccd1b344a302018949089ef3ed5f25399593cc"
Jul 17 17:39:44.932953 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:44.932919    2566 generic.go:356] "Generic (PLEG): container finished" podID="6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2" containerID="5f0c699420cd11b2f6d4a1d2ac30c649e045f0d2cf5d3eaa5546c663e0f76fb8" exitCode=7
Jul 17 17:39:44.933068 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:44.932988    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n" event={"ID":"6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2","Type":"ContainerDied","Data":"5f0c699420cd11b2f6d4a1d2ac30c649e045f0d2cf5d3eaa5546c663e0f76fb8"}
Jul 17 17:39:44.933107 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:44.933082    2566 scope.go:117] "RemoveContainer" containerID="3e37b65d072939c510104fc667ccd1b344a302018949089ef3ed5f25399593cc"
Jul 17 17:39:44.933427 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:44.933405    2566 scope.go:117] "RemoveContainer" containerID="5f0c699420cd11b2f6d4a1d2ac30c649e045f0d2cf5d3eaa5546c663e0f76fb8"
Jul 17 17:39:44.933602 ip-10-0-130-95 kubenswrapper[2566]: E0717 17:39:44.933582    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n_odh-ai-gateway-infra(6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n" podUID="6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2"
Jul 17 17:39:45.962981 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:45.962936    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n"]
Jul 17 17:39:46.112216 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:46.112191    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n"
Jul 17 17:39:46.244602 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:46.244519    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2-maas-api-service-ca\") pod \"6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2\" (UID: \"6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2\") "
Jul 17 17:39:46.244933 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:46.244904    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2" (UID: "6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:39:46.346216 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:46.346186    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2-maas-api-service-ca\") on node \"ip-10-0-130-95.ec2.internal\" DevicePath \"\""
Jul 17 17:39:46.947697 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:46.947663    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n"
Jul 17 17:39:46.947873 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:46.947662    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n" event={"ID":"6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2","Type":"ContainerDied","Data":"c60941ed2d3d1e5aff8e053784fa2c4344deb569f306fed16d34983287a0568b"}
Jul 17 17:39:46.947873 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:46.947778    2566 scope.go:117] "RemoveContainer" containerID="5f0c699420cd11b2f6d4a1d2ac30c649e045f0d2cf5d3eaa5546c663e0f76fb8"
Jul 17 17:39:46.971993 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:46.971963    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n"]
Jul 17 17:39:46.976635 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:46.976614    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a8e6750e-gzc5n"]
Jul 17 17:39:47.032257 ip-10-0-130-95 kubenswrapper[2566]: I0717 17:39:47.032232    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2" path="/var/lib/kubelet/pods/6d7fa91c-e49e-4d84-ac84-5c0dce02e5f2/volumes"