Jul 06 13:37:33.919572 ip-10-0-134-86 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 13:37:33.919586 ip-10-0-134-86 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 13:37:33.919596 ip-10-0-134-86 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 13:37:33.919946 ip-10-0-134-86 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 13:37:45.020235 ip-10-0-134-86 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 13:37:45.020259 ip-10-0-134-86 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ba6fafd50b1a4f73b2a73d9d2b5268fc --
Jul 06 13:39:44.564417 ip-10-0-134-86 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 13:39:45.024806 ip-10-0-134-86 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 13:39:45.024806 ip-10-0-134-86 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 13:39:45.024806 ip-10-0-134-86 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 13:39:45.024806 ip-10-0-134-86 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 13:39:45.024806 ip-10-0-134-86 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 13:39:45.027236 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.027131    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 13:39:45.031657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031628    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:39:45.031657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031654    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:39:45.031657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031658    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031663    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031666    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031670    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031673    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031676    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031679    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031682    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031685    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031688    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031690    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031695    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031698    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031703    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031707    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031710    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031714    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031723    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031726    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:39:45.031769 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031729    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031731    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031734    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031738    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031740    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031743    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031746    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031748    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031751    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031754    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031757    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031760    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031763    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031766    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031769    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031772    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031776    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031779    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031783    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031786    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:39:45.032283 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031789    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031792    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031794    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031798    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031801    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031803    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031806    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031809    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031811    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031815    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031818    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031821    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031823    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031826    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031829    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031833    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031835    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031838    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031841    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031844    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:39:45.032824 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031847    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031849    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031852    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031855    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031857    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031862    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031866    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031870    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031874    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031877    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031881    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031884    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031887    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031889    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031892    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031895    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031898    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031902    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031905    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:39:45.033355 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031907    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031912    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031915    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031919    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031922    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031925    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031927    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031930    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031933    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031936    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031939    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031942    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031945    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031948    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031951    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031954    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031956    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031959    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.031962    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032807    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:39:45.033843 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032816    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032820    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032823    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032828    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032831    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032834    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032837    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032840    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032843    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032846    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032849    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032851    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032854    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032857    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032859    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032862    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032865    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032868    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032872    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:39:45.034405 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032876    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032879    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032882    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032885    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032889    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032892    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032895    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032897    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032900    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032903    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032906    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032909    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032913    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032917    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032921    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032924    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032927    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032930    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032934    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032937    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:39:45.034910 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032940    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032942    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032945    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032948    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032950    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032953    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032956    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032958    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032961    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032963    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032966    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032969    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032971    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032974    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032976    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032979    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032982    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032986    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032989    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032991    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:39:45.035452 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032994    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.032997    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033001    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033004    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033007    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033010    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033013    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033016    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033018    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033021    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033024    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033027    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033029    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033032    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033034    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033037    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033039    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033042    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033045    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033047    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:39:45.036018 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033050    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033052    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033055    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033058    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033060    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033063    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033066    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033069    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033071    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033076    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033079    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033082    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033085    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033088    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033091    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033094    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033096    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033099    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033102    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:39:45.036602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033540    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033545    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033548    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033552    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033555    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033558    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033561    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033564    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033567    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033570    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033573    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033575    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033578    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033581    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033584    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033587    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033590    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033592    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033595    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033598    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:39:45.037122 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033601    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033605    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033609    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033613    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033616    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033619    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033622    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033625    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033633    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033636    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033639    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033641    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033644    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033647    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033651    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033654    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033657    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033660    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033663    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:39:45.037657 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033666    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033669    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033671    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033674    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033677    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033679    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033682    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033685    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033688    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033691    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033693    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033697    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033701    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033704    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033707    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033710    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033713    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033716    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033719    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:39:45.038201 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033722    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033725    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033730    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033733    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033735    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033738    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033741    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033744    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033747    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033750    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033752    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033755    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033758    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033761    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033764    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033768    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033771    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033774    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033777    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033779    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:39:45.038702 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033782    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033785    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033787    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033790    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033793    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033796    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033799    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033802    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033806    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033809    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033812    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033815    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033817    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033820    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033824    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033826    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033829    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033832    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033835    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:39:45.039277 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033838    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.033840    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033929    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033942    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033949    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033954    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033959    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033963    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033968    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033972    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033976    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033980    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033983    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033987    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033990    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033994    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.033997    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034000    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034003    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034006    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034011    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034015    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034018    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034022    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 13:39:45.039751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034025    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034029    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034033    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034037    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034040    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034044    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034047    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034050    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034053    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034056    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034061    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034064    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034067    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034070    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034073    2573 flags.go:64] FLAG: --enable-server="true"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034077    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034081    2573 flags.go:64] FLAG: --event-burst="100"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034085    2573 flags.go:64] FLAG: --event-qps="50"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034088    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034091    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034095    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034099    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034102    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034105    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034108    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 06 13:39:45.040404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034110    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034113    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034116    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034119    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034123    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034141    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034144    2573 flags.go:64] FLAG: --feature-gates=""
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034149    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034152    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034155    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034159    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034162    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034166    2573 flags.go:64] FLAG: --help="false"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034169    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034172    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034176    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034179    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034183    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034186    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034190    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034193    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034196    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034199    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 13:39:45.041140 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034203    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034206    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034209    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034212    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034215    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034218    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034221    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034225    2573 flags.go:64] FLAG: --lock-file=""
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034228    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034231    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034234    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034239    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034242    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034246    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034249    2573 flags.go:64] FLAG: --logging-format="text"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034252    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034256    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034259    2573 flags.go:64] FLAG: --manifest-url=""
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034262    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034267    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034270    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034275    2573 flags.go:64] FLAG: --max-pods="110"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034278    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034281    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034285    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 13:39:45.041787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034288    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034291    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034294    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034297    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034305    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034308    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034311    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034314    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034318    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034324    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034327    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034330    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034333    2573 flags.go:64] FLAG: --port="10250"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034336    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034339    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bd630f32ec822e28"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034342    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034345    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034349    2573 flags.go:64] FLAG: --register-node="true"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034351    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034355    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034358    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034361    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034364    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034368    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034372    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 13:39:45.042466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034375    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034378    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034381    2573 flags.go:64] FLAG: --runonce="false"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034384    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034387    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034391    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034394    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034397    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034400    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034403    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034407    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034410    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034413    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034417    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034420    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034424    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034427    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034430    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034436    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034439    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034442    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034447    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034450    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034453    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034456    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 13:39:45.043186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034459    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034462    2573 flags.go:64] FLAG: --v="2"
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034468    2573 flags.go:64] FLAG: --version="false"
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034473    2573 flags.go:64] FLAG: --vmodule=""
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034477    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.034480    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034601    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034605    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034609    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034614    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034617    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034620    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034623    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034626    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034629    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034632    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034635    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034638    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034641    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034645    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034648    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:39:45.043905 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034651    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034654    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034657    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034661    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034664    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034667    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034670    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034672    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034675    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034677    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034680    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034683    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034686    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034690    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034692    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034695    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034698    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034701    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034704    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034706    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:39:45.044836 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034711    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034713    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034716    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034719    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034722    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034725    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034729    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034732    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034735    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034738    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034740    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034744    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034747    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034749    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034752    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034755    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034762    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034765    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034767    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:39:45.045462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034770    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034772    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034775    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034778    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034781    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034784    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034788    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034791    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034794    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034797    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034799    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034802    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034804    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034808    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034811    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034814    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034817    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034819    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034822    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:39:45.045976 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034826    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034829    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034832    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034835    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034838    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034841    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034844    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034847    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034850    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034853    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034855    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034861    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034864    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034866    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034869    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034872    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034875    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034877    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034880    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034885    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:39:45.046542 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034887    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034890    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034893    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034895    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034898    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.034901    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.035452    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.042636    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.042662    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.043531    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.043539    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043605    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043612    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043616    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043620    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:39:45.047046 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043623    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043626    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043629    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043635    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043640    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043643    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043646    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043649    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043652    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043655    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043657    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043660    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043663    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043666    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043668    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043671    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043674    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043677    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043681    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:39:45.047527 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043685    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043688    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043692    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043695    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043697    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043700    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043705    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043707    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043804    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043811    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043814    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043817    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043821    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043824    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043827    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.043830    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044629    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044647    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044654    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:39:45.048003 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044662    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044669    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044675    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044681    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044687    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044693    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044698    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044703    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044716    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044720    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044725    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044731    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044738    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044745    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044750    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044755    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044760    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044765    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044770    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044775    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:39:45.048504 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044781    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044791    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044796    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044801    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044806    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044811    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044816    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044821    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044826    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044832    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044869    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044875    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044880    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044892    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044896    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044901    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044906    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044911    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044915    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044920    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:39:45.049064 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044925    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044929    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044934    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044939    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044944    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044949    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044958    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044963    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044968    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044973    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044977    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044982    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044987    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044992    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.044996    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045003    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:39:45.049605 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045007    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.045017    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045451    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045460    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045464    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045471    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045477    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045482    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045486    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045489    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045494    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045497    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045502    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045505    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045510    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:39:45.050089 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045513    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045518    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045521    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045524    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045526    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045529    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045532    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045534    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045537    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045540    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045543    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045546    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045550    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045555    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045560    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045564    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045568    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045574    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045578    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045581    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:39:45.050520 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045584    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045587    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045590    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045593    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045596    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045599    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045602    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045604    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045607    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045610    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045613    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045616    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045618    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045622    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045625    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045628    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045630    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045633    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045636    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045638    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:39:45.051031 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045641    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045646    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045650    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045654    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045659    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045663    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045666    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045669    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045672    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045675    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045678    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045681    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045684    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045687    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045692    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045696    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045698    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045715    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045718    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045720    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:39:45.051712 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045723    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045726    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045730    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045734    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045738    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045743    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045748    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045750    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045756    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045759    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045762    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045765    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045769    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045772    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045775    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045778    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045781    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045784    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045787    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:39:45.052227 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045789    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:39:45.052744 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045792    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:39:45.052744 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045795    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:39:45.052744 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045798    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:39:45.052744 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045802    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:39:45.052744 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045805    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:39:45.052744 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:45.045810    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:39:45.052744 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.045817    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 13:39:45.052744 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.045980    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 13:39:45.052744 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.048236    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 13:39:45.052744 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.049806    2573 server.go:1019] "Starting client certificate rotation"
Jul 06 13:39:45.052744 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.049914    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 13:39:45.052744 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.049947    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 13:39:45.053388 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.053370    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 13:39:45.054714 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.054693    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 13:39:45.062292 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.062265    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 06 13:39:45.064604 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.064581    2573 log.go:25] "Validated CRI v1 image API"
Jul 06 13:39:45.066408 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.066388    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 13:39:45.069260 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.069232    2573 fs.go:135] Filesystem UUIDs: map[0b049807-7c57-4197-8a82-90323968f90c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ce76f1ec-3a6f-479a-8ce2-2ad88272a0d6:/dev/nvme0n1p4]
Jul 06 13:39:45.069358 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.069258    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 13:39:45.075006 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.074864    2573 manager.go:216] Machine: {Timestamp:2026-07-06 13:39:45.073250775 +0000 UTC m=+0.384814435 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199835 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2975befb97098192fcbb2feaa18133 SystemUUID:ec2975be-fb97-0981-92fc-bb2feaa18133 BootID:ba6fafd5-0b1a-4f73-b2a7-3d9d2b5268fc Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c7:63:d5:01:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c7:63:d5:01:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:c5:fd:ea:83:f5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 13:39:45.075006 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.074997    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 13:39:45.075147 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.075105    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 13:39:45.078355 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.078312    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 13:39:45.078565 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.078371    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-86.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 13:39:45.079214 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.079200    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 13:39:45.079252 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.079216    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 13:39:45.079252 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.079224    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 13:39:45.079316 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.079254    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 13:39:45.080560 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.080546    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 13:39:45.084816 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.084800    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 13:39:45.084947 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.084937    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 13:39:45.085002 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.084970    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 13:39:45.085002 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.084987    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 13:39:45.085002 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.085002    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 13:39:45.085101 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.085012    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 06 13:39:45.085101 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.085023    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 13:39:45.085338 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.085297    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 13:39:45.085780 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.085749    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 13:39:45.086334 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.086308    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 13:39:45.088971 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.088946    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 13:39:45.090927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.090913    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 13:39:45.090996 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.090945    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 13:39:45.092039 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.092017    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 13:39:45.092127 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.092043    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 13:39:45.092127 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.092050    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 13:39:45.092127 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.092055    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 13:39:45.092127 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.092084    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 13:39:45.092127 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.092090    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 13:39:45.092127 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.092098    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 13:39:45.092127 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.092103    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 13:39:45.092127 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.092110    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 13:39:45.092127 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.092116    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 13:39:45.092382 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.092144    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 13:39:45.092382 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.092151    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 13:39:45.092782 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.092772    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 13:39:45.092782 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.092781    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 13:39:45.096271 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.096254    2573 server.go:1268] "Started kubelet"
Jul 06 13:39:45.096423 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.096374    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 13:39:45.097175 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.097151    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-86.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 13:39:45.097285 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.097169    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 13:39:45.097285 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.097248    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 13:39:45.097285 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.097110    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 13:39:45.097172 ip-10-0-134-86 systemd[1]: Started Kubernetes Kubelet.
Jul 06 13:39:45.097576 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.097299    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 13:39:45.098725 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.098709    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 13:39:45.099172 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.099126    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 13:39:45.101737 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.101708    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 13:39:45.105156 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.105134    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vjkcf"
Jul 06 13:39:45.105823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.105804    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 13:39:45.105894 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.104758    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-86.ec2.internal.18bfb6ff4d904f78  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-86.ec2.internal,UID:ip-10-0-134-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-86.ec2.internal,},FirstTimestamp:2026-07-06 13:39:45.096224632 +0000 UTC m=+0.407788374,LastTimestamp:2026-07-06 13:39:45.096224632 +0000 UTC m=+0.407788374,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-86.ec2.internal,}"
Jul 06 13:39:45.105894 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.105830    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 13:39:45.106019 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.105945    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-86.ec2.internal\" not found"
Jul 06 13:39:45.106533 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.106461    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 13:39:45.106533 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.106525    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 13:39:45.106533 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.106537    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 13:39:45.106706 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.106653    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 13:39:45.106706 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.106696    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 13:39:45.107283 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.107251    2573 factory.go:153] Registering CRI-O factory
Jul 06 13:39:45.107366 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.107295    2573 factory.go:223] Registration of the crio container factory successfully
Jul 06 13:39:45.107366 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.107349    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 13:39:45.107366 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.107360    2573 factory.go:55] Registering systemd factory
Jul 06 13:39:45.107366 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.107367    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 06 13:39:45.107486 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.107392    2573 factory.go:103] Registering Raw factory
Jul 06 13:39:45.107486 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.107408    2573 manager.go:1196] Started watching for new ooms in manager
Jul 06 13:39:45.107887 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.107874    2573 manager.go:349] Starting recovery of all containers
Jul 06 13:39:45.110488 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.110460    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 13:39:45.110777 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.110690    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 13:39:45.111916 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.111545    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vjkcf"
Jul 06 13:39:45.135611 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.135582    2573 manager.go:354] Recovery completed
Jul 06 13:39:45.140532 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.140514    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:39:45.142865 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.142846    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:39:45.142946 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.142886    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:39:45.142946 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.142901    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:39:45.143467 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.143452    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 13:39:45.143521 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.143467    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 13:39:45.143521 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.143487    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 13:39:45.143580 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.143482    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:39:45.144514 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.144494    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:39:45.144566 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.144532    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:39:45.144566 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.144549    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:39:45.145779 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.145766    2573 policy_none.go:49] "None policy: Start"
Jul 06 13:39:45.145816 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.145784    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 13:39:45.145816 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.145795    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 13:39:45.148011 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.147997    2573 policy_none.go:47] "Start"
Jul 06 13:39:45.196940 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.196916    2573 manager.go:337] "Starting Device Plugin manager"
Jul 06 13:39:45.197088 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.196965    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 13:39:45.197088 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.196976    2573 server.go:87] "Starting device plugin registration server"
Jul 06 13:39:45.197346 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.197333    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 13:39:45.197404 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.197348    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 13:39:45.197496 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.197478    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 13:39:45.197574 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.197567    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 13:39:45.197574 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.197577    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 13:39:45.198021 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.197996    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 13:39:45.198128 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.198061    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-86.ec2.internal\" not found"
Jul 06 13:39:45.303625 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.303550    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:39:45.305787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.304680    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:39:45.305787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.304724    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:39:45.305787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.304740    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:39:45.305787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.304781    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.305787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.305730    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 13:39:45.307051 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.307029    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 13:39:45.307143 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.307084    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 13:39:45.307143 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.307113    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 13:39:45.307245 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.307172    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 13:39:45.309222 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.309202    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:39:45.313907 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.313879    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.313907 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.313912    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-86.ec2.internal\": node \"ip-10-0-134-86.ec2.internal\" not found"
Jul 06 13:39:45.359662 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.359628    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-86.ec2.internal\" not found"
Jul 06 13:39:45.407645 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.407608    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-86.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal"]
Jul 06 13:39:45.407753 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.407701    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:39:45.409538 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.409513    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:39:45.409656 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.409552    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:39:45.409656 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.409568    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:39:45.412040 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.412023    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:39:45.412184 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.412166    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.412227 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.412204    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:39:45.412988 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.412970    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:39:45.413080 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.413000    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:39:45.413080 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.413012    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:39:45.413080 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.413024    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:39:45.413080 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.413046    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:39:45.413080 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.413071    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:39:45.415520 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.415503    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.415573 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.415541    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:39:45.416449 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.416431    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:39:45.416562 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.416465    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:39:45.416562 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.416475    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:39:45.440219 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.440184    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-86.ec2.internal\" not found" node="ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.445194 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.445175    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-86.ec2.internal\" not found" node="ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.460739 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.460705    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-86.ec2.internal\" not found"
Jul 06 13:39:45.508198 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.508161    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4917cbac70d3a854e4ffc76b7293bab-config\") pod \"kube-apiserver-proxy-ip-10-0-134-86.ec2.internal\" (UID: \"e4917cbac70d3a854e4ffc76b7293bab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.508374 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.508201    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a68539a85cc11dc6f814626af5419522-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal\" (UID: \"a68539a85cc11dc6f814626af5419522\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.508374 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.508271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a68539a85cc11dc6f814626af5419522-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal\" (UID: \"a68539a85cc11dc6f814626af5419522\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.561449 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.561364    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-86.ec2.internal\" not found"
Jul 06 13:39:45.608639 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.608604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4917cbac70d3a854e4ffc76b7293bab-config\") pod \"kube-apiserver-proxy-ip-10-0-134-86.ec2.internal\" (UID: \"e4917cbac70d3a854e4ffc76b7293bab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.608755 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.608646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a68539a85cc11dc6f814626af5419522-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal\" (UID: \"a68539a85cc11dc6f814626af5419522\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.608755 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.608671    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a68539a85cc11dc6f814626af5419522-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal\" (UID: \"a68539a85cc11dc6f814626af5419522\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.608755 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.608712    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4917cbac70d3a854e4ffc76b7293bab-config\") pod \"kube-apiserver-proxy-ip-10-0-134-86.ec2.internal\" (UID: \"e4917cbac70d3a854e4ffc76b7293bab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.608755 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.608734    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a68539a85cc11dc6f814626af5419522-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal\" (UID: \"a68539a85cc11dc6f814626af5419522\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.608755 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.608733    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a68539a85cc11dc6f814626af5419522-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal\" (UID: \"a68539a85cc11dc6f814626af5419522\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.662919 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.662864    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-86.ec2.internal\" not found"
Jul 06 13:39:45.745098 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.745026    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.748321 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:45.748292    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:45.764036 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.763999    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-86.ec2.internal\" not found"
Jul 06 13:39:45.865234 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.865180    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-86.ec2.internal\" not found"
Jul 06 13:39:45.966583 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:45.966536    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-86.ec2.internal\" not found"
Jul 06 13:39:46.040724 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:46.040699    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:39:46.049220 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:46.049188    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 13:39:46.049393 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:46.049356    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 13:39:46.049436 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:46.049387    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 13:39:46.067042 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:46.067000    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-86.ec2.internal\" not found"
Jul 06 13:39:46.116099 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:46.115954    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 13:34:45 +0000 UTC" deadline="2028-01-31 10:21:42.715966287 +0000 UTC"
Jul 06 13:39:46.116099 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:46.116005    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13772h41m56.599965697s"
Jul 06 13:39:46.167484 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:46.167434    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-86.ec2.internal\" not found"
Jul 06 13:39:46.208944 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:46.208914    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:39:46.308157 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:46.308112    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:46.319046 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:46.319010    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 13:39:46.321081 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:46.321047    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal"
Jul 06 13:39:46.331945 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:46.331922    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 13:39:46.354348 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:46.354303    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4917cbac70d3a854e4ffc76b7293bab.slice/crio-2f66a114d4992c3b75763df3eaab894c9c1327f17b4e0167657d1be75d01fdc7 WatchSource:0}: Error finding container 2f66a114d4992c3b75763df3eaab894c9c1327f17b4e0167657d1be75d01fdc7: Status 404 returned error can't find the container with id 2f66a114d4992c3b75763df3eaab894c9c1327f17b4e0167657d1be75d01fdc7
Jul 06 13:39:46.358902 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:46.358885    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 13:39:46.365252 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:46.365226    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda68539a85cc11dc6f814626af5419522.slice/crio-d4e717bee4f322f94de65e12280b230d3e49d3cb65602f35598aa8b2e22d0012 WatchSource:0}: Error finding container d4e717bee4f322f94de65e12280b230d3e49d3cb65602f35598aa8b2e22d0012: Status 404 returned error can't find the container with id d4e717bee4f322f94de65e12280b230d3e49d3cb65602f35598aa8b2e22d0012
Jul 06 13:39:46.472798 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:46.472766    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:39:47.086986 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.086950    2573 apiserver.go:52] "Watching apiserver"
Jul 06 13:39:47.096205 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.095616    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 13:39:47.096385 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.096271    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-g2x7s","kube-system/kube-apiserver-proxy-ip-10-0-134-86.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6","openshift-dns/node-resolver-24pv7","openshift-image-registry/node-ca-jvw66","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal","openshift-multus/multus-k7qsv","openshift-multus/network-metrics-daemon-bxwzf","kube-system/global-pull-secret-syncer-v7pkm","openshift-cluster-node-tuning-operator/tuned-flf7k","openshift-multus/multus-additional-cni-plugins-txzrt","openshift-network-diagnostics/network-check-target-98cxh","openshift-network-operator/iptables-alerter-6w99d","openshift-ovn-kubernetes/ovnkube-node-9gnwx"]
Jul 06 13:39:47.099239 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.099206    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.101897 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.101867    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6w99d"
Jul 06 13:39:47.102577 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.102535    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 13:39:47.102577 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.102536    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 13:39:47.102807 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.102707    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z7thk\""
Jul 06 13:39:47.102807 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.102776    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 13:39:47.102916 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.102833    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 13:39:47.102978 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.102964    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 13:39:47.104207 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.104184    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.105288 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.105074    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v2g9f\""
Jul 06 13:39:47.105288 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.105133    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 13:39:47.105288 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.105150    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 13:39:47.105487 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.105390    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 13:39:47.108162 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.106943    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-24pv7"
Jul 06 13:39:47.108162 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.107941    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 13:39:47.110188 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.108528    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7zd4x\""
Jul 06 13:39:47.110188 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.109092    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 13:39:47.111500 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.110650    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 13:39:47.111500 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.111024    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 13:39:47.111500 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.111328    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xbv25\""
Jul 06 13:39:47.111500 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.111402    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jvw66"
Jul 06 13:39:47.114143 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.114123    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 13:39:47.114532 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.114515    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hksb5\""
Jul 06 13:39:47.114718 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.114702    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 13:39:47.114928 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.114893    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 13:39:47.115223 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.115207    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g2x7s"
Jul 06 13:39:47.117621 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.117557    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sc6fj\""
Jul 06 13:39:47.117621 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.117557    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 13:39:47.117773 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.117674    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 13:39:47.118332 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118311    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbb9f\" (UniqueName: \"kubernetes.io/projected/db98920a-1284-4df7-b4a8-e188335e3bfe-kube-api-access-xbb9f\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.118418 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-multus-socket-dir-parent\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.118418 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-hostroot\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.118418 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118398    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-run-multus-certs\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.118558 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118418    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:47.118558 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118424    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db98920a-1284-4df7-b4a8-e188335e3bfe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.118558 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-etc-kubernetes\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.118558 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118492    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db98920a-1284-4df7-b4a8-e188335e3bfe-cnibin\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.118558 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118515    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-system-cni-dir\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.118558 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118541    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-multus-daemon-config\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.118748 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118563    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p292p\" (UniqueName: \"kubernetes.io/projected/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-kube-api-access-p292p\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.118748 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118589    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db98920a-1284-4df7-b4a8-e188335e3bfe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.118748 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118610    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-cni-binary-copy\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.118748 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118647    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94fa57f3-07ff-41ed-ba5b-1afa96644e70-hosts-file\") pod \"node-resolver-24pv7\" (UID: \"94fa57f3-07ff-41ed-ba5b-1afa96644e70\") " pod="openshift-dns/node-resolver-24pv7"
Jul 06 13:39:47.118748 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118681    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db98920a-1284-4df7-b4a8-e188335e3bfe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.118748 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118706    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jxvj\" (UniqueName: \"kubernetes.io/projected/d138f6c3-773b-455e-9319-85fa4d195585-kube-api-access-6jxvj\") pod \"iptables-alerter-6w99d\" (UID: \"d138f6c3-773b-455e-9319-85fa4d195585\") " pod="openshift-network-operator/iptables-alerter-6w99d"
Jul 06 13:39:47.119037 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118739    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-run-k8s-cni-cncf-io\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.119037 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118786    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-run-netns\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.119037 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.118509    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:39:47.119037 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118876    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d138f6c3-773b-455e-9319-85fa4d195585-iptables-alerter-script\") pod \"iptables-alerter-6w99d\" (UID: \"d138f6c3-773b-455e-9319-85fa4d195585\") " pod="openshift-network-operator/iptables-alerter-6w99d"
Jul 06 13:39:47.119037 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-var-lib-cni-multus\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.119037 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118950    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94fa57f3-07ff-41ed-ba5b-1afa96644e70-tmp-dir\") pod \"node-resolver-24pv7\" (UID: \"94fa57f3-07ff-41ed-ba5b-1afa96644e70\") " pod="openshift-dns/node-resolver-24pv7"
Jul 06 13:39:47.119037 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.118978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-multus-cni-dir\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.119037 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.119029    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-var-lib-kubelet\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.119650 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.119091    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prbrk\" (UniqueName: \"kubernetes.io/projected/94fa57f3-07ff-41ed-ba5b-1afa96644e70-kube-api-access-prbrk\") pod \"node-resolver-24pv7\" (UID: \"94fa57f3-07ff-41ed-ba5b-1afa96644e70\") " pod="openshift-dns/node-resolver-24pv7"
Jul 06 13:39:47.119650 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.119126    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db98920a-1284-4df7-b4a8-e188335e3bfe-system-cni-dir\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.119650 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.119149    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d138f6c3-773b-455e-9319-85fa4d195585-host-slash\") pod \"iptables-alerter-6w99d\" (UID: \"d138f6c3-773b-455e-9319-85fa4d195585\") " pod="openshift-network-operator/iptables-alerter-6w99d"
Jul 06 13:39:47.119650 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.119176    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-cnibin\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.119650 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.119199    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-os-release\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.119650 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.119236    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-var-lib-cni-bin\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.119650 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.119266    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-multus-conf-dir\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.119650 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.119294    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db98920a-1284-4df7-b4a8-e188335e3bfe-os-release\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.119650 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.119320    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db98920a-1284-4df7-b4a8-e188335e3bfe-cni-binary-copy\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.121032 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.121011    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:47.121158 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.121009    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 13:39:47.121228 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.121174    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:39:47.123449 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.123426    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.125915 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.125892    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.126087 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.126060    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 13:39:47.126270 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.126249    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wgf6c\""
Jul 06 13:39:47.126380 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.126004    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 13:39:47.128381 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.128358    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:39:47.128483 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.128432    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:39:47.128827 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.128769    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 13:39:47.129054 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.129029    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bc2ps\""
Jul 06 13:39:47.129151 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.129059    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 13:39:47.129340 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.129316    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 13:39:47.132183 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.132162    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.134922 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.134718    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j49zs\""
Jul 06 13:39:47.135570 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.135550    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 13:39:47.135726 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.135709    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 13:39:47.136063 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.136041    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 13:39:47.136147 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.136099    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 13:39:47.136386 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.136369    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 13:39:47.136462 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.136376    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 13:39:47.141502 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.141478    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bxc78"
Jul 06 13:39:47.148459 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.148393    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bxc78"
Jul 06 13:39:47.208855 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.208823    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 13:39:47.220254 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220218    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db98920a-1284-4df7-b4a8-e188335e3bfe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.220441 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220268    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ef2141c-12a4-456c-aaa6-2562ad662e9e-serviceca\") pod \"node-ca-jvw66\" (UID: \"9ef2141c-12a4-456c-aaa6-2562ad662e9e\") " pod="openshift-image-registry/node-ca-jvw66"
Jul 06 13:39:47.220441 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220297    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/669b823f-324a-4575-9949-eeab012ffeb2-ovnkube-config\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.220441 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220322    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-run-netns\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.220441 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-tuned\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.220441 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220370    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/669b823f-324a-4575-9949-eeab012ffeb2-env-overrides\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.220441 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d138f6c3-773b-455e-9319-85fa4d195585-iptables-alerter-script\") pod \"iptables-alerter-6w99d\" (UID: \"d138f6c3-773b-455e-9319-85fa4d195585\") " pod="openshift-network-operator/iptables-alerter-6w99d"
Jul 06 13:39:47.220771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220460    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-device-dir\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.220771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220462    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db98920a-1284-4df7-b4a8-e188335e3bfe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.220771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220488    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-kubelet\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.220771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220516    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-multus-cni-dir\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.220771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-modprobe-d\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.220771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-sysctl-d\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.220771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220610    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khpwm\" (UniqueName: \"kubernetes.io/projected/e91222e6-c320-40fc-95ca-143f548068d7-kube-api-access-khpwm\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.220771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220639    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db98920a-1284-4df7-b4a8-e188335e3bfe-system-cni-dir\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.220771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220666    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d138f6c3-773b-455e-9319-85fa4d195585-host-slash\") pod \"iptables-alerter-6w99d\" (UID: \"d138f6c3-773b-455e-9319-85fa4d195585\") " pod="openshift-network-operator/iptables-alerter-6w99d"
Jul 06 13:39:47.220771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-cnibin\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.220771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-os-release\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.220771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220770    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-kubernetes\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-host\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220820    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220544    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-run-netns\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220880    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-socket-dir\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220896    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d138f6c3-773b-455e-9319-85fa4d195585-host-slash\") pod \"iptables-alerter-6w99d\" (UID: \"d138f6c3-773b-455e-9319-85fa4d195585\") " pod="openshift-network-operator/iptables-alerter-6w99d"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db98920a-1284-4df7-b4a8-e188335e3bfe-os-release\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220957    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-hostroot\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.220985    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-run-multus-certs\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221013    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-run-systemd\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221035    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db98920a-1284-4df7-b4a8-e188335e3bfe-os-release\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221054    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-etc-openvswitch\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221110    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db98920a-1284-4df7-b4a8-e188335e3bfe-system-cni-dir\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221117    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-node-log\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221118    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-cnibin\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221047    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-os-release\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db98920a-1284-4df7-b4a8-e188335e3bfe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.221391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221173    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-hostroot\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221177    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d138f6c3-773b-455e-9319-85fa4d195585-iptables-alerter-script\") pod \"iptables-alerter-6w99d\" (UID: \"d138f6c3-773b-455e-9319-85fa4d195585\") " pod="openshift-network-operator/iptables-alerter-6w99d"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-sysctl-conf\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-run-netns\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db98920a-1284-4df7-b4a8-e188335e3bfe-cnibin\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221287    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-sysconfig\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221305    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-multus-cni-dir\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221328    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-log-socket\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221344    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-run-multus-certs\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-cni-binary-copy\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221381    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94fa57f3-07ff-41ed-ba5b-1afa96644e70-hosts-file\") pod \"node-resolver-24pv7\" (UID: \"94fa57f3-07ff-41ed-ba5b-1afa96644e70\") " pod="openshift-dns/node-resolver-24pv7"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221411    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcfsj\" (UniqueName: \"kubernetes.io/projected/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-kube-api-access-zcfsj\") pod \"network-metrics-daemon-bxwzf\" (UID: \"fa01cd4e-ab76-429e-aaca-95f1c98c19c1\") " pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221442    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db98920a-1284-4df7-b4a8-e188335e3bfe-cnibin\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221473    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ef2141c-12a4-456c-aaa6-2562ad662e9e-host\") pod \"node-ca-jvw66\" (UID: \"9ef2141c-12a4-456c-aaa6-2562ad662e9e\") " pod="openshift-image-registry/node-ca-jvw66"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221489    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94fa57f3-07ff-41ed-ba5b-1afa96644e70-hosts-file\") pod \"node-resolver-24pv7\" (UID: \"94fa57f3-07ff-41ed-ba5b-1afa96644e70\") " pod="openshift-dns/node-resolver-24pv7"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221507    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j7x6\" (UniqueName: \"kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6\") pod \"network-check-target-98cxh\" (UID: \"8fac2838-23a2-41f6-bbda-35a421545754\") " pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:39:47.222250 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-slash\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-run-openvswitch\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221705    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db98920a-1284-4df7-b4a8-e188335e3bfe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221732    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jxvj\" (UniqueName: \"kubernetes.io/projected/d138f6c3-773b-455e-9319-85fa4d195585-kube-api-access-6jxvj\") pod \"iptables-alerter-6w99d\" (UID: \"d138f6c3-773b-455e-9319-85fa4d195585\") " pod="openshift-network-operator/iptables-alerter-6w99d"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221731    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db98920a-1284-4df7-b4a8-e188335e3bfe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221787    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-run-k8s-cni-cncf-io\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-var-lib-openvswitch\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221861    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-run-k8s-cni-cncf-io\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221884    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-run-ovn-kubernetes\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221921    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-cni-netd\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221964    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-var-lib-cni-multus\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.221993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94fa57f3-07ff-41ed-ba5b-1afa96644e70-tmp-dir\") pod \"node-resolver-24pv7\" (UID: \"94fa57f3-07ff-41ed-ba5b-1afa96644e70\") " pod="openshift-dns/node-resolver-24pv7"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222006    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-var-lib-cni-multus\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222020    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/724a5d6d-ae9b-40ad-a340-75f587e5f95c-konnectivity-ca\") pod \"konnectivity-agent-g2x7s\" (UID: \"724a5d6d-ae9b-40ad-a340-75f587e5f95c\") " pod="kube-system/konnectivity-agent-g2x7s"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222056    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c146d14-3752-4d60-892c-39f682820d0f-kubelet-config\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222049    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-cni-binary-copy\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222083    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-run\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.223084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222128    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-lib-modules\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222152    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222177    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4shgp\" (UniqueName: \"kubernetes.io/projected/669b823f-324a-4575-9949-eeab012ffeb2-kube-api-access-4shgp\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222218    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-var-lib-kubelet\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prbrk\" (UniqueName: \"kubernetes.io/projected/94fa57f3-07ff-41ed-ba5b-1afa96644e70-kube-api-access-prbrk\") pod \"node-resolver-24pv7\" (UID: \"94fa57f3-07ff-41ed-ba5b-1afa96644e70\") " pod="openshift-dns/node-resolver-24pv7"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222269    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/669b823f-324a-4575-9949-eeab012ffeb2-ovnkube-script-lib\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222283    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-var-lib-kubelet\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222283    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db98920a-1284-4df7-b4a8-e188335e3bfe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222302    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-var-lib-cni-bin\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222337    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94fa57f3-07ff-41ed-ba5b-1afa96644e70-tmp-dir\") pod \"node-resolver-24pv7\" (UID: \"94fa57f3-07ff-41ed-ba5b-1afa96644e70\") " pod="openshift-dns/node-resolver-24pv7"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222344    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-host-var-lib-cni-bin\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-multus-conf-dir\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222485    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs\") pod \"network-metrics-daemon-bxwzf\" (UID: \"fa01cd4e-ab76-429e-aaca-95f1c98c19c1\") " pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blljz\" (UniqueName: \"kubernetes.io/projected/9ef2141c-12a4-456c-aaa6-2562ad662e9e-kube-api-access-blljz\") pod \"node-ca-jvw66\" (UID: \"9ef2141c-12a4-456c-aaa6-2562ad662e9e\") " pod="openshift-image-registry/node-ca-jvw66"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222523    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-multus-conf-dir\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222533    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-sys\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-tmp\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.223927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222613    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-systemd-units\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db98920a-1284-4df7-b4a8-e188335e3bfe-cni-binary-copy\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbb9f\" (UniqueName: \"kubernetes.io/projected/db98920a-1284-4df7-b4a8-e188335e3bfe-kube-api-access-xbb9f\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222703    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-multus-socket-dir-parent\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222729    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-systemd\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222755    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-sys-fs\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222781    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-cni-bin\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222806    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-multus-socket-dir-parent\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222807    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222879    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-etc-kubernetes\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222907    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c146d14-3752-4d60-892c-39f682820d0f-dbus\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222931    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-var-lib-kubelet\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-registration-dir\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.222984    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/669b823f-324a-4575-9949-eeab012ffeb2-ovn-node-metrics-cert\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.223012    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-system-cni-dir\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.223039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-multus-daemon-config\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.223065    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p292p\" (UniqueName: \"kubernetes.io/projected/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-kube-api-access-p292p\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.224823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.223122    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/724a5d6d-ae9b-40ad-a340-75f587e5f95c-agent-certs\") pod \"konnectivity-agent-g2x7s\" (UID: \"724a5d6d-ae9b-40ad-a340-75f587e5f95c\") " pod="kube-system/konnectivity-agent-g2x7s"
Jul 06 13:39:47.225746 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.223153    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9clcc\" (UniqueName: \"kubernetes.io/projected/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-kube-api-access-9clcc\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.225746 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.223180    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-run-ovn\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.225746 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.223182    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db98920a-1284-4df7-b4a8-e188335e3bfe-cni-binary-copy\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.225746 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.223297    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-etc-kubernetes\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.225746 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.223361    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-system-cni-dir\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.225746 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.223637    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-multus-daemon-config\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.229117 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.229070    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 13:39:47.234417 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.234317    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prbrk\" (UniqueName: \"kubernetes.io/projected/94fa57f3-07ff-41ed-ba5b-1afa96644e70-kube-api-access-prbrk\") pod \"node-resolver-24pv7\" (UID: \"94fa57f3-07ff-41ed-ba5b-1afa96644e70\") " pod="openshift-dns/node-resolver-24pv7"
Jul 06 13:39:47.235428 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.235399    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jxvj\" (UniqueName: \"kubernetes.io/projected/d138f6c3-773b-455e-9319-85fa4d195585-kube-api-access-6jxvj\") pod \"iptables-alerter-6w99d\" (UID: \"d138f6c3-773b-455e-9319-85fa4d195585\") " pod="openshift-network-operator/iptables-alerter-6w99d"
Jul 06 13:39:47.235552 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.235444    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p292p\" (UniqueName: \"kubernetes.io/projected/babb6ce9-b53f-4d84-9b28-9a3bd75ed38d-kube-api-access-p292p\") pod \"multus-k7qsv\" (UID: \"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d\") " pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.237625 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.237590    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbb9f\" (UniqueName: \"kubernetes.io/projected/db98920a-1284-4df7-b4a8-e188335e3bfe-kube-api-access-xbb9f\") pod \"multus-additional-cni-plugins-txzrt\" (UID: \"db98920a-1284-4df7-b4a8-e188335e3bfe\") " pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.248389 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.248353    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:39:47.312069 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.311983    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal" event={"ID":"a68539a85cc11dc6f814626af5419522","Type":"ContainerStarted","Data":"d4e717bee4f322f94de65e12280b230d3e49d3cb65602f35598aa8b2e22d0012"}
Jul 06 13:39:47.313328 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.313292    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-86.ec2.internal" event={"ID":"e4917cbac70d3a854e4ffc76b7293bab","Type":"ContainerStarted","Data":"2f66a114d4992c3b75763df3eaab894c9c1327f17b4e0167657d1be75d01fdc7"}
Jul 06 13:39:47.323723 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.323663    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-device-dir\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.323723 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.323725    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-kubelet\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.323775    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-modprobe-d\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.323837    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-device-dir\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.323846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-sysctl-d\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.323913    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khpwm\" (UniqueName: \"kubernetes.io/projected/e91222e6-c320-40fc-95ca-143f548068d7-kube-api-access-khpwm\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.323951    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-kubernetes\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.323874    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-kubelet\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.323975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-host\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.323984    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-sysctl-d\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.323998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.323984    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-modprobe-d\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324028    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-socket-dir\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324030    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-kubernetes\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324047    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-run-systemd\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324051    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-host\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324063    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-etc-openvswitch\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.324072 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324098    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-node-log\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324115    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324122    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-sysctl-conf\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324150    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-run-netns\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324171    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-run-systemd\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-sysconfig\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-log-socket\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324202    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-socket-dir\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324218    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcfsj\" (UniqueName: \"kubernetes.io/projected/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-kube-api-access-zcfsj\") pod \"network-metrics-daemon-bxwzf\" (UID: \"fa01cd4e-ab76-429e-aaca-95f1c98c19c1\") " pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324252    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-run-netns\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324305    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-sysconfig\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324304    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-sysctl-conf\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324336    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-node-log\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324346    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-log-socket\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324462    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ef2141c-12a4-456c-aaa6-2562ad662e9e-host\") pod \"node-ca-jvw66\" (UID: \"9ef2141c-12a4-456c-aaa6-2562ad662e9e\") " pod="openshift-image-registry/node-ca-jvw66"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324517    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-etc-openvswitch\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.324797 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.324561    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.324628    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret podName:4c146d14-3752-4d60-892c-39f682820d0f nodeName:}" failed. No retries permitted until 2026-07-06 13:39:47.824607975 +0000 UTC m=+3.136171623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret") pod "global-pull-secret-syncer-v7pkm" (UID: "4c146d14-3752-4d60-892c-39f682820d0f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324634    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ef2141c-12a4-456c-aaa6-2562ad662e9e-host\") pod \"node-ca-jvw66\" (UID: \"9ef2141c-12a4-456c-aaa6-2562ad662e9e\") " pod="openshift-image-registry/node-ca-jvw66"
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324645    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7x6\" (UniqueName: \"kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6\") pod \"network-check-target-98cxh\" (UID: \"8fac2838-23a2-41f6-bbda-35a421545754\") " pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-slash\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324692    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-run-openvswitch\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324797    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-slash\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324836    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-var-lib-openvswitch\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324866    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-run-ovn-kubernetes\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324885    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-run-openvswitch\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324928    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-var-lib-openvswitch\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324936    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-cni-netd\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-cni-netd\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324971    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-run-ovn-kubernetes\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.324983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/724a5d6d-ae9b-40ad-a340-75f587e5f95c-konnectivity-ca\") pod \"konnectivity-agent-g2x7s\" (UID: \"724a5d6d-ae9b-40ad-a340-75f587e5f95c\") " pod="kube-system/konnectivity-agent-g2x7s"
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325106    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c146d14-3752-4d60-892c-39f682820d0f-kubelet-config\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:47.325615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325134    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-run\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325151    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-lib-modules\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325211    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4shgp\" (UniqueName: \"kubernetes.io/projected/669b823f-324a-4575-9949-eeab012ffeb2-kube-api-access-4shgp\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325235    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-run\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325260    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/669b823f-324a-4575-9949-eeab012ffeb2-ovnkube-script-lib\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325285    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs\") pod \"network-metrics-daemon-bxwzf\" (UID: \"fa01cd4e-ab76-429e-aaca-95f1c98c19c1\") " pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325295    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c146d14-3752-4d60-892c-39f682820d0f-kubelet-config\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blljz\" (UniqueName: \"kubernetes.io/projected/9ef2141c-12a4-456c-aaa6-2562ad662e9e-kube-api-access-blljz\") pod \"node-ca-jvw66\" (UID: \"9ef2141c-12a4-456c-aaa6-2562ad662e9e\") " pod="openshift-image-registry/node-ca-jvw66"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325323    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-lib-modules\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325400    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.325451    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325481    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-sys\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.325507    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs podName:fa01cd4e-ab76-429e-aaca-95f1c98c19c1 nodeName:}" failed. No retries permitted until 2026-07-06 13:39:47.825488004 +0000 UTC m=+3.137051654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs") pod "network-metrics-daemon-bxwzf" (UID: "fa01cd4e-ab76-429e-aaca-95f1c98c19c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-tmp\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325545    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-sys\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325559    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-systemd-units\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.327026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325588    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-systemd\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-sys-fs\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325618    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-systemd-units\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325650    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-cni-bin\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325679    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-systemd\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325703    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/724a5d6d-ae9b-40ad-a340-75f587e5f95c-konnectivity-ca\") pod \"konnectivity-agent-g2x7s\" (UID: \"724a5d6d-ae9b-40ad-a340-75f587e5f95c\") " pod="kube-system/konnectivity-agent-g2x7s"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325716    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-cni-bin\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325723    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325681    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325769    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-sys-fs\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325779    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c146d14-3752-4d60-892c-39f682820d0f-dbus\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-var-lib-kubelet\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325827    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c146d14-3752-4d60-892c-39f682820d0f-dbus\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325832    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-registration-dir\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325861    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/669b823f-324a-4575-9949-eeab012ffeb2-ovn-node-metrics-cert\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325872    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-var-lib-kubelet\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/724a5d6d-ae9b-40ad-a340-75f587e5f95c-agent-certs\") pod \"konnectivity-agent-g2x7s\" (UID: \"724a5d6d-ae9b-40ad-a340-75f587e5f95c\") " pod="kube-system/konnectivity-agent-g2x7s"
Jul 06 13:39:47.328056 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325912    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e91222e6-c320-40fc-95ca-143f548068d7-registration-dir\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.328965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325920    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9clcc\" (UniqueName: \"kubernetes.io/projected/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-kube-api-access-9clcc\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.328965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.325974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-run-ovn\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.328965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.326018    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/669b823f-324a-4575-9949-eeab012ffeb2-ovnkube-script-lib\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.328965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.326027    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ef2141c-12a4-456c-aaa6-2562ad662e9e-serviceca\") pod \"node-ca-jvw66\" (UID: \"9ef2141c-12a4-456c-aaa6-2562ad662e9e\") " pod="openshift-image-registry/node-ca-jvw66"
Jul 06 13:39:47.328965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.326087    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/669b823f-324a-4575-9949-eeab012ffeb2-run-ovn\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.328965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.326091    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/669b823f-324a-4575-9949-eeab012ffeb2-ovnkube-config\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.328965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.326148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-tuned\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.328965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.326300    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/669b823f-324a-4575-9949-eeab012ffeb2-env-overrides\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.328965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.326550    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/669b823f-324a-4575-9949-eeab012ffeb2-ovnkube-config\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.328965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.326629    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ef2141c-12a4-456c-aaa6-2562ad662e9e-serviceca\") pod \"node-ca-jvw66\" (UID: \"9ef2141c-12a4-456c-aaa6-2562ad662e9e\") " pod="openshift-image-registry/node-ca-jvw66"
Jul 06 13:39:47.328965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.326878    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/669b823f-324a-4575-9949-eeab012ffeb2-env-overrides\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.328965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.328482    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/669b823f-324a-4575-9949-eeab012ffeb2-ovn-node-metrics-cert\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.328965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.328706    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-tmp\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.328965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.328782    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/724a5d6d-ae9b-40ad-a340-75f587e5f95c-agent-certs\") pod \"konnectivity-agent-g2x7s\" (UID: \"724a5d6d-ae9b-40ad-a340-75f587e5f95c\") " pod="kube-system/konnectivity-agent-g2x7s"
Jul 06 13:39:47.329786 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.329449    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-etc-tuned\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.337748 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.337661    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcfsj\" (UniqueName: \"kubernetes.io/projected/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-kube-api-access-zcfsj\") pod \"network-metrics-daemon-bxwzf\" (UID: \"fa01cd4e-ab76-429e-aaca-95f1c98c19c1\") " pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:47.338123 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.338094    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:39:47.338123 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.338126    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:39:47.338123 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.338144    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7j7x6 for pod openshift-network-diagnostics/network-check-target-98cxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:39:47.338379 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.338160    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9clcc\" (UniqueName: \"kubernetes.io/projected/9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0-kube-api-access-9clcc\") pod \"tuned-flf7k\" (UID: \"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0\") " pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.338379 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.338242    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6 podName:8fac2838-23a2-41f6-bbda-35a421545754 nodeName:}" failed. No retries permitted until 2026-07-06 13:39:47.838218197 +0000 UTC m=+3.149781869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7j7x6" (UniqueName: "kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6") pod "network-check-target-98cxh" (UID: "8fac2838-23a2-41f6-bbda-35a421545754") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:39:47.340032 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.339817    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4shgp\" (UniqueName: \"kubernetes.io/projected/669b823f-324a-4575-9949-eeab012ffeb2-kube-api-access-4shgp\") pod \"ovnkube-node-9gnwx\" (UID: \"669b823f-324a-4575-9949-eeab012ffeb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.341642 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.341617    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blljz\" (UniqueName: \"kubernetes.io/projected/9ef2141c-12a4-456c-aaa6-2562ad662e9e-kube-api-access-blljz\") pod \"node-ca-jvw66\" (UID: \"9ef2141c-12a4-456c-aaa6-2562ad662e9e\") " pod="openshift-image-registry/node-ca-jvw66"
Jul 06 13:39:47.342635 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.342610    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khpwm\" (UniqueName: \"kubernetes.io/projected/e91222e6-c320-40fc-95ca-143f548068d7-kube-api-access-khpwm\") pod \"aws-ebs-csi-driver-node-7xcf6\" (UID: \"e91222e6-c320-40fc-95ca-143f548068d7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.414374 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.414335    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-txzrt"
Jul 06 13:39:47.424227 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.424190    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6w99d"
Jul 06 13:39:47.435621 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.435584    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k7qsv"
Jul 06 13:39:47.443101 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.443047    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-24pv7"
Jul 06 13:39:47.452339 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.452305    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jvw66"
Jul 06 13:39:47.461787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.461744    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g2x7s"
Jul 06 13:39:47.472184 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.472144    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-flf7k"
Jul 06 13:39:47.480671 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.480605    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6"
Jul 06 13:39:47.490089 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.490046    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:39:47.831135 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.831098    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:47.831305 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.831175    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs\") pod \"network-metrics-daemon-bxwzf\" (UID: \"fa01cd4e-ab76-429e-aaca-95f1c98c19c1\") " pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:47.831305 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.831272    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:39:47.831418 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.831305    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:39:47.831418 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.831353    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret podName:4c146d14-3752-4d60-892c-39f682820d0f nodeName:}" failed. No retries permitted until 2026-07-06 13:39:48.831327681 +0000 UTC m=+4.142891347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret") pod "global-pull-secret-syncer-v7pkm" (UID: "4c146d14-3752-4d60-892c-39f682820d0f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:39:47.831418 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.831371    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs podName:fa01cd4e-ab76-429e-aaca-95f1c98c19c1 nodeName:}" failed. No retries permitted until 2026-07-06 13:39:48.831363363 +0000 UTC m=+4.142927010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs") pod "network-metrics-daemon-bxwzf" (UID: "fa01cd4e-ab76-429e-aaca-95f1c98c19c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:39:47.931868 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:47.931826    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7x6\" (UniqueName: \"kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6\") pod \"network-check-target-98cxh\" (UID: \"8fac2838-23a2-41f6-bbda-35a421545754\") " pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:39:47.932095 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.931978    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:39:47.932095 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.932002    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:39:47.932095 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.932017    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7j7x6 for pod openshift-network-diagnostics/network-check-target-98cxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:39:47.932279 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:47.932099    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6 podName:8fac2838-23a2-41f6-bbda-35a421545754 nodeName:}" failed. No retries permitted until 2026-07-06 13:39:48.93206537 +0000 UTC m=+4.243629039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7j7x6" (UniqueName: "kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6") pod "network-check-target-98cxh" (UID: "8fac2838-23a2-41f6-bbda-35a421545754") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:39:48.035381 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:48.035352    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:39:48.151958 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:48.151856    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 13:34:47 +0000 UTC" deadline="2028-01-02 22:10:40.329717793 +0000 UTC"
Jul 06 13:39:48.151958 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:48.151910    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13088h30m52.1778128s"
Jul 06 13:39:48.308351 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:48.308307    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:39:48.308351 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:48.308350    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:48.308577 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:48.308467    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:39:48.308646 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:48.308621    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:39:48.455759 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:48.455725    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbabb6ce9_b53f_4d84_9b28_9a3bd75ed38d.slice/crio-547c465ff631c3f8b63dafc676b9bf359be0a3d6b2b5332a6417029d76ac0b39 WatchSource:0}: Error finding container 547c465ff631c3f8b63dafc676b9bf359be0a3d6b2b5332a6417029d76ac0b39: Status 404 returned error can't find the container with id 547c465ff631c3f8b63dafc676b9bf359be0a3d6b2b5332a6417029d76ac0b39
Jul 06 13:39:48.456541 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:48.456504    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef2141c_12a4_456c_aaa6_2562ad662e9e.slice/crio-ff887417be459390024777409d08ec1c5a5bdc96ae6a9c7297891d9e513dcfbe WatchSource:0}: Error finding container ff887417be459390024777409d08ec1c5a5bdc96ae6a9c7297891d9e513dcfbe: Status 404 returned error can't find the container with id ff887417be459390024777409d08ec1c5a5bdc96ae6a9c7297891d9e513dcfbe
Jul 06 13:39:48.457508 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:48.457416    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669b823f_324a_4575_9949_eeab012ffeb2.slice/crio-7c3a1e1bb759a54938fbe0f03fb4e0f0249754c51b83e776d4885a274e734571 WatchSource:0}: Error finding container 7c3a1e1bb759a54938fbe0f03fb4e0f0249754c51b83e776d4885a274e734571: Status 404 returned error can't find the container with id 7c3a1e1bb759a54938fbe0f03fb4e0f0249754c51b83e776d4885a274e734571
Jul 06 13:39:48.483719 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:48.483651    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f3bdcc0_1b6b_47d8_bce9_d7f6ead5aff0.slice/crio-dccb0d9bf5318ebf6127b345cf4729b7e01fbc80d5d308ab0cc1fcf44535f73a WatchSource:0}: Error finding container dccb0d9bf5318ebf6127b345cf4729b7e01fbc80d5d308ab0cc1fcf44535f73a: Status 404 returned error can't find the container with id dccb0d9bf5318ebf6127b345cf4729b7e01fbc80d5d308ab0cc1fcf44535f73a
Jul 06 13:39:48.484980 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:48.484952    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91222e6_c320_40fc_95ca_143f548068d7.slice/crio-a98342c6f0d60c5fbc459fc59ccbe782e22d925e7fa5a80ba4eb45f2cef52f01 WatchSource:0}: Error finding container a98342c6f0d60c5fbc459fc59ccbe782e22d925e7fa5a80ba4eb45f2cef52f01: Status 404 returned error can't find the container with id a98342c6f0d60c5fbc459fc59ccbe782e22d925e7fa5a80ba4eb45f2cef52f01
Jul 06 13:39:48.485883 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:48.485862    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod724a5d6d_ae9b_40ad_a340_75f587e5f95c.slice/crio-80b5807a365b9fb31e111b05eabea8b97006102dbbad9bc7bfe161270912c95c WatchSource:0}: Error finding container 80b5807a365b9fb31e111b05eabea8b97006102dbbad9bc7bfe161270912c95c: Status 404 returned error can't find the container with id 80b5807a365b9fb31e111b05eabea8b97006102dbbad9bc7bfe161270912c95c
Jul 06 13:39:48.486567 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:48.486541    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94fa57f3_07ff_41ed_ba5b_1afa96644e70.slice/crio-5200c576768f1cdb5f8b89909898807fdd24f0b615e6dc5194fe596ca1749999 WatchSource:0}: Error finding container 5200c576768f1cdb5f8b89909898807fdd24f0b615e6dc5194fe596ca1749999: Status 404 returned error can't find the container with id 5200c576768f1cdb5f8b89909898807fdd24f0b615e6dc5194fe596ca1749999
Jul 06 13:39:48.488643 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:39:48.488597    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd138f6c3_773b_455e_9319_85fa4d195585.slice/crio-0b5cb3718591afc09252976364d1d215e7905b93985426782cec20cd3c93b07a WatchSource:0}: Error finding container 0b5cb3718591afc09252976364d1d215e7905b93985426782cec20cd3c93b07a: Status 404 returned error can't find the container with id 0b5cb3718591afc09252976364d1d215e7905b93985426782cec20cd3c93b07a
Jul 06 13:39:48.840326 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:48.840043    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs\") pod \"network-metrics-daemon-bxwzf\" (UID: \"fa01cd4e-ab76-429e-aaca-95f1c98c19c1\") " pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:48.840514 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:48.840273    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:39:48.840514 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:48.840424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:48.840514 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:48.840492    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs podName:fa01cd4e-ab76-429e-aaca-95f1c98c19c1 nodeName:}" failed. No retries permitted until 2026-07-06 13:39:50.840470253 +0000 UTC m=+6.152033916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs") pod "network-metrics-daemon-bxwzf" (UID: "fa01cd4e-ab76-429e-aaca-95f1c98c19c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:39:48.840702 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:48.840562    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:39:48.840702 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:48.840612    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret podName:4c146d14-3752-4d60-892c-39f682820d0f nodeName:}" failed. No retries permitted until 2026-07-06 13:39:50.840597435 +0000 UTC m=+6.152161082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret") pod "global-pull-secret-syncer-v7pkm" (UID: "4c146d14-3752-4d60-892c-39f682820d0f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:39:48.941130 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:48.941090    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7x6\" (UniqueName: \"kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6\") pod \"network-check-target-98cxh\" (UID: \"8fac2838-23a2-41f6-bbda-35a421545754\") " pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:39:48.941342 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:48.941287    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:39:48.941342 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:48.941311    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:39:48.941342 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:48.941324    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7j7x6 for pod openshift-network-diagnostics/network-check-target-98cxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:39:48.941520 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:48.941388    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6 podName:8fac2838-23a2-41f6-bbda-35a421545754 nodeName:}" failed. No retries permitted until 2026-07-06 13:39:50.941368703 +0000 UTC m=+6.252932368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7j7x6" (UniqueName: "kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6") pod "network-check-target-98cxh" (UID: "8fac2838-23a2-41f6-bbda-35a421545754") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:39:49.153139 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.153078    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 13:34:47 +0000 UTC" deadline="2028-04-10 02:48:06.278518176 +0000 UTC"
Jul 06 13:39:49.153139 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.153122    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15445h8m17.125401407s"
Jul 06 13:39:49.311208 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.310585    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:49.311208 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:49.310801    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:39:49.349004 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.345620    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-86.ec2.internal" event={"ID":"e4917cbac70d3a854e4ffc76b7293bab","Type":"ContainerStarted","Data":"deefb430f1b08f2d33c4631c532cb009a551ee4bdf2b1319f578035ad06b3a15"}
Jul 06 13:39:49.353169 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.353020    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-24pv7" event={"ID":"94fa57f3-07ff-41ed-ba5b-1afa96644e70","Type":"ContainerStarted","Data":"5200c576768f1cdb5f8b89909898807fdd24f0b615e6dc5194fe596ca1749999"}
Jul 06 13:39:49.363718 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.363537    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g2x7s" event={"ID":"724a5d6d-ae9b-40ad-a340-75f587e5f95c","Type":"ContainerStarted","Data":"80b5807a365b9fb31e111b05eabea8b97006102dbbad9bc7bfe161270912c95c"}
Jul 06 13:39:49.368006 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.367923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-flf7k" event={"ID":"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0","Type":"ContainerStarted","Data":"dccb0d9bf5318ebf6127b345cf4729b7e01fbc80d5d308ab0cc1fcf44535f73a"}
Jul 06 13:39:49.389607 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.389562    2573 generic.go:356] "Generic (PLEG): container finished" podID="a68539a85cc11dc6f814626af5419522" containerID="d72b4656b044f0f7da06f69d52f1fb67eb0f6d4896ea4edf3813806cb0cb99f0" exitCode=0
Jul 06 13:39:49.389790 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.389688    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal" event={"ID":"a68539a85cc11dc6f814626af5419522","Type":"ContainerDied","Data":"d72b4656b044f0f7da06f69d52f1fb67eb0f6d4896ea4edf3813806cb0cb99f0"}
Jul 06 13:39:49.399766 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.399655    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6w99d" event={"ID":"d138f6c3-773b-455e-9319-85fa4d195585","Type":"ContainerStarted","Data":"0b5cb3718591afc09252976364d1d215e7905b93985426782cec20cd3c93b07a"}
Jul 06 13:39:49.407251 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.407042    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6" event={"ID":"e91222e6-c320-40fc-95ca-143f548068d7","Type":"ContainerStarted","Data":"a98342c6f0d60c5fbc459fc59ccbe782e22d925e7fa5a80ba4eb45f2cef52f01"}
Jul 06 13:39:49.409213 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.407958    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-86.ec2.internal" podStartSLOduration=3.407939403 podStartE2EDuration="3.407939403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:39:49.365472731 +0000 UTC m=+4.677036404" watchObservedRunningTime="2026-07-06 13:39:49.407939403 +0000 UTC m=+4.719503074"
Jul 06 13:39:49.421949 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.421786    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx" event={"ID":"669b823f-324a-4575-9949-eeab012ffeb2","Type":"ContainerStarted","Data":"7c3a1e1bb759a54938fbe0f03fb4e0f0249754c51b83e776d4885a274e734571"}
Jul 06 13:39:49.437325 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.437280    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jvw66" event={"ID":"9ef2141c-12a4-456c-aaa6-2562ad662e9e","Type":"ContainerStarted","Data":"ff887417be459390024777409d08ec1c5a5bdc96ae6a9c7297891d9e513dcfbe"}
Jul 06 13:39:49.443851 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.443813    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k7qsv" event={"ID":"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d","Type":"ContainerStarted","Data":"547c465ff631c3f8b63dafc676b9bf359be0a3d6b2b5332a6417029d76ac0b39"}
Jul 06 13:39:49.457910 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:49.457871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txzrt" event={"ID":"db98920a-1284-4df7-b4a8-e188335e3bfe","Type":"ContainerStarted","Data":"22a084bb6f56ea620f8b6c4a6802bfc80c2a4986ebe9e9b0e0fdd3bb23439eab"}
Jul 06 13:39:50.308757 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:50.308022    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:39:50.308757 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:50.308174    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:39:50.308757 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:50.308590    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:50.308757 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:50.308703    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:39:50.469412 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:50.469375    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal" event={"ID":"a68539a85cc11dc6f814626af5419522","Type":"ContainerStarted","Data":"366240565aaa0235706a6cab78c38cf462d65f1c1d6eb1f1661f8febb653226c"}
Jul 06 13:39:50.498044 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:50.497299    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-86.ec2.internal" podStartSLOduration=4.497273257 podStartE2EDuration="4.497273257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:39:50.496851061 +0000 UTC m=+5.808414757" watchObservedRunningTime="2026-07-06 13:39:50.497273257 +0000 UTC m=+5.808836930"
Jul 06 13:39:50.862013 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:50.861973    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:50.862280 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:50.862048    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs\") pod \"network-metrics-daemon-bxwzf\" (UID: \"fa01cd4e-ab76-429e-aaca-95f1c98c19c1\") " pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:50.862280 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:50.862232    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:39:50.862425 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:50.862300    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs podName:fa01cd4e-ab76-429e-aaca-95f1c98c19c1 nodeName:}" failed. No retries permitted until 2026-07-06 13:39:54.86227996 +0000 UTC m=+10.173843623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs") pod "network-metrics-daemon-bxwzf" (UID: "fa01cd4e-ab76-429e-aaca-95f1c98c19c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:39:50.862885 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:50.862717    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:39:50.862885 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:50.862770    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret podName:4c146d14-3752-4d60-892c-39f682820d0f nodeName:}" failed. No retries permitted until 2026-07-06 13:39:54.862754188 +0000 UTC m=+10.174317856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret") pod "global-pull-secret-syncer-v7pkm" (UID: "4c146d14-3752-4d60-892c-39f682820d0f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:39:50.963253 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:50.963210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7x6\" (UniqueName: \"kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6\") pod \"network-check-target-98cxh\" (UID: \"8fac2838-23a2-41f6-bbda-35a421545754\") " pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:39:50.963436 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:50.963378    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:39:50.963436 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:50.963401    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:39:50.963436 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:50.963413    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7j7x6 for pod openshift-network-diagnostics/network-check-target-98cxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:39:50.963615 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:50.963475    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6 podName:8fac2838-23a2-41f6-bbda-35a421545754 nodeName:}" failed. No retries permitted until 2026-07-06 13:39:54.963454991 +0000 UTC m=+10.275018638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7j7x6" (UniqueName: "kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6") pod "network-check-target-98cxh" (UID: "8fac2838-23a2-41f6-bbda-35a421545754") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:39:51.308358 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:51.308270    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:51.308518 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:51.308415    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:39:52.308107 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:52.307939    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:39:52.308107 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:52.307976    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:52.308107 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:52.308093    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:39:52.308738 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:52.308218    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:39:53.307724 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:53.307625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:53.307913 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:53.307777    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:39:54.308203 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:54.307959    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:54.308203 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:54.308123    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:39:54.308203 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:54.307958    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:39:54.308804 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:54.308336    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:39:54.897740 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:54.897465    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:54.897740 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:54.897549    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs\") pod \"network-metrics-daemon-bxwzf\" (UID: \"fa01cd4e-ab76-429e-aaca-95f1c98c19c1\") " pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:54.897740 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:54.897581    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:39:54.897740 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:54.897657    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret podName:4c146d14-3752-4d60-892c-39f682820d0f nodeName:}" failed. No retries permitted until 2026-07-06 13:40:02.897637927 +0000 UTC m=+18.209201585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret") pod "global-pull-secret-syncer-v7pkm" (UID: "4c146d14-3752-4d60-892c-39f682820d0f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:39:54.897740 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:54.897679    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:39:54.897740 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:54.897714    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs podName:fa01cd4e-ab76-429e-aaca-95f1c98c19c1 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:02.8977035 +0000 UTC m=+18.209267149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs") pod "network-metrics-daemon-bxwzf" (UID: "fa01cd4e-ab76-429e-aaca-95f1c98c19c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:39:54.998371 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:54.998276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7x6\" (UniqueName: \"kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6\") pod \"network-check-target-98cxh\" (UID: \"8fac2838-23a2-41f6-bbda-35a421545754\") " pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:39:54.998557 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:54.998439    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:39:54.998557 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:54.998468    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:39:54.998557 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:54.998484    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7j7x6 for pod openshift-network-diagnostics/network-check-target-98cxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:39:54.998557 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:54.998550    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6 podName:8fac2838-23a2-41f6-bbda-35a421545754 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:02.998531352 +0000 UTC m=+18.310095007 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7j7x6" (UniqueName: "kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6") pod "network-check-target-98cxh" (UID: "8fac2838-23a2-41f6-bbda-35a421545754") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:39:55.309976 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:55.309405    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:55.309976 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:55.309531    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:39:56.308409 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:56.308001    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:39:56.308409 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:56.308187    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:39:56.308693 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:56.308673    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:56.309199 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:56.308813    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:39:57.307985 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:57.307894    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:57.308598 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:57.308038    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:39:58.308258 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:58.308224    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:39:58.308750 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:58.308224    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:39:58.308750 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:58.308402    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:39:58.308750 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:58.308485    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:39:59.307592 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:39:59.307556    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:39:59.307737 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:39:59.307681    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:40:00.307974 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:00.307936    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:00.308478 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:00.307941    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:00.308478 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:00.308085    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:40:00.308478 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:00.308197    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:40:01.308407 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:01.308351    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:01.308809 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:01.308507    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:40:02.307607 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:02.307567    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:02.307607 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:02.307600    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:02.307854 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:02.307698    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:40:02.307854 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:02.307840    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:40:02.961684 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:02.961640    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:02.962179 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:02.961710    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs\") pod \"network-metrics-daemon-bxwzf\" (UID: \"fa01cd4e-ab76-429e-aaca-95f1c98c19c1\") " pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:02.962179 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:02.961800    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:40:02.962179 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:02.961822    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:40:02.962179 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:02.961881    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret podName:4c146d14-3752-4d60-892c-39f682820d0f nodeName:}" failed. No retries permitted until 2026-07-06 13:40:18.96186162 +0000 UTC m=+34.273425265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret") pod "global-pull-secret-syncer-v7pkm" (UID: "4c146d14-3752-4d60-892c-39f682820d0f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:40:02.962179 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:02.961898    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs podName:fa01cd4e-ab76-429e-aaca-95f1c98c19c1 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:18.961891464 +0000 UTC m=+34.273455110 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs") pod "network-metrics-daemon-bxwzf" (UID: "fa01cd4e-ab76-429e-aaca-95f1c98c19c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:40:03.062781 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:03.062686    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7x6\" (UniqueName: \"kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6\") pod \"network-check-target-98cxh\" (UID: \"8fac2838-23a2-41f6-bbda-35a421545754\") " pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:03.062948 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:03.062864    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:40:03.062948 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:03.062891    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:40:03.062948 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:03.062904    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7j7x6 for pod openshift-network-diagnostics/network-check-target-98cxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:40:03.063122 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:03.062964    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6 podName:8fac2838-23a2-41f6-bbda-35a421545754 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:19.062950219 +0000 UTC m=+34.374513885 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7j7x6" (UniqueName: "kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6") pod "network-check-target-98cxh" (UID: "8fac2838-23a2-41f6-bbda-35a421545754") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:40:03.308210 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:03.308172    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:03.308400 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:03.308320    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:40:04.308281 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:04.308241    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:04.308281 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:04.308282    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:04.308824 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:04.308406    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:40:04.308824 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:04.308536    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:40:05.309191 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:05.309147    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:05.309657 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:05.309254    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:40:06.308031 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:06.307995    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:06.308031 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:06.308026    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:06.308259 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:06.308134    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:40:06.308335 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:06.308274    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:40:07.310808 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:07.310787    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:07.311184 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:07.310912    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:40:07.512131 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:07.511418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jvw66" event={"ID":"9ef2141c-12a4-456c-aaa6-2562ad662e9e","Type":"ContainerStarted","Data":"44e2d2d5ccba72098c77bb43d46e059992732c515a791ced34f9cb06097c7986"}
Jul 06 13:40:07.517146 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:07.516742    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g2x7s" event={"ID":"724a5d6d-ae9b-40ad-a340-75f587e5f95c","Type":"ContainerStarted","Data":"e2c1bae9ed7bbaf6094222ebae5b9e24ce5e6bfa3f29976361e9cd4b0055df8d"}
Jul 06 13:40:07.519494 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:07.519122    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-flf7k" event={"ID":"9f3bdcc0-1b6b-47d8-bce9-d7f6ead5aff0","Type":"ContainerStarted","Data":"3c3583abfbf4f824b5ed794c36901111224c5f593bedc2d6b41c4f7e6fb4461c"}
Jul 06 13:40:07.520895 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:07.520850    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx" event={"ID":"669b823f-324a-4575-9949-eeab012ffeb2","Type":"ContainerStarted","Data":"cfdb68fddf3e385dbd91d4d9c85097071825ea440ce8e71db6541d96699abb5c"}
Jul 06 13:40:07.534872 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:07.534828    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jvw66" podStartSLOduration=2.729383282 podStartE2EDuration="21.534813401s" totalImagesPullingTime="18.805430119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:07.53419982 +0000 UTC m=+22.845763490" watchObservedRunningTime="2026-07-06 13:40:07.534813401 +0000 UTC m=+22.846377067"
Jul 06 13:40:07.565353 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:07.565307    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g2x7s" podStartSLOduration=7.300475732 podStartE2EDuration="21.565289866s" totalImagesPullingTime="14.264814134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:07.564705353 +0000 UTC m=+22.876269021" watchObservedRunningTime="2026-07-06 13:40:07.565289866 +0000 UTC m=+22.876853533"
Jul 06 13:40:08.307930 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.307686    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:08.308178 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:08.308063    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:40:08.308369 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.307703    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:08.308418 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:08.308380    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:40:08.523475 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.523439    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6" event={"ID":"e91222e6-c320-40fc-95ca-143f548068d7","Type":"ContainerStarted","Data":"177d7b4f76dfc8b4e2f252f26920153b2888ccbd9d2c1f54739db8c65b50e4c0"}
Jul 06 13:40:08.526191 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.526168    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 13:40:08.526494 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.526471    2573 generic.go:356] "Generic (PLEG): container finished" podID="669b823f-324a-4575-9949-eeab012ffeb2" containerID="ff17065dad7ec6aa40cb70c08cd3bda5fc5b11184757a0b23fcf7b86d75ff5f7" exitCode=1
Jul 06 13:40:08.526563 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.526545    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx" event={"ID":"669b823f-324a-4575-9949-eeab012ffeb2","Type":"ContainerStarted","Data":"ca7937f311cf89b8ff4f51ca3e3ffd9dee292009582e1ee4d2ec9a2c7dda451b"}
Jul 06 13:40:08.526627 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.526615    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx" event={"ID":"669b823f-324a-4575-9949-eeab012ffeb2","Type":"ContainerStarted","Data":"9fecd345e3c5d278e837b8a1bcaf896663ed0ff9fb6720f967eab3ec68f6c465"}
Jul 06 13:40:08.526683 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.526653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx" event={"ID":"669b823f-324a-4575-9949-eeab012ffeb2","Type":"ContainerStarted","Data":"6cf7620ef4bef2d968b2ffd6e5d5271a594a916c7eccf240aa092ee1404531a2"}
Jul 06 13:40:08.526683 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.526681    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx" event={"ID":"669b823f-324a-4575-9949-eeab012ffeb2","Type":"ContainerStarted","Data":"465bc3ce2edacc46242f3273f792e877fdc5f6b4c75372dd09d3a1f59acc7d44"}
Jul 06 13:40:08.526760 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.526717    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx" event={"ID":"669b823f-324a-4575-9949-eeab012ffeb2","Type":"ContainerDied","Data":"ff17065dad7ec6aa40cb70c08cd3bda5fc5b11184757a0b23fcf7b86d75ff5f7"}
Jul 06 13:40:08.527955 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.527933    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k7qsv" event={"ID":"babb6ce9-b53f-4d84-9b28-9a3bd75ed38d","Type":"ContainerStarted","Data":"3dc64ca7a1df7832b74fdbfe6c683edf7c973453651f1d00a2e3d40561bf6fad"}
Jul 06 13:40:08.529281 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.529257    2573 generic.go:356] "Generic (PLEG): container finished" podID="db98920a-1284-4df7-b4a8-e188335e3bfe" containerID="d97bd21f8c3e0c147de4918f4ecd93cce55cd69ce95f1f11dd5e858b5c7c9f11" exitCode=0
Jul 06 13:40:08.529391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.529335    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txzrt" event={"ID":"db98920a-1284-4df7-b4a8-e188335e3bfe","Type":"ContainerDied","Data":"d97bd21f8c3e0c147de4918f4ecd93cce55cd69ce95f1f11dd5e858b5c7c9f11"}
Jul 06 13:40:08.530807 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.530747    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-24pv7" event={"ID":"94fa57f3-07ff-41ed-ba5b-1afa96644e70","Type":"ContainerStarted","Data":"4da5c84ae53079c10728f9e58a8e3abe3a9b02537e7dbc67afc6df1a51d22c68"}
Jul 06 13:40:08.553953 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.553901    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k7qsv" podStartSLOduration=3.708423035 podStartE2EDuration="22.553886274s" totalImagesPullingTime="18.845463239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:08.553297039 +0000 UTC m=+23.864860720" watchObservedRunningTime="2026-07-06 13:40:08.553886274 +0000 UTC m=+23.865449936"
Jul 06 13:40:08.554150 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.554105    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-flf7k" podStartSLOduration=3.733453198 podStartE2EDuration="22.554086243s" totalImagesPullingTime="18.820633045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:07.611780061 +0000 UTC m=+22.923343729" watchObservedRunningTime="2026-07-06 13:40:08.554086243 +0000 UTC m=+23.865649909"
Jul 06 13:40:08.599308 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.599246    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-24pv7" podStartSLOduration=3.802139842 podStartE2EDuration="22.599229417s" totalImagesPullingTime="18.797089575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:08.598812703 +0000 UTC m=+23.910376388" watchObservedRunningTime="2026-07-06 13:40:08.599229417 +0000 UTC m=+23.910793082"
Jul 06 13:40:08.975237 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:08.975204    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 13:40:09.208269 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:09.208112    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T13:40:08.975226703Z","UUID":"895a5526-270d-4df0-982d-03649a3277dd","Handler":null,"Name":"","Endpoint":""}
Jul 06 13:40:09.209561 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:09.209541    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 13:40:09.209678 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:09.209570    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 13:40:09.311559 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:09.311531    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:09.311728 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:09.311642    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:40:09.535386 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:09.535291    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6w99d" event={"ID":"d138f6c3-773b-455e-9319-85fa4d195585","Type":"ContainerStarted","Data":"2f07937506da69854e32d399dfab3021ee408c93dd72dee19b1976e921365be1"}
Jul 06 13:40:09.538271 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:09.538046    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6" event={"ID":"e91222e6-c320-40fc-95ca-143f548068d7","Type":"ContainerStarted","Data":"12d70e3dc7bc69cde8c84e9cbae7659f52e72562f367f8bc53eee151f292edf0"}
Jul 06 13:40:09.673855 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:09.673822    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g2x7s"
Jul 06 13:40:09.674544 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:09.674521    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g2x7s"
Jul 06 13:40:09.697688 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:09.697631    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6w99d" podStartSLOduration=5.880703707 podStartE2EDuration="24.697608086s" totalImagesPullingTime="18.816904379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:09.552546678 +0000 UTC m=+24.864110348" watchObservedRunningTime="2026-07-06 13:40:09.697608086 +0000 UTC m=+25.009172125"
Jul 06 13:40:10.307561 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:10.307472    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:10.307709 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:10.307481    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:10.307709 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:10.307596    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:40:10.307709 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:10.307702    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:40:10.543218 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:10.543174    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6" event={"ID":"e91222e6-c320-40fc-95ca-143f548068d7","Type":"ContainerStarted","Data":"efd84a080bbca3e36076e1c894e3c4ce855703187c109fc039eff093b88f1d38"}
Jul 06 13:40:10.546572 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:10.546547    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 13:40:10.547032 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:10.547007    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx" event={"ID":"669b823f-324a-4575-9949-eeab012ffeb2","Type":"ContainerStarted","Data":"f437e2b9d4386809834d557883bc8fcfa4208fe03646e0c9da002c8f8b23b572"}
Jul 06 13:40:10.547298 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:10.547284    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g2x7s"
Jul 06 13:40:10.547753 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:10.547736    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g2x7s"
Jul 06 13:40:10.566063 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:10.565945    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xcf6" podStartSLOduration=3.752165353 podStartE2EDuration="24.565928401s" totalImagesPullingTime="20.813763048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:10.565486986 +0000 UTC m=+25.877050667" watchObservedRunningTime="2026-07-06 13:40:10.565928401 +0000 UTC m=+25.877492068"
Jul 06 13:40:11.311900 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:11.311695    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:11.312106 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:11.311998    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:40:12.308374 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:12.308315    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:12.308800 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:12.308463    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:40:12.308800 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:12.308509    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:12.308800 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:12.308617    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:40:13.307866 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:13.307837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:13.307987 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:13.307954    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:40:13.557785 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:13.557570    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 13:40:13.558496 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:13.558095    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx" event={"ID":"669b823f-324a-4575-9949-eeab012ffeb2","Type":"ContainerStarted","Data":"e3d4bf94de0f9e3a514830382efa4b701d87ae0976f2fe9a8b7234f2865460fe"}
Jul 06 13:40:13.558496 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:13.558315    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:40:13.558496 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:13.558486    2573 scope.go:117] "RemoveContainer" containerID="ff17065dad7ec6aa40cb70c08cd3bda5fc5b11184757a0b23fcf7b86d75ff5f7"
Jul 06 13:40:13.574017 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:13.573989    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:40:14.308007 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:14.307971    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:14.308168 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:14.307976    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:14.308168 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:14.308110    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:40:14.308168 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:14.308153    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:40:14.565353 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:14.565270    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 13:40:14.565787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:14.565712    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx" event={"ID":"669b823f-324a-4575-9949-eeab012ffeb2","Type":"ContainerStarted","Data":"deb7feca63e1f944b3591c2ef41c5b368ccf5d630e0d839f3d26f2c79bf1df28"}
Jul 06 13:40:14.565963 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:14.565941    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:40:14.566046 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:14.566013    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:40:14.567732 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:14.567709    2573 generic.go:356] "Generic (PLEG): container finished" podID="db98920a-1284-4df7-b4a8-e188335e3bfe" containerID="dbddec2d8b5f06073c8172262862db51e74fa2b038d495b84d1dbfff068ef8d8" exitCode=0
Jul 06 13:40:14.567836 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:14.567750    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txzrt" event={"ID":"db98920a-1284-4df7-b4a8-e188335e3bfe","Type":"ContainerDied","Data":"dbddec2d8b5f06073c8172262862db51e74fa2b038d495b84d1dbfff068ef8d8"}
Jul 06 13:40:14.586714 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:14.586682    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:40:14.603875 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:14.603816    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx" podStartSLOduration=9.701085093 podStartE2EDuration="28.603796009s" totalImagesPullingTime="18.902710916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:14.60259121 +0000 UTC m=+29.914154893" watchObservedRunningTime="2026-07-06 13:40:14.603796009 +0000 UTC m=+29.915359674"
Jul 06 13:40:15.311238 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:15.311047    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:15.311374 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:15.311307    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:40:15.337487 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:15.337455    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-98cxh"]
Jul 06 13:40:15.337646 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:15.337573    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:15.337683 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:15.337665    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:40:15.340391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:15.340339    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v7pkm"]
Jul 06 13:40:15.340927 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:15.340903    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bxwzf"]
Jul 06 13:40:15.341045 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:15.341005    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:15.341157 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:15.341136    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:40:15.571883 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:15.571798    2573 generic.go:356] "Generic (PLEG): container finished" podID="db98920a-1284-4df7-b4a8-e188335e3bfe" containerID="c397f018a3ec864beefcd245581b2f7079eb1be59b8639c070fd1b08e3e8a7e0" exitCode=0
Jul 06 13:40:15.571883 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:15.571853    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txzrt" event={"ID":"db98920a-1284-4df7-b4a8-e188335e3bfe","Type":"ContainerDied","Data":"c397f018a3ec864beefcd245581b2f7079eb1be59b8639c070fd1b08e3e8a7e0"}
Jul 06 13:40:15.572440 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:15.571899    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:15.572440 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:15.572090    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:40:16.575946 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:16.575841    2573 generic.go:356] "Generic (PLEG): container finished" podID="db98920a-1284-4df7-b4a8-e188335e3bfe" containerID="4eed98b6ae0e1ddc24c3b52bfd53576ad37176714f94731f1f7ba5e3350584aa" exitCode=0
Jul 06 13:40:16.575946 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:16.575933    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txzrt" event={"ID":"db98920a-1284-4df7-b4a8-e188335e3bfe","Type":"ContainerDied","Data":"4eed98b6ae0e1ddc24c3b52bfd53576ad37176714f94731f1f7ba5e3350584aa"}
Jul 06 13:40:17.308368 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:17.308255    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:17.308368 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:17.308328    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:17.308669 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:17.308255    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:17.308669 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:17.308445    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:40:17.308669 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:17.308529    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:40:17.308669 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:17.308629    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:40:18.986314 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:18.986277    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs\") pod \"network-metrics-daemon-bxwzf\" (UID: \"fa01cd4e-ab76-429e-aaca-95f1c98c19c1\") " pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:18.986974 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:18.986355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:18.986974 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:18.986419    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:40:18.986974 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:18.986453    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:40:18.986974 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:18.986491    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs podName:fa01cd4e-ab76-429e-aaca-95f1c98c19c1 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:50.986470221 +0000 UTC m=+66.298033885 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs") pod "network-metrics-daemon-bxwzf" (UID: "fa01cd4e-ab76-429e-aaca-95f1c98c19c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:40:18.986974 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:18.986507    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret podName:4c146d14-3752-4d60-892c-39f682820d0f nodeName:}" failed. No retries permitted until 2026-07-06 13:40:50.986500376 +0000 UTC m=+66.298064027 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret") pod "global-pull-secret-syncer-v7pkm" (UID: "4c146d14-3752-4d60-892c-39f682820d0f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:40:19.086993 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:19.086953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7x6\" (UniqueName: \"kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6\") pod \"network-check-target-98cxh\" (UID: \"8fac2838-23a2-41f6-bbda-35a421545754\") " pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:19.087196 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:19.087167    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:40:19.087196 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:19.087194    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:40:19.087299 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:19.087208    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7j7x6 for pod openshift-network-diagnostics/network-check-target-98cxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:40:19.087299 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:19.087275    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6 podName:8fac2838-23a2-41f6-bbda-35a421545754 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:51.087255964 +0000 UTC m=+66.398819625 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7j7x6" (UniqueName: "kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6") pod "network-check-target-98cxh" (UID: "8fac2838-23a2-41f6-bbda-35a421545754") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:40:19.311552 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:19.311483    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:19.311552 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:19.311505    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:19.311735 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:19.311589    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxwzf" podUID="fa01cd4e-ab76-429e-aaca-95f1c98c19c1"
Jul 06 13:40:19.311735 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:19.311482    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:19.311816 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:19.311737    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98cxh" podUID="8fac2838-23a2-41f6-bbda-35a421545754"
Jul 06 13:40:19.311856 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:19.311823    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7pkm" podUID="4c146d14-3752-4d60-892c-39f682820d0f"
Jul 06 13:40:20.002714 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.002680    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-86.ec2.internal" event="NodeReady"
Jul 06 13:40:20.003214 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.002841    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 13:40:20.072232 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.072198    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jhwrh"]
Jul 06 13:40:20.103996 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.103937    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9vc98"]
Jul 06 13:40:20.103996 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.103998    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:20.107817 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.107787    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lqkq5\""
Jul 06 13:40:20.107977 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.107816    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 13:40:20.110132 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.110107    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 13:40:20.127001 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.126970    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jhwrh"]
Jul 06 13:40:20.127001 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.127012    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9vc98"]
Jul 06 13:40:20.127249 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.127104    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9vc98"
Jul 06 13:40:20.130706 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.130685    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 13:40:20.130869 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.130780    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fhbx9\""
Jul 06 13:40:20.131243 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.131221    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 13:40:20.131359 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.131260    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 13:40:20.194822 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.194735    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl67f\" (UniqueName: \"kubernetes.io/projected/891e0a85-e345-47ee-930d-8361eab9b666-kube-api-access-pl67f\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:20.194987 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.194819    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/891e0a85-e345-47ee-930d-8361eab9b666-config-volume\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:20.194987 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.194886    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:20.194987 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.194965    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/891e0a85-e345-47ee-930d-8361eab9b666-tmp-dir\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:20.295930 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.295885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:20.296149 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.295954    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24-cert\") pod \"ingress-canary-9vc98\" (UID: \"c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24\") " pod="openshift-ingress-canary/ingress-canary-9vc98"
Jul 06 13:40:20.296149 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.295986    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/891e0a85-e345-47ee-930d-8361eab9b666-tmp-dir\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:20.296149 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:20.296072    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:40:20.296149 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.296116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2bp8\" (UniqueName: \"kubernetes.io/projected/c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24-kube-api-access-j2bp8\") pod \"ingress-canary-9vc98\" (UID: \"c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24\") " pod="openshift-ingress-canary/ingress-canary-9vc98"
Jul 06 13:40:20.296149 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:20.296146    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls podName:891e0a85-e345-47ee-930d-8361eab9b666 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:20.796123717 +0000 UTC m=+36.107687370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls") pod "dns-default-jhwrh" (UID: "891e0a85-e345-47ee-930d-8361eab9b666") : secret "dns-default-metrics-tls" not found
Jul 06 13:40:20.296418 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.296176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl67f\" (UniqueName: \"kubernetes.io/projected/891e0a85-e345-47ee-930d-8361eab9b666-kube-api-access-pl67f\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:20.296418 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.296226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/891e0a85-e345-47ee-930d-8361eab9b666-config-volume\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:20.296521 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.296497    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/891e0a85-e345-47ee-930d-8361eab9b666-tmp-dir\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:20.296848 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.296830    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/891e0a85-e345-47ee-930d-8361eab9b666-config-volume\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:20.313685 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.313652    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl67f\" (UniqueName: \"kubernetes.io/projected/891e0a85-e345-47ee-930d-8361eab9b666-kube-api-access-pl67f\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:20.396784 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.396751    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24-cert\") pod \"ingress-canary-9vc98\" (UID: \"c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24\") " pod="openshift-ingress-canary/ingress-canary-9vc98"
Jul 06 13:40:20.396784 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.396791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2bp8\" (UniqueName: \"kubernetes.io/projected/c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24-kube-api-access-j2bp8\") pod \"ingress-canary-9vc98\" (UID: \"c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24\") " pod="openshift-ingress-canary/ingress-canary-9vc98"
Jul 06 13:40:20.399582 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.399556    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24-cert\") pod \"ingress-canary-9vc98\" (UID: \"c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24\") " pod="openshift-ingress-canary/ingress-canary-9vc98"
Jul 06 13:40:20.419298 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.419268    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2bp8\" (UniqueName: \"kubernetes.io/projected/c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24-kube-api-access-j2bp8\") pod \"ingress-canary-9vc98\" (UID: \"c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24\") " pod="openshift-ingress-canary/ingress-canary-9vc98"
Jul 06 13:40:20.437955 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.437918    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9vc98"
Jul 06 13:40:20.800113 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:20.800009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:20.800279 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:20.800185    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:40:20.800279 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:20.800257    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls podName:891e0a85-e345-47ee-930d-8361eab9b666 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:21.800238042 +0000 UTC m=+37.111801720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls") pod "dns-default-jhwrh" (UID: "891e0a85-e345-47ee-930d-8361eab9b666") : secret "dns-default-metrics-tls" not found
Jul 06 13:40:21.310653 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:21.310623    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:21.311247 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:21.310712    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:21.311247 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:21.310739    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:21.314526 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:21.314503    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jzrjm\""
Jul 06 13:40:21.314665 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:21.314566    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 13:40:21.315462 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:21.315434    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 13:40:21.315569 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:21.315468    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 13:40:21.315569 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:21.315498    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 13:40:21.315569 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:21.315435    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rf6qs\""
Jul 06 13:40:21.533106 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:21.532883    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9vc98"]
Jul 06 13:40:21.597037 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:40:21.597005    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5bcfdc8_ccc4_41cf_a986_7ee07d32cf24.slice/crio-875834b0d087e8ed87b8c5aa4e970b35d88e409605bfd17ab30c4712bbafc860 WatchSource:0}: Error finding container 875834b0d087e8ed87b8c5aa4e970b35d88e409605bfd17ab30c4712bbafc860: Status 404 returned error can't find the container with id 875834b0d087e8ed87b8c5aa4e970b35d88e409605bfd17ab30c4712bbafc860
Jul 06 13:40:21.807883 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:21.807859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:21.808023 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:21.808005    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:40:21.808092 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:21.808081    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls podName:891e0a85-e345-47ee-930d-8361eab9b666 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:23.808065506 +0000 UTC m=+39.119629168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls") pod "dns-default-jhwrh" (UID: "891e0a85-e345-47ee-930d-8361eab9b666") : secret "dns-default-metrics-tls" not found
Jul 06 13:40:22.594542 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:22.594506    2573 generic.go:356] "Generic (PLEG): container finished" podID="db98920a-1284-4df7-b4a8-e188335e3bfe" containerID="230e321b817d9749eeaf43b79003848f189c81542cd57ec12c944a76cb8d8d60" exitCode=0
Jul 06 13:40:22.594984 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:22.594592    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txzrt" event={"ID":"db98920a-1284-4df7-b4a8-e188335e3bfe","Type":"ContainerDied","Data":"230e321b817d9749eeaf43b79003848f189c81542cd57ec12c944a76cb8d8d60"}
Jul 06 13:40:22.596163 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:22.596136    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9vc98" event={"ID":"c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24","Type":"ContainerStarted","Data":"875834b0d087e8ed87b8c5aa4e970b35d88e409605bfd17ab30c4712bbafc860"}
Jul 06 13:40:23.603021 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:23.602987    2573 generic.go:356] "Generic (PLEG): container finished" podID="db98920a-1284-4df7-b4a8-e188335e3bfe" containerID="38a5d0afb32d25fb7a5994e0fbc7e1ff00f1472e61f1f43db5735d8ccb892614" exitCode=0
Jul 06 13:40:23.603539 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:23.603035    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txzrt" event={"ID":"db98920a-1284-4df7-b4a8-e188335e3bfe","Type":"ContainerDied","Data":"38a5d0afb32d25fb7a5994e0fbc7e1ff00f1472e61f1f43db5735d8ccb892614"}
Jul 06 13:40:23.825347 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:23.825307    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:23.825529 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:23.825470    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:40:23.825603 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:23.825556    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls podName:891e0a85-e345-47ee-930d-8361eab9b666 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:27.825525036 +0000 UTC m=+43.137088690 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls") pod "dns-default-jhwrh" (UID: "891e0a85-e345-47ee-930d-8361eab9b666") : secret "dns-default-metrics-tls" not found
Jul 06 13:40:24.182076 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.167157    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c"]
Jul 06 13:40:24.182076 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.178143    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c"
Jul 06 13:40:24.182076 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.181473    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 13:40:24.182076 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.181620    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 13:40:24.182076 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.181468    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c"]
Jul 06 13:40:24.182076 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.181775    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 13:40:24.182076 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.181870    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nwg6c\""
Jul 06 13:40:24.182489 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.182320    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 13:40:24.269686 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.269651    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq"]
Jul 06 13:40:24.284949 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.284921    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-khpj2"]
Jul 06 13:40:24.285105 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.285027    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq"
Jul 06 13:40:24.288956 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.288936    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 13:40:24.289175 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.289160    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 13:40:24.289261 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.289233    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 13:40:24.289387 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.289343    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-r4h9b\""
Jul 06 13:40:24.289467 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.289451    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 13:40:24.303459 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.303438    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f94c6895c-tdclc"]
Jul 06 13:40:24.303574 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.303497    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.306064 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.306033    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 13:40:24.306542 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.306529    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 13:40:24.306669 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.306657    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 13:40:24.306801 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.306784    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vl6qf\""
Jul 06 13:40:24.307691 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.307676    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 13:40:24.316590 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.316568    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 13:40:24.319969 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.319955    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq"]
Jul 06 13:40:24.320020 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.319983    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-khpj2"]
Jul 06 13:40:24.320020 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.319997    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f94c6895c-tdclc"]
Jul 06 13:40:24.320094 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.320072    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:24.323463 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.323449    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 13:40:24.323769 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.323696    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 13:40:24.323769 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.323745    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 13:40:24.323769 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.323754    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 13:40:24.323948 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.323816    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 13:40:24.323948 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.323744    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 13:40:24.324041 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.323990    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4zs9j\""
Jul 06 13:40:24.330133 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.330115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f77abc72-8afd-43b2-825a-6de62e1ca90a-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-lwt7c\" (UID: \"f77abc72-8afd-43b2-825a-6de62e1ca90a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c"
Jul 06 13:40:24.330207 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.330145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk5cf\" (UniqueName: \"kubernetes.io/projected/f77abc72-8afd-43b2-825a-6de62e1ca90a-kube-api-access-sk5cf\") pod \"service-ca-operator-5d46d9ffd4-lwt7c\" (UID: \"f77abc72-8afd-43b2-825a-6de62e1ca90a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c"
Jul 06 13:40:24.330207 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.330169    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f77abc72-8afd-43b2-825a-6de62e1ca90a-config\") pod \"service-ca-operator-5d46d9ffd4-lwt7c\" (UID: \"f77abc72-8afd-43b2-825a-6de62e1ca90a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c"
Jul 06 13:40:24.373741 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.373716    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"]
Jul 06 13:40:24.383142 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.382911    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"
Jul 06 13:40:24.385476 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.385455    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 13:40:24.385634 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.385619    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w7vr6\""
Jul 06 13:40:24.385695 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.385681    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 13:40:24.394584 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.394563    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"]
Jul 06 13:40:24.430995 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.430971    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4b8d094-6812-404e-8b6e-4da897d37c31-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.431148 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:24.431148 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431027    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4b8d094-6812-404e-8b6e-4da897d37c31-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.431148 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431046    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:24.431253 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431147    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m2mz\" (UniqueName: \"kubernetes.io/projected/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-kube-api-access-7m2mz\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:24.431253 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431197    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f77abc72-8afd-43b2-825a-6de62e1ca90a-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-lwt7c\" (UID: \"f77abc72-8afd-43b2-825a-6de62e1ca90a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c"
Jul 06 13:40:24.431253 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431222    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4b8d094-6812-404e-8b6e-4da897d37c31-tmp\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.431253 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431245    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e4b8d094-6812-404e-8b6e-4da897d37c31-snapshots\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.431385 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431270    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4b8d094-6812-404e-8b6e-4da897d37c31-serving-cert\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.431385 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431297    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sncbz\" (UniqueName: \"kubernetes.io/projected/7517c60b-f9c0-4de0-b058-a0b83e3ae3f1-kube-api-access-sncbz\") pod \"kube-storage-version-migrator-operator-846bf668f7-txbtq\" (UID: \"7517c60b-f9c0-4de0-b058-a0b83e3ae3f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq"
Jul 06 13:40:24.431385 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7517c60b-f9c0-4de0-b058-a0b83e3ae3f1-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-txbtq\" (UID: \"7517c60b-f9c0-4de0-b058-a0b83e3ae3f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq"
Jul 06 13:40:24.431385 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431375    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk5cf\" (UniqueName: \"kubernetes.io/projected/f77abc72-8afd-43b2-825a-6de62e1ca90a-kube-api-access-sk5cf\") pod \"service-ca-operator-5d46d9ffd4-lwt7c\" (UID: \"f77abc72-8afd-43b2-825a-6de62e1ca90a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c"
Jul 06 13:40:24.431561 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431403    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zxhp\" (UniqueName: \"kubernetes.io/projected/e4b8d094-6812-404e-8b6e-4da897d37c31-kube-api-access-6zxhp\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.431561 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431427    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7517c60b-f9c0-4de0-b058-a0b83e3ae3f1-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-txbtq\" (UID: \"7517c60b-f9c0-4de0-b058-a0b83e3ae3f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq"
Jul 06 13:40:24.431561 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431485    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f77abc72-8afd-43b2-825a-6de62e1ca90a-config\") pod \"service-ca-operator-5d46d9ffd4-lwt7c\" (UID: \"f77abc72-8afd-43b2-825a-6de62e1ca90a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c"
Jul 06 13:40:24.431561 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431507    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-default-certificate\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:24.431706 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.431562    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-stats-auth\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:24.432062 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.432031    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f77abc72-8afd-43b2-825a-6de62e1ca90a-config\") pod \"service-ca-operator-5d46d9ffd4-lwt7c\" (UID: \"f77abc72-8afd-43b2-825a-6de62e1ca90a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c"
Jul 06 13:40:24.435205 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.435183    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f77abc72-8afd-43b2-825a-6de62e1ca90a-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-lwt7c\" (UID: \"f77abc72-8afd-43b2-825a-6de62e1ca90a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c"
Jul 06 13:40:24.443097 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.443076    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk5cf\" (UniqueName: \"kubernetes.io/projected/f77abc72-8afd-43b2-825a-6de62e1ca90a-kube-api-access-sk5cf\") pod \"service-ca-operator-5d46d9ffd4-lwt7c\" (UID: \"f77abc72-8afd-43b2-825a-6de62e1ca90a\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c"
Jul 06 13:40:24.495585 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.495553    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c"
Jul 06 13:40:24.532802 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.532767    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-default-certificate\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:24.532977 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.532809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ba91a8b0-ac4a-4dfe-9463-d55b27379677-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-sc4fj\" (UID: \"ba91a8b0-ac4a-4dfe-9463-d55b27379677\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"
Jul 06 13:40:24.532977 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.532835    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sc4fj\" (UID: \"ba91a8b0-ac4a-4dfe-9463-d55b27379677\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"
Jul 06 13:40:24.532977 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.532893    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-stats-auth\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:24.532977 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.532936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4b8d094-6812-404e-8b6e-4da897d37c31-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.532977 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.532962    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:24.533216 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.532997    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4b8d094-6812-404e-8b6e-4da897d37c31-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.533216 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.533020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:24.533216 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.533070    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m2mz\" (UniqueName: \"kubernetes.io/projected/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-kube-api-access-7m2mz\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:24.533216 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.533102    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4b8d094-6812-404e-8b6e-4da897d37c31-tmp\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.533216 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.533129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e4b8d094-6812-404e-8b6e-4da897d37c31-snapshots\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.533216 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.533154    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4b8d094-6812-404e-8b6e-4da897d37c31-serving-cert\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.533216 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.533185    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sncbz\" (UniqueName: \"kubernetes.io/projected/7517c60b-f9c0-4de0-b058-a0b83e3ae3f1-kube-api-access-sncbz\") pod \"kube-storage-version-migrator-operator-846bf668f7-txbtq\" (UID: \"7517c60b-f9c0-4de0-b058-a0b83e3ae3f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq"
Jul 06 13:40:24.533216 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.533213    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7517c60b-f9c0-4de0-b058-a0b83e3ae3f1-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-txbtq\" (UID: \"7517c60b-f9c0-4de0-b058-a0b83e3ae3f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq"
Jul 06 13:40:24.533646 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:24.533622    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 13:40:24.533700 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:24.533692    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs podName:fef07690-0fb5-4d47-81c8-8e4b6bdb23cf nodeName:}" failed. No retries permitted until 2026-07-06 13:40:25.033673237 +0000 UTC m=+40.345236884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs") pod "router-default-6f94c6895c-tdclc" (UID: "fef07690-0fb5-4d47-81c8-8e4b6bdb23cf") : secret "router-metrics-certs-default" not found
Jul 06 13:40:24.533784 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.533748    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4b8d094-6812-404e-8b6e-4da897d37c31-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.533784 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.533754    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7517c60b-f9c0-4de0-b058-a0b83e3ae3f1-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-txbtq\" (UID: \"7517c60b-f9c0-4de0-b058-a0b83e3ae3f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq"
Jul 06 13:40:24.533910 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.533876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zxhp\" (UniqueName: \"kubernetes.io/projected/e4b8d094-6812-404e-8b6e-4da897d37c31-kube-api-access-6zxhp\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.533983 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:24.533916    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle podName:fef07690-0fb5-4d47-81c8-8e4b6bdb23cf nodeName:}" failed. No retries permitted until 2026-07-06 13:40:25.03390076 +0000 UTC m=+40.345464406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle") pod "router-default-6f94c6895c-tdclc" (UID: "fef07690-0fb5-4d47-81c8-8e4b6bdb23cf") : configmap references non-existent config key: service-ca.crt
Jul 06 13:40:24.533983 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.533937    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7517c60b-f9c0-4de0-b058-a0b83e3ae3f1-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-txbtq\" (UID: \"7517c60b-f9c0-4de0-b058-a0b83e3ae3f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq"
Jul 06 13:40:24.534568 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.534018    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4b8d094-6812-404e-8b6e-4da897d37c31-tmp\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.534568 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.534554    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e4b8d094-6812-404e-8b6e-4da897d37c31-snapshots\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.535221 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.535180    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4b8d094-6812-404e-8b6e-4da897d37c31-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.535883 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.535862    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-default-certificate\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:24.536488 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.536468    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7517c60b-f9c0-4de0-b058-a0b83e3ae3f1-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-txbtq\" (UID: \"7517c60b-f9c0-4de0-b058-a0b83e3ae3f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq"
Jul 06 13:40:24.536803 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.536771    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4b8d094-6812-404e-8b6e-4da897d37c31-serving-cert\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.536895 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.536814    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-stats-auth\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:24.547649 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.547583    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zxhp\" (UniqueName: \"kubernetes.io/projected/e4b8d094-6812-404e-8b6e-4da897d37c31-kube-api-access-6zxhp\") pod \"insights-operator-5c847dcfc4-khpj2\" (UID: \"e4b8d094-6812-404e-8b6e-4da897d37c31\") " pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.548517 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.548494    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sncbz\" (UniqueName: \"kubernetes.io/projected/7517c60b-f9c0-4de0-b058-a0b83e3ae3f1-kube-api-access-sncbz\") pod \"kube-storage-version-migrator-operator-846bf668f7-txbtq\" (UID: \"7517c60b-f9c0-4de0-b058-a0b83e3ae3f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq"
Jul 06 13:40:24.548817 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.548796    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m2mz\" (UniqueName: \"kubernetes.io/projected/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-kube-api-access-7m2mz\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:24.593511 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.593458    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq"
Jul 06 13:40:24.610176 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.609994    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9vc98" event={"ID":"c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24","Type":"ContainerStarted","Data":"a8599649cb1eab54df1dc0ac02d904fd61a582778f5b13274e026df959e6c32a"}
Jul 06 13:40:24.612624 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.612572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-khpj2"
Jul 06 13:40:24.615686 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.615362    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txzrt" event={"ID":"db98920a-1284-4df7-b4a8-e188335e3bfe","Type":"ContainerStarted","Data":"3d4af1647636ee55492ec901162d483888fadbcc0d150f96c9afbd777e82fd37"}
Jul 06 13:40:24.634677 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.634646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ba91a8b0-ac4a-4dfe-9463-d55b27379677-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-sc4fj\" (UID: \"ba91a8b0-ac4a-4dfe-9463-d55b27379677\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"
Jul 06 13:40:24.634848 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.634682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sc4fj\" (UID: \"ba91a8b0-ac4a-4dfe-9463-d55b27379677\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"
Jul 06 13:40:24.635194 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:24.634907    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 13:40:24.635194 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:24.634994    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert podName:ba91a8b0-ac4a-4dfe-9463-d55b27379677 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:25.134975426 +0000 UTC m=+40.446539072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-sc4fj" (UID: "ba91a8b0-ac4a-4dfe-9463-d55b27379677") : secret "networking-console-plugin-cert" not found
Jul 06 13:40:24.635750 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.635727    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ba91a8b0-ac4a-4dfe-9463-d55b27379677-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-sc4fj\" (UID: \"ba91a8b0-ac4a-4dfe-9463-d55b27379677\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"
Jul 06 13:40:24.653767 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.653703    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9vc98" podStartSLOduration=1.893016067 podStartE2EDuration="4.65367978s" totalImagesPullingTime="2.760663713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:24.653167626 +0000 UTC m=+39.964731319" watchObservedRunningTime="2026-07-06 13:40:24.65367978 +0000 UTC m=+39.965243449"
Jul 06 13:40:24.671857 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.671591    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c"]
Jul 06 13:40:24.676741 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:40:24.676713    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf77abc72_8afd_43b2_825a_6de62e1ca90a.slice/crio-0aeb98b524dad4b4ca8bd90015c0fde1024db1e408ec5727315379b30a5bc11d WatchSource:0}: Error finding container 0aeb98b524dad4b4ca8bd90015c0fde1024db1e408ec5727315379b30a5bc11d: Status 404 returned error can't find the container with id 0aeb98b524dad4b4ca8bd90015c0fde1024db1e408ec5727315379b30a5bc11d
Jul 06 13:40:24.775771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.775720    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-txzrt" podStartSLOduration=9.650047486 podStartE2EDuration="39.775697986s" totalImagesPullingTime="30.1256505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:24.6970735 +0000 UTC m=+40.008637180" watchObservedRunningTime="2026-07-06 13:40:24.775697986 +0000 UTC m=+40.087261655"
Jul 06 13:40:24.776282 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.776263    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq"]
Jul 06 13:40:24.779118 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:40:24.779091    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7517c60b_f9c0_4de0_b058_a0b83e3ae3f1.slice/crio-ebc589b0069a949ccd9c4e54e7cbebdd5cbdbe3268688d2cf8e2e207dec6b3ff WatchSource:0}: Error finding container ebc589b0069a949ccd9c4e54e7cbebdd5cbdbe3268688d2cf8e2e207dec6b3ff: Status 404 returned error can't find the container with id ebc589b0069a949ccd9c4e54e7cbebdd5cbdbe3268688d2cf8e2e207dec6b3ff
Jul 06 13:40:24.797582 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:24.797555    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-khpj2"]
Jul 06 13:40:24.800464 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:40:24.800441    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b8d094_6812_404e_8b6e_4da897d37c31.slice/crio-7fc8f9fe6e37631697b45066de1661784b1ae19a56167f688790ce9815ff535e WatchSource:0}: Error finding container 7fc8f9fe6e37631697b45066de1661784b1ae19a56167f688790ce9815ff535e: Status 404 returned error can't find the container with id 7fc8f9fe6e37631697b45066de1661784b1ae19a56167f688790ce9815ff535e
Jul 06 13:40:25.038540 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:25.038436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:25.038540 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:25.038476    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:25.038717 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:25.038594    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 13:40:25.038717 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:25.038643    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs podName:fef07690-0fb5-4d47-81c8-8e4b6bdb23cf nodeName:}" failed. No retries permitted until 2026-07-06 13:40:26.038626581 +0000 UTC m=+41.350190230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs") pod "router-default-6f94c6895c-tdclc" (UID: "fef07690-0fb5-4d47-81c8-8e4b6bdb23cf") : secret "router-metrics-certs-default" not found
Jul 06 13:40:25.038717 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:25.038660    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle podName:fef07690-0fb5-4d47-81c8-8e4b6bdb23cf nodeName:}" failed. No retries permitted until 2026-07-06 13:40:26.038652018 +0000 UTC m=+41.350215664 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle") pod "router-default-6f94c6895c-tdclc" (UID: "fef07690-0fb5-4d47-81c8-8e4b6bdb23cf") : configmap references non-existent config key: service-ca.crt
Jul 06 13:40:25.139066 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:25.139027    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sc4fj\" (UID: \"ba91a8b0-ac4a-4dfe-9463-d55b27379677\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"
Jul 06 13:40:25.139259 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:25.139179    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 13:40:25.139259 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:25.139249    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert podName:ba91a8b0-ac4a-4dfe-9463-d55b27379677 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:26.139230338 +0000 UTC m=+41.450793997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-sc4fj" (UID: "ba91a8b0-ac4a-4dfe-9463-d55b27379677") : secret "networking-console-plugin-cert" not found
Jul 06 13:40:25.620324 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:25.620269    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-khpj2" event={"ID":"e4b8d094-6812-404e-8b6e-4da897d37c31","Type":"ContainerStarted","Data":"7fc8f9fe6e37631697b45066de1661784b1ae19a56167f688790ce9815ff535e"}
Jul 06 13:40:25.622186 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:25.622155    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq" event={"ID":"7517c60b-f9c0-4de0-b058-a0b83e3ae3f1","Type":"ContainerStarted","Data":"ebc589b0069a949ccd9c4e54e7cbebdd5cbdbe3268688d2cf8e2e207dec6b3ff"}
Jul 06 13:40:25.623505 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:25.623476    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c" event={"ID":"f77abc72-8afd-43b2-825a-6de62e1ca90a","Type":"ContainerStarted","Data":"0aeb98b524dad4b4ca8bd90015c0fde1024db1e408ec5727315379b30a5bc11d"}
Jul 06 13:40:26.046804 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:26.046447    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:26.046804 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:26.046507    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:26.046804 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:26.046629    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 13:40:26.046804 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:26.046702    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs podName:fef07690-0fb5-4d47-81c8-8e4b6bdb23cf nodeName:}" failed. No retries permitted until 2026-07-06 13:40:28.046681814 +0000 UTC m=+43.358245461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs") pod "router-default-6f94c6895c-tdclc" (UID: "fef07690-0fb5-4d47-81c8-8e4b6bdb23cf") : secret "router-metrics-certs-default" not found
Jul 06 13:40:26.046804 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:26.046725    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle podName:fef07690-0fb5-4d47-81c8-8e4b6bdb23cf nodeName:}" failed. No retries permitted until 2026-07-06 13:40:28.046708467 +0000 UTC m=+43.358272115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle") pod "router-default-6f94c6895c-tdclc" (UID: "fef07690-0fb5-4d47-81c8-8e4b6bdb23cf") : configmap references non-existent config key: service-ca.crt
Jul 06 13:40:26.148004 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:26.147960    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sc4fj\" (UID: \"ba91a8b0-ac4a-4dfe-9463-d55b27379677\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"
Jul 06 13:40:26.148208 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:26.148104    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 13:40:26.148208 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:26.148172    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert podName:ba91a8b0-ac4a-4dfe-9463-d55b27379677 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:28.148154345 +0000 UTC m=+43.459717993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-sc4fj" (UID: "ba91a8b0-ac4a-4dfe-9463-d55b27379677") : secret "networking-console-plugin-cert" not found
Jul 06 13:40:27.863105 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:27.863013    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:27.863521 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:27.863197    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:40:27.863521 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:27.863269    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls podName:891e0a85-e345-47ee-930d-8361eab9b666 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:35.86325208 +0000 UTC m=+51.174815744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls") pod "dns-default-jhwrh" (UID: "891e0a85-e345-47ee-930d-8361eab9b666") : secret "dns-default-metrics-tls" not found
Jul 06 13:40:28.064603 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:28.064557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:28.064800 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:28.064623    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:28.064800 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:28.064732    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 13:40:28.064800 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:28.064790    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle podName:fef07690-0fb5-4d47-81c8-8e4b6bdb23cf nodeName:}" failed. No retries permitted until 2026-07-06 13:40:32.064764901 +0000 UTC m=+47.376328569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle") pod "router-default-6f94c6895c-tdclc" (UID: "fef07690-0fb5-4d47-81c8-8e4b6bdb23cf") : configmap references non-existent config key: service-ca.crt
Jul 06 13:40:28.064960 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:28.064823    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs podName:fef07690-0fb5-4d47-81c8-8e4b6bdb23cf nodeName:}" failed. No retries permitted until 2026-07-06 13:40:32.064810326 +0000 UTC m=+47.376373973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs") pod "router-default-6f94c6895c-tdclc" (UID: "fef07690-0fb5-4d47-81c8-8e4b6bdb23cf") : secret "router-metrics-certs-default" not found
Jul 06 13:40:28.165258 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:28.165168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sc4fj\" (UID: \"ba91a8b0-ac4a-4dfe-9463-d55b27379677\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"
Jul 06 13:40:28.165421 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:28.165337    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 13:40:28.165421 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:28.165413    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert podName:ba91a8b0-ac4a-4dfe-9463-d55b27379677 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:32.165393029 +0000 UTC m=+47.476956691 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-sc4fj" (UID: "ba91a8b0-ac4a-4dfe-9463-d55b27379677") : secret "networking-console-plugin-cert" not found
Jul 06 13:40:29.635230 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:29.635188    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-khpj2" event={"ID":"e4b8d094-6812-404e-8b6e-4da897d37c31","Type":"ContainerStarted","Data":"6ac018c8af0263b4d7f0cc7b99002b92c01c9f4539dd75a9920cf475a8b4ec02"}
Jul 06 13:40:29.637256 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:29.637209    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq" event={"ID":"7517c60b-f9c0-4de0-b058-a0b83e3ae3f1","Type":"ContainerStarted","Data":"7f05008c295c22a659a9aec6a8f1ff70a62b18222ba144dff34e3f93b5f151c4"}
Jul 06 13:40:29.638801 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:29.638768    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c" event={"ID":"f77abc72-8afd-43b2-825a-6de62e1ca90a","Type":"ContainerStarted","Data":"3322545b2a6d95e2ff435ed63b3c401e671b167a01773568fa63d06b5055da1f"}
Jul 06 13:40:29.666774 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:29.666718    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-khpj2" podStartSLOduration=1.752444155 podStartE2EDuration="5.666703319s" totalImagesPullingTime="3.914259164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:29.666081093 +0000 UTC m=+44.977644772" watchObservedRunningTime="2026-07-06 13:40:29.666703319 +0000 UTC m=+44.978266965"
Jul 06 13:40:29.701156 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:29.701101    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq" podStartSLOduration=1.7597663350000001 podStartE2EDuration="5.701082389s" totalImagesPullingTime="3.941316054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:29.700588272 +0000 UTC m=+45.012151941" watchObservedRunningTime="2026-07-06 13:40:29.701082389 +0000 UTC m=+45.012646058"
Jul 06 13:40:29.732695 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:29.732632    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c" podStartSLOduration=1.695482849 podStartE2EDuration="5.732609383s" totalImagesPullingTime="4.037126534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:29.731972271 +0000 UTC m=+45.043535965" watchObservedRunningTime="2026-07-06 13:40:29.732609383 +0000 UTC m=+45.044173054"
Jul 06 13:40:30.231646 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.231610    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s2xzt"]
Jul 06 13:40:30.261148 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.261114    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s2xzt"]
Jul 06 13:40:30.261299 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.261217    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.266774 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.266747    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 13:40:30.266774 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.266768    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nbfr8\""
Jul 06 13:40:30.282344 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.282316    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8a6cfca-bad3-403f-a852-df71d8bd891c-data-volume\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.282497 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.282364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.282497 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.282393    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.282497 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.282484    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clldj\" (UniqueName: \"kubernetes.io/projected/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-api-access-clldj\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.282643 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.282516    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e8a6cfca-bad3-403f-a852-df71d8bd891c-crio-socket\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.292897 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.292863    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 13:40:30.383467 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.383417    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8a6cfca-bad3-403f-a852-df71d8bd891c-data-volume\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.383676 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.383488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.383676 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.383517    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.383676 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.383608    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clldj\" (UniqueName: \"kubernetes.io/projected/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-api-access-clldj\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.383676 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:30.383625    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 13:40:30.383676 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.383637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e8a6cfca-bad3-403f-a852-df71d8bd891c-crio-socket\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.383894 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:30.383693    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm podName:e8a6cfca-bad3-403f-a852-df71d8bd891c nodeName:}" failed. No retries permitted until 2026-07-06 13:40:30.883675292 +0000 UTC m=+46.195238938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s2xzt" (UID: "e8a6cfca-bad3-403f-a852-df71d8bd891c") : configmap "kube-rbac-proxy" not found
Jul 06 13:40:30.383894 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:30.383740    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:40:30.383894 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:30.383811    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls podName:e8a6cfca-bad3-403f-a852-df71d8bd891c nodeName:}" failed. No retries permitted until 2026-07-06 13:40:30.883793411 +0000 UTC m=+46.195357056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2xzt" (UID: "e8a6cfca-bad3-403f-a852-df71d8bd891c") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:40:30.383894 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.383807    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8a6cfca-bad3-403f-a852-df71d8bd891c-data-volume\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.383894 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.383862    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e8a6cfca-bad3-403f-a852-df71d8bd891c-crio-socket\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.413068 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.413015    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clldj\" (UniqueName: \"kubernetes.io/projected/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-api-access-clldj\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.886464 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.886430    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.886464 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:30.886469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:30.886890 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:30.886561    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 13:40:30.886890 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:30.886632    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:40:30.886890 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:30.886634    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm podName:e8a6cfca-bad3-403f-a852-df71d8bd891c nodeName:}" failed. No retries permitted until 2026-07-06 13:40:31.886614744 +0000 UTC m=+47.198178394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s2xzt" (UID: "e8a6cfca-bad3-403f-a852-df71d8bd891c") : configmap "kube-rbac-proxy" not found
Jul 06 13:40:30.886890 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:30.886683    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls podName:e8a6cfca-bad3-403f-a852-df71d8bd891c nodeName:}" failed. No retries permitted until 2026-07-06 13:40:31.886670742 +0000 UTC m=+47.198234401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2xzt" (UID: "e8a6cfca-bad3-403f-a852-df71d8bd891c") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:40:31.893656 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:31.893613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:31.893656 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:31.893656    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:31.894265 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:31.893759    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 13:40:31.894265 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:31.893846    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm podName:e8a6cfca-bad3-403f-a852-df71d8bd891c nodeName:}" failed. No retries permitted until 2026-07-06 13:40:33.893823302 +0000 UTC m=+49.205386948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s2xzt" (UID: "e8a6cfca-bad3-403f-a852-df71d8bd891c") : configmap "kube-rbac-proxy" not found
Jul 06 13:40:31.894265 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:31.893767    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:40:31.894265 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:31.893907    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls podName:e8a6cfca-bad3-403f-a852-df71d8bd891c nodeName:}" failed. No retries permitted until 2026-07-06 13:40:33.893892485 +0000 UTC m=+49.205456140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2xzt" (UID: "e8a6cfca-bad3-403f-a852-df71d8bd891c") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:40:32.061326 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.061299    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-24pv7_94fa57f3-07ff-41ed-ba5b-1afa96644e70/dns-node-resolver/0.log"
Jul 06 13:40:32.095001 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.094964    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:32.095162 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.095041    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:32.095230 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:32.095180    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 13:40:32.095230 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:32.095200    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle podName:fef07690-0fb5-4d47-81c8-8e4b6bdb23cf nodeName:}" failed. No retries permitted until 2026-07-06 13:40:40.095176241 +0000 UTC m=+55.406739904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle") pod "router-default-6f94c6895c-tdclc" (UID: "fef07690-0fb5-4d47-81c8-8e4b6bdb23cf") : configmap references non-existent config key: service-ca.crt
Jul 06 13:40:32.095230 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:32.095228    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs podName:fef07690-0fb5-4d47-81c8-8e4b6bdb23cf nodeName:}" failed. No retries permitted until 2026-07-06 13:40:40.095217828 +0000 UTC m=+55.406781483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs") pod "router-default-6f94c6895c-tdclc" (UID: "fef07690-0fb5-4d47-81c8-8e4b6bdb23cf") : secret "router-metrics-certs-default" not found
Jul 06 13:40:32.195850 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.195759    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sc4fj\" (UID: \"ba91a8b0-ac4a-4dfe-9463-d55b27379677\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"
Jul 06 13:40:32.196013 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:32.195899    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 13:40:32.196013 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:32.195968    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert podName:ba91a8b0-ac4a-4dfe-9463-d55b27379677 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:40.195953343 +0000 UTC m=+55.507516992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-sc4fj" (UID: "ba91a8b0-ac4a-4dfe-9463-d55b27379677") : secret "networking-console-plugin-cert" not found
Jul 06 13:40:32.521162 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.521078    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-st49t"]
Jul 06 13:40:32.552292 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.552265    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-st49t"]
Jul 06 13:40:32.552477 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.552397    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-st49t"
Jul 06 13:40:32.556752 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.556730    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 13:40:32.558537 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.558514    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 13:40:32.559234 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.558896    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 13:40:32.559659 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.559620    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 13:40:32.559736 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.559657    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fk88q\""
Jul 06 13:40:32.599104 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.599038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c994r\" (UniqueName: \"kubernetes.io/projected/8673f5e1-e08d-4b71-af40-4351b20f808f-kube-api-access-c994r\") pod \"service-ca-758f599c5-st49t\" (UID: \"8673f5e1-e08d-4b71-af40-4351b20f808f\") " pod="openshift-service-ca/service-ca-758f599c5-st49t"
Jul 06 13:40:32.599288 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.599147    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8673f5e1-e08d-4b71-af40-4351b20f808f-signing-key\") pod \"service-ca-758f599c5-st49t\" (UID: \"8673f5e1-e08d-4b71-af40-4351b20f808f\") " pod="openshift-service-ca/service-ca-758f599c5-st49t"
Jul 06 13:40:32.599288 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.599178    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8673f5e1-e08d-4b71-af40-4351b20f808f-signing-cabundle\") pod \"service-ca-758f599c5-st49t\" (UID: \"8673f5e1-e08d-4b71-af40-4351b20f808f\") " pod="openshift-service-ca/service-ca-758f599c5-st49t"
Jul 06 13:40:32.699919 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.699886    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8673f5e1-e08d-4b71-af40-4351b20f808f-signing-key\") pod \"service-ca-758f599c5-st49t\" (UID: \"8673f5e1-e08d-4b71-af40-4351b20f808f\") " pod="openshift-service-ca/service-ca-758f599c5-st49t"
Jul 06 13:40:32.700120 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.699941    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8673f5e1-e08d-4b71-af40-4351b20f808f-signing-cabundle\") pod \"service-ca-758f599c5-st49t\" (UID: \"8673f5e1-e08d-4b71-af40-4351b20f808f\") " pod="openshift-service-ca/service-ca-758f599c5-st49t"
Jul 06 13:40:32.700120 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.699998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c994r\" (UniqueName: \"kubernetes.io/projected/8673f5e1-e08d-4b71-af40-4351b20f808f-kube-api-access-c994r\") pod \"service-ca-758f599c5-st49t\" (UID: \"8673f5e1-e08d-4b71-af40-4351b20f808f\") " pod="openshift-service-ca/service-ca-758f599c5-st49t"
Jul 06 13:40:32.700742 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.700715    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8673f5e1-e08d-4b71-af40-4351b20f808f-signing-cabundle\") pod \"service-ca-758f599c5-st49t\" (UID: \"8673f5e1-e08d-4b71-af40-4351b20f808f\") " pod="openshift-service-ca/service-ca-758f599c5-st49t"
Jul 06 13:40:32.702536 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.702513    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8673f5e1-e08d-4b71-af40-4351b20f808f-signing-key\") pod \"service-ca-758f599c5-st49t\" (UID: \"8673f5e1-e08d-4b71-af40-4351b20f808f\") " pod="openshift-service-ca/service-ca-758f599c5-st49t"
Jul 06 13:40:32.710941 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.710910    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c994r\" (UniqueName: \"kubernetes.io/projected/8673f5e1-e08d-4b71-af40-4351b20f808f-kube-api-access-c994r\") pod \"service-ca-758f599c5-st49t\" (UID: \"8673f5e1-e08d-4b71-af40-4351b20f808f\") " pod="openshift-service-ca/service-ca-758f599c5-st49t"
Jul 06 13:40:32.861940 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:32.861901    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-st49t"
Jul 06 13:40:33.023980 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:33.023947    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-st49t"]
Jul 06 13:40:33.027198 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:40:33.027167    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8673f5e1_e08d_4b71_af40_4351b20f808f.slice/crio-fbf70e0cbff96b2bd8d41ff43d58be2ed942c893869fa3f0e25934205f2adb41 WatchSource:0}: Error finding container fbf70e0cbff96b2bd8d41ff43d58be2ed942c893869fa3f0e25934205f2adb41: Status 404 returned error can't find the container with id fbf70e0cbff96b2bd8d41ff43d58be2ed942c893869fa3f0e25934205f2adb41
Jul 06 13:40:33.444028 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:33.443945    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jvw66_9ef2141c-12a4-456c-aaa6-2562ad662e9e/node-ca/0.log"
Jul 06 13:40:33.653111 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:33.653076    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-st49t" event={"ID":"8673f5e1-e08d-4b71-af40-4351b20f808f","Type":"ContainerStarted","Data":"2db232e8580dd46e47ce2452a6032d70d2a17780e21f02abb428f6acfe5b8d7f"}
Jul 06 13:40:33.653304 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:33.653127    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-st49t" event={"ID":"8673f5e1-e08d-4b71-af40-4351b20f808f","Type":"ContainerStarted","Data":"fbf70e0cbff96b2bd8d41ff43d58be2ed942c893869fa3f0e25934205f2adb41"}
Jul 06 13:40:33.669817 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:33.669753    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-st49t" podStartSLOduration=1.669729209 podStartE2EDuration="1.669729209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:33.668639592 +0000 UTC m=+48.980203261" watchObservedRunningTime="2026-07-06 13:40:33.669729209 +0000 UTC m=+48.981292879"
Jul 06 13:40:33.910740 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:33.910701    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:33.911034 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:33.911010    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:33.911670 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:33.910845    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 13:40:33.911670 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:33.911291    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm podName:e8a6cfca-bad3-403f-a852-df71d8bd891c nodeName:}" failed. No retries permitted until 2026-07-06 13:40:37.911270757 +0000 UTC m=+53.222834417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s2xzt" (UID: "e8a6cfca-bad3-403f-a852-df71d8bd891c") : configmap "kube-rbac-proxy" not found
Jul 06 13:40:33.911670 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:33.911146    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:40:33.911670 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:33.911646    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls podName:e8a6cfca-bad3-403f-a852-df71d8bd891c nodeName:}" failed. No retries permitted until 2026-07-06 13:40:37.911629047 +0000 UTC m=+53.223192698 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2xzt" (UID: "e8a6cfca-bad3-403f-a852-df71d8bd891c") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:40:34.042839 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:34.042804    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9vc98_c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24/serve-healthcheck-canary/0.log"
Jul 06 13:40:35.931858 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:35.931820    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:35.932386 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:35.932004    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:40:35.932386 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:35.932125    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls podName:891e0a85-e345-47ee-930d-8361eab9b666 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:51.932103026 +0000 UTC m=+67.243666684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls") pod "dns-default-jhwrh" (UID: "891e0a85-e345-47ee-930d-8361eab9b666") : secret "dns-default-metrics-tls" not found
Jul 06 13:40:37.952214 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:37.952179    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:37.952214 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:37.952217    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:37.952847 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:37.952394    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:40:37.952847 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:37.952456    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls podName:e8a6cfca-bad3-403f-a852-df71d8bd891c nodeName:}" failed. No retries permitted until 2026-07-06 13:40:45.952440878 +0000 UTC m=+61.264004546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2xzt" (UID: "e8a6cfca-bad3-403f-a852-df71d8bd891c") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:40:37.952957 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:37.952882    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8a6cfca-bad3-403f-a852-df71d8bd891c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:40.171348 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:40.171313    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:40.171812 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:40.171385    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:40.172040 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:40.172019    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-service-ca-bundle\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:40.173753 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:40.173732    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fef07690-0fb5-4d47-81c8-8e4b6bdb23cf-metrics-certs\") pod \"router-default-6f94c6895c-tdclc\" (UID: \"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf\") " pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:40.228001 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:40.227966    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:40.272153 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:40.272117    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sc4fj\" (UID: \"ba91a8b0-ac4a-4dfe-9463-d55b27379677\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"
Jul 06 13:40:40.272346 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:40.272293    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 13:40:40.272420 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:40:40.272406    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert podName:ba91a8b0-ac4a-4dfe-9463-d55b27379677 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:56.272388614 +0000 UTC m=+71.583952259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-sc4fj" (UID: "ba91a8b0-ac4a-4dfe-9463-d55b27379677") : secret "networking-console-plugin-cert" not found
Jul 06 13:40:40.359976 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:40.359940    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f94c6895c-tdclc"]
Jul 06 13:40:40.363165 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:40:40.363134    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef07690_0fb5_4d47_81c8_8e4b6bdb23cf.slice/crio-0b3aa783eb5c12450e9abd22a053c8edda8ddf1ff87702b9095761d06dd1c460 WatchSource:0}: Error finding container 0b3aa783eb5c12450e9abd22a053c8edda8ddf1ff87702b9095761d06dd1c460: Status 404 returned error can't find the container with id 0b3aa783eb5c12450e9abd22a053c8edda8ddf1ff87702b9095761d06dd1c460
Jul 06 13:40:40.676986 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:40.676949    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f94c6895c-tdclc" event={"ID":"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf","Type":"ContainerStarted","Data":"2f195522f991310ab0bdbe4e04707e3256e1978cc8188a4ff6878338b5430c7d"}
Jul 06 13:40:40.677203 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:40.677004    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f94c6895c-tdclc" event={"ID":"fef07690-0fb5-4d47-81c8-8e4b6bdb23cf","Type":"ContainerStarted","Data":"0b3aa783eb5c12450e9abd22a053c8edda8ddf1ff87702b9095761d06dd1c460"}
Jul 06 13:40:40.696498 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:40.696444    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f94c6895c-tdclc" podStartSLOduration=16.696428359 podStartE2EDuration="16.696428359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:40.695858502 +0000 UTC m=+56.007422168" watchObservedRunningTime="2026-07-06 13:40:40.696428359 +0000 UTC m=+56.007992005"
Jul 06 13:40:41.229017 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:41.228976    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:41.231562 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:41.231539    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:41.680300 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:41.680259    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:41.681454 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:41.681432    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f94c6895c-tdclc"
Jul 06 13:40:46.018781 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:46.018735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:46.021192 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:46.021163    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8a6cfca-bad3-403f-a852-df71d8bd891c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2xzt\" (UID: \"e8a6cfca-bad3-403f-a852-df71d8bd891c\") " pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:46.173160 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:46.173124    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nbfr8\""
Jul 06 13:40:46.181332 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:46.181287    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s2xzt"
Jul 06 13:40:46.311763 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:46.311680    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s2xzt"]
Jul 06 13:40:46.314602 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:40:46.314573    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a6cfca_bad3_403f_a852_df71d8bd891c.slice/crio-41bee400f460b68be8a99eab3267248bce79f20816daa2c3c0749e3a73cc99ba WatchSource:0}: Error finding container 41bee400f460b68be8a99eab3267248bce79f20816daa2c3c0749e3a73cc99ba: Status 404 returned error can't find the container with id 41bee400f460b68be8a99eab3267248bce79f20816daa2c3c0749e3a73cc99ba
Jul 06 13:40:46.587228 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:46.587198    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gnwx"
Jul 06 13:40:46.699944 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:46.699904    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2xzt" event={"ID":"e8a6cfca-bad3-403f-a852-df71d8bd891c","Type":"ContainerStarted","Data":"41bee400f460b68be8a99eab3267248bce79f20816daa2c3c0749e3a73cc99ba"}
Jul 06 13:40:50.715905 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:50.715872    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2xzt" event={"ID":"e8a6cfca-bad3-403f-a852-df71d8bd891c","Type":"ContainerStarted","Data":"8f833c9ac16fc82992e2a98e27215c9045f2bd79a77102f089e2788b5203d55f"}
Jul 06 13:40:50.716332 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:50.715932    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2xzt" event={"ID":"e8a6cfca-bad3-403f-a852-df71d8bd891c","Type":"ContainerStarted","Data":"015a303ed45d1b56cd01d278372b460c5a67213f3dc51ad8d2b022ad36d1d463"}
Jul 06 13:40:51.064423 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.064361    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:51.064612 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.064448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs\") pod \"network-metrics-daemon-bxwzf\" (UID: \"fa01cd4e-ab76-429e-aaca-95f1c98c19c1\") " pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:51.067341 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.067308    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 13:40:51.067508 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.067389    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 13:40:51.078610 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.078578    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa01cd4e-ab76-429e-aaca-95f1c98c19c1-metrics-certs\") pod \"network-metrics-daemon-bxwzf\" (UID: \"fa01cd4e-ab76-429e-aaca-95f1c98c19c1\") " pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:51.078766 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.078695    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c146d14-3752-4d60-892c-39f682820d0f-original-pull-secret\") pod \"global-pull-secret-syncer-v7pkm\" (UID: \"4c146d14-3752-4d60-892c-39f682820d0f\") " pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:51.165450 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.165408    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7x6\" (UniqueName: \"kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6\") pod \"network-check-target-98cxh\" (UID: \"8fac2838-23a2-41f6-bbda-35a421545754\") " pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:51.168412 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.168365    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 13:40:51.178497 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.178463    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 13:40:51.189758 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.189720    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j7x6\" (UniqueName: \"kubernetes.io/projected/8fac2838-23a2-41f6-bbda-35a421545754-kube-api-access-7j7x6\") pod \"network-check-target-98cxh\" (UID: \"8fac2838-23a2-41f6-bbda-35a421545754\") " pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:51.320498 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.320410    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7pkm"
Jul 06 13:40:51.331084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.330705    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jzrjm\""
Jul 06 13:40:51.335735 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.335697    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rf6qs\""
Jul 06 13:40:51.337759 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.337736    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxwzf"
Jul 06 13:40:51.343281 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.343226    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:51.504842 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.504760    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v7pkm"]
Jul 06 13:40:51.508317 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:40:51.508272    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c146d14_3752_4d60_892c_39f682820d0f.slice/crio-7c6d87368518efae9907c232b70297db6f4bceafcc39fb2de8fd3906b4829b3c WatchSource:0}: Error finding container 7c6d87368518efae9907c232b70297db6f4bceafcc39fb2de8fd3906b4829b3c: Status 404 returned error can't find the container with id 7c6d87368518efae9907c232b70297db6f4bceafcc39fb2de8fd3906b4829b3c
Jul 06 13:40:51.532361 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.532321    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bxwzf"]
Jul 06 13:40:51.536736 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:40:51.536700    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa01cd4e_ab76_429e_aaca_95f1c98c19c1.slice/crio-2fc14a615dca896445c4ecfeab5f761e6118f04edc8da79bff4616eb94a8f4b0 WatchSource:0}: Error finding container 2fc14a615dca896445c4ecfeab5f761e6118f04edc8da79bff4616eb94a8f4b0: Status 404 returned error can't find the container with id 2fc14a615dca896445c4ecfeab5f761e6118f04edc8da79bff4616eb94a8f4b0
Jul 06 13:40:51.567201 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.567170    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-98cxh"]
Jul 06 13:40:51.571174 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:40:51.571091    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fac2838_23a2_41f6_bbda_35a421545754.slice/crio-b46342832b882f5601adcff0b039387020ae541b13bd82c20222f44ff1e14420 WatchSource:0}: Error finding container b46342832b882f5601adcff0b039387020ae541b13bd82c20222f44ff1e14420: Status 404 returned error can't find the container with id b46342832b882f5601adcff0b039387020ae541b13bd82c20222f44ff1e14420
Jul 06 13:40:51.720904 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.720866    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-98cxh" event={"ID":"8fac2838-23a2-41f6-bbda-35a421545754","Type":"ContainerStarted","Data":"b46342832b882f5601adcff0b039387020ae541b13bd82c20222f44ff1e14420"}
Jul 06 13:40:51.722345 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.722311    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v7pkm" event={"ID":"4c146d14-3752-4d60-892c-39f682820d0f","Type":"ContainerStarted","Data":"7c6d87368518efae9907c232b70297db6f4bceafcc39fb2de8fd3906b4829b3c"}
Jul 06 13:40:51.723548 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.723521    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bxwzf" event={"ID":"fa01cd4e-ab76-429e-aaca-95f1c98c19c1","Type":"ContainerStarted","Data":"2fc14a615dca896445c4ecfeab5f761e6118f04edc8da79bff4616eb94a8f4b0"}
Jul 06 13:40:51.972730 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.972695    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:51.975621 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:51.975587    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/891e0a85-e345-47ee-930d-8361eab9b666-metrics-tls\") pod \"dns-default-jhwrh\" (UID: \"891e0a85-e345-47ee-930d-8361eab9b666\") " pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:52.218214 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:52.218177    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lqkq5\""
Jul 06 13:40:52.226043 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:52.225762    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:40:53.891815 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:53.891731    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jhwrh"]
Jul 06 13:40:54.355476 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.354726    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"]
Jul 06 13:40:54.358299 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.358270    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"
Jul 06 13:40:54.361091 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.361066    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 13:40:54.361205 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.361045    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 13:40:54.361266 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.361250    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 13:40:54.362192 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.361906    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 13:40:54.368435 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.368131    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"]
Jul 06 13:40:54.461536 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.461502    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-n66zm"]
Jul 06 13:40:54.463571 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.463540    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-n66zm"
Jul 06 13:40:54.466740 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.466702    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 13:40:54.467195 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.467079    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 13:40:54.467558 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.467406    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-l4xfh\""
Jul 06 13:40:54.469279 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.469246    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d84559797-5zg8t"]
Jul 06 13:40:54.471243 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.471225    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.473769 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.473752    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 13:40:54.474340 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.474322    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 13:40:54.474531 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.474513    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c858x\""
Jul 06 13:40:54.474738 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.474723    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 13:40:54.481795 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.481769    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 13:40:54.484201 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.484177    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-n66zm"]
Jul 06 13:40:54.494969 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.494935    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d84559797-5zg8t"]
Jul 06 13:40:54.496839 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.496812    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bde376ac-638b-4b47-87be-70ef25a0e41e-tmp\") pod \"klusterlet-addon-workmgr-595dc45865-q8m7t\" (UID: \"bde376ac-638b-4b47-87be-70ef25a0e41e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"
Jul 06 13:40:54.497132 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.497097    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bde376ac-638b-4b47-87be-70ef25a0e41e-klusterlet-config\") pod \"klusterlet-addon-workmgr-595dc45865-q8m7t\" (UID: \"bde376ac-638b-4b47-87be-70ef25a0e41e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"
Jul 06 13:40:54.497240 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.497197    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4czf8\" (UniqueName: \"kubernetes.io/projected/bde376ac-638b-4b47-87be-70ef25a0e41e-kube-api-access-4czf8\") pod \"klusterlet-addon-workmgr-595dc45865-q8m7t\" (UID: \"bde376ac-638b-4b47-87be-70ef25a0e41e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"
Jul 06 13:40:54.597925 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.597892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4czf8\" (UniqueName: \"kubernetes.io/projected/bde376ac-638b-4b47-87be-70ef25a0e41e-kube-api-access-4czf8\") pod \"klusterlet-addon-workmgr-595dc45865-q8m7t\" (UID: \"bde376ac-638b-4b47-87be-70ef25a0e41e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"
Jul 06 13:40:54.598145 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.597938    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e119faea-a52c-4da5-b226-ed4dc01f7f6c-ca-trust-extracted\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.598145 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.597963    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47bs8\" (UniqueName: \"kubernetes.io/projected/e119faea-a52c-4da5-b226-ed4dc01f7f6c-kube-api-access-47bs8\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.598145 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.598078    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e119faea-a52c-4da5-b226-ed4dc01f7f6c-installation-pull-secrets\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.598145 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.598122    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e119faea-a52c-4da5-b226-ed4dc01f7f6c-bound-sa-token\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.598335 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.598157    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bde376ac-638b-4b47-87be-70ef25a0e41e-tmp\") pod \"klusterlet-addon-workmgr-595dc45865-q8m7t\" (UID: \"bde376ac-638b-4b47-87be-70ef25a0e41e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"
Jul 06 13:40:54.598335 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.598218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e119faea-a52c-4da5-b226-ed4dc01f7f6c-registry-tls\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.598335 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.598259    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e119faea-a52c-4da5-b226-ed4dc01f7f6c-trusted-ca\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.598335 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.598294    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc58k\" (UniqueName: \"kubernetes.io/projected/f0ab51b9-d5f8-4eea-974c-06f0f963d248-kube-api-access-zc58k\") pod \"downloads-685bfb5f64-n66zm\" (UID: \"f0ab51b9-d5f8-4eea-974c-06f0f963d248\") " pod="openshift-console/downloads-685bfb5f64-n66zm"
Jul 06 13:40:54.598502 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.598377    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bde376ac-638b-4b47-87be-70ef25a0e41e-klusterlet-config\") pod \"klusterlet-addon-workmgr-595dc45865-q8m7t\" (UID: \"bde376ac-638b-4b47-87be-70ef25a0e41e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"
Jul 06 13:40:54.598558 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.598507    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e119faea-a52c-4da5-b226-ed4dc01f7f6c-image-registry-private-configuration\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.598602 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.598558    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e119faea-a52c-4da5-b226-ed4dc01f7f6c-registry-certificates\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.598602 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.598562    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bde376ac-638b-4b47-87be-70ef25a0e41e-tmp\") pod \"klusterlet-addon-workmgr-595dc45865-q8m7t\" (UID: \"bde376ac-638b-4b47-87be-70ef25a0e41e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"
Jul 06 13:40:54.601138 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.601113    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bde376ac-638b-4b47-87be-70ef25a0e41e-klusterlet-config\") pod \"klusterlet-addon-workmgr-595dc45865-q8m7t\" (UID: \"bde376ac-638b-4b47-87be-70ef25a0e41e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"
Jul 06 13:40:54.607513 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.607439    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4czf8\" (UniqueName: \"kubernetes.io/projected/bde376ac-638b-4b47-87be-70ef25a0e41e-kube-api-access-4czf8\") pod \"klusterlet-addon-workmgr-595dc45865-q8m7t\" (UID: \"bde376ac-638b-4b47-87be-70ef25a0e41e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"
Jul 06 13:40:54.673198 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.673159    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"
Jul 06 13:40:54.699541 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.699510    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e119faea-a52c-4da5-b226-ed4dc01f7f6c-registry-certificates\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.699739 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.699551    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e119faea-a52c-4da5-b226-ed4dc01f7f6c-ca-trust-extracted\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.699739 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.699570    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47bs8\" (UniqueName: \"kubernetes.io/projected/e119faea-a52c-4da5-b226-ed4dc01f7f6c-kube-api-access-47bs8\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.699739 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.699596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e119faea-a52c-4da5-b226-ed4dc01f7f6c-installation-pull-secrets\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.699739 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.699627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e119faea-a52c-4da5-b226-ed4dc01f7f6c-bound-sa-token\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.699739 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.699655    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e119faea-a52c-4da5-b226-ed4dc01f7f6c-registry-tls\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.699739 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.699678    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e119faea-a52c-4da5-b226-ed4dc01f7f6c-trusted-ca\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.699739 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.699703    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc58k\" (UniqueName: \"kubernetes.io/projected/f0ab51b9-d5f8-4eea-974c-06f0f963d248-kube-api-access-zc58k\") pod \"downloads-685bfb5f64-n66zm\" (UID: \"f0ab51b9-d5f8-4eea-974c-06f0f963d248\") " pod="openshift-console/downloads-685bfb5f64-n66zm"
Jul 06 13:40:54.700163 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.699758    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e119faea-a52c-4da5-b226-ed4dc01f7f6c-image-registry-private-configuration\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.700163 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.700003    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e119faea-a52c-4da5-b226-ed4dc01f7f6c-ca-trust-extracted\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.700802 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.700751    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e119faea-a52c-4da5-b226-ed4dc01f7f6c-trusted-ca\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.700915 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.700888    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e119faea-a52c-4da5-b226-ed4dc01f7f6c-registry-certificates\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.702636 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.702609    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e119faea-a52c-4da5-b226-ed4dc01f7f6c-image-registry-private-configuration\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.702747 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.702651    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e119faea-a52c-4da5-b226-ed4dc01f7f6c-registry-tls\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.702747 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.702709    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e119faea-a52c-4da5-b226-ed4dc01f7f6c-installation-pull-secrets\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.711175 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.711115    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e119faea-a52c-4da5-b226-ed4dc01f7f6c-bound-sa-token\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.711324 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.711220    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47bs8\" (UniqueName: \"kubernetes.io/projected/e119faea-a52c-4da5-b226-ed4dc01f7f6c-kube-api-access-47bs8\") pod \"image-registry-5d84559797-5zg8t\" (UID: \"e119faea-a52c-4da5-b226-ed4dc01f7f6c\") " pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:54.711615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.711592    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc58k\" (UniqueName: \"kubernetes.io/projected/f0ab51b9-d5f8-4eea-974c-06f0f963d248-kube-api-access-zc58k\") pod \"downloads-685bfb5f64-n66zm\" (UID: \"f0ab51b9-d5f8-4eea-974c-06f0f963d248\") " pod="openshift-console/downloads-685bfb5f64-n66zm"
Jul 06 13:40:54.737085 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.737015    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bxwzf" event={"ID":"fa01cd4e-ab76-429e-aaca-95f1c98c19c1","Type":"ContainerStarted","Data":"a595455a01b9affd7f6b9e54b6e0c3c2b664f95deab4e52e12b63eff7de5da1c"}
Jul 06 13:40:54.737290 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.737135    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bxwzf" event={"ID":"fa01cd4e-ab76-429e-aaca-95f1c98c19c1","Type":"ContainerStarted","Data":"cf33530dc61989b477eb82598d3767e660dcea765ae126a1e9c3d9a96d6b695c"}
Jul 06 13:40:54.739688 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.739663    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2xzt" event={"ID":"e8a6cfca-bad3-403f-a852-df71d8bd891c","Type":"ContainerStarted","Data":"18fda47417bb51e5665f3782d57906fe239080ffcd9dc4ddb853266b5f49c74e"}
Jul 06 13:40:54.754403 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.754341    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bxwzf" podStartSLOduration=66.571517569 podStartE2EDuration="1m8.754290913s" totalImagesPullingTime="2.182773344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:54.753220841 +0000 UTC m=+70.064784539" watchObservedRunningTime="2026-07-06 13:40:54.754290913 +0000 UTC m=+70.065854579"
Jul 06 13:40:54.772848 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.772786    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s2xzt" podStartSLOduration=17.489894451 podStartE2EDuration="24.772767962s" totalImagesPullingTime="7.282873511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:40:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:54.771624181 +0000 UTC m=+70.083187849" watchObservedRunningTime="2026-07-06 13:40:54.772767962 +0000 UTC m=+70.084331631"
Jul 06 13:40:54.776202 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.776167    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-n66zm"
Jul 06 13:40:54.784761 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:54.784728    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:56.315170 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.315127    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sc4fj\" (UID: \"ba91a8b0-ac4a-4dfe-9463-d55b27379677\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"
Jul 06 13:40:56.318745 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.318712    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba91a8b0-ac4a-4dfe-9463-d55b27379677-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-sc4fj\" (UID: \"ba91a8b0-ac4a-4dfe-9463-d55b27379677\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"
Jul 06 13:40:56.337778 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:40:56.337744    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891e0a85_e345_47ee_930d_8361eab9b666.slice/crio-9e6de783fb92406cb4574a2a83b2aa8b9b45d043a8077affa4ac6743869efdbe WatchSource:0}: Error finding container 9e6de783fb92406cb4574a2a83b2aa8b9b45d043a8077affa4ac6743869efdbe: Status 404 returned error can't find the container with id 9e6de783fb92406cb4574a2a83b2aa8b9b45d043a8077affa4ac6743869efdbe
Jul 06 13:40:56.507607 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.507464    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w7vr6\""
Jul 06 13:40:56.515821 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.515781    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"
Jul 06 13:40:56.552773 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.552740    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d84559797-5zg8t"]
Jul 06 13:40:56.556280 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:40:56.556251    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode119faea_a52c_4da5_b226_ed4dc01f7f6c.slice/crio-d423ddecd4d55f82e31e304e4631c3afd31e8d73aff1861d478a229f683fd29e WatchSource:0}: Error finding container d423ddecd4d55f82e31e304e4631c3afd31e8d73aff1861d478a229f683fd29e: Status 404 returned error can't find the container with id d423ddecd4d55f82e31e304e4631c3afd31e8d73aff1861d478a229f683fd29e
Jul 06 13:40:56.565974 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.565916    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"]
Jul 06 13:40:56.571148 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:40:56.571113    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde376ac_638b_4b47_87be_70ef25a0e41e.slice/crio-462d140ec72abadddd4ead84bbe815132f98a125a030a3f6464efd1963dc61aa WatchSource:0}: Error finding container 462d140ec72abadddd4ead84bbe815132f98a125a030a3f6464efd1963dc61aa: Status 404 returned error can't find the container with id 462d140ec72abadddd4ead84bbe815132f98a125a030a3f6464efd1963dc61aa
Jul 06 13:40:56.582508 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.582434    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-n66zm"]
Jul 06 13:40:56.674925 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.674770    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj"]
Jul 06 13:40:56.677519 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:40:56.677495    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba91a8b0_ac4a_4dfe_9463_d55b27379677.slice/crio-b17e0534c950e23f43262d445088a3e29ef8b7a0fd8c7db6511ed58c130d3c75 WatchSource:0}: Error finding container b17e0534c950e23f43262d445088a3e29ef8b7a0fd8c7db6511ed58c130d3c75: Status 404 returned error can't find the container with id b17e0534c950e23f43262d445088a3e29ef8b7a0fd8c7db6511ed58c130d3c75
Jul 06 13:40:56.756957 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.756916    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-98cxh" event={"ID":"8fac2838-23a2-41f6-bbda-35a421545754","Type":"ContainerStarted","Data":"1ceac44a28c4319868274d8d3bf013d4be67be3ecc4622b2d26baf051eb17ac0"}
Jul 06 13:40:56.757181 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.757013    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:40:56.758820 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.758793    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v7pkm" event={"ID":"4c146d14-3752-4d60-892c-39f682820d0f","Type":"ContainerStarted","Data":"cb0510018c1182607d437eb581fa9dbbe70cf92298cefa9f6443283cf564af02"}
Jul 06 13:40:56.760101 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.760075    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj" event={"ID":"ba91a8b0-ac4a-4dfe-9463-d55b27379677","Type":"ContainerStarted","Data":"b17e0534c950e23f43262d445088a3e29ef8b7a0fd8c7db6511ed58c130d3c75"}
Jul 06 13:40:56.761309 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.761273    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jhwrh" event={"ID":"891e0a85-e345-47ee-930d-8361eab9b666","Type":"ContainerStarted","Data":"9e6de783fb92406cb4574a2a83b2aa8b9b45d043a8077affa4ac6743869efdbe"}
Jul 06 13:40:56.762510 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.762489    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t" event={"ID":"bde376ac-638b-4b47-87be-70ef25a0e41e","Type":"ContainerStarted","Data":"462d140ec72abadddd4ead84bbe815132f98a125a030a3f6464efd1963dc61aa"}
Jul 06 13:40:56.763524 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.763501    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-n66zm" event={"ID":"f0ab51b9-d5f8-4eea-974c-06f0f963d248","Type":"ContainerStarted","Data":"e6b222935b04672375f16c145bd405a9a906fb601cd8f87b60ac589c32b7e206"}
Jul 06 13:40:56.764975 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.764945    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d84559797-5zg8t" event={"ID":"e119faea-a52c-4da5-b226-ed4dc01f7f6c","Type":"ContainerStarted","Data":"a9527cfda56c0f29dc85bf3378351a9663f6a2e1d1ee9e95caef41819b7f450f"}
Jul 06 13:40:56.765092 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.764984    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d84559797-5zg8t" event={"ID":"e119faea-a52c-4da5-b226-ed4dc01f7f6c","Type":"ContainerStarted","Data":"d423ddecd4d55f82e31e304e4631c3afd31e8d73aff1861d478a229f683fd29e"}
Jul 06 13:40:56.765146 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.765103    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:40:56.774248 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.774200    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-98cxh" podStartSLOduration=65.963259717 podStartE2EDuration="1m10.774188217s" totalImagesPullingTime="4.8109285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:56.773863708 +0000 UTC m=+72.085427375" watchObservedRunningTime="2026-07-06 13:40:56.774188217 +0000 UTC m=+72.085751885"
Jul 06 13:40:56.796262 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.796199    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d84559797-5zg8t" podStartSLOduration=2.796177181 podStartE2EDuration="2.796177181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:56.79519474 +0000 UTC m=+72.106758406" watchObservedRunningTime="2026-07-06 13:40:56.796177181 +0000 UTC m=+72.107740848"
Jul 06 13:40:56.814280 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:40:56.814199    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v7pkm" podStartSLOduration=65.931595141 podStartE2EDuration="1m10.814175476s" totalImagesPullingTime="4.882580335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:56.813520556 +0000 UTC m=+72.125084229" watchObservedRunningTime="2026-07-06 13:40:56.814175476 +0000 UTC m=+72.125739126"
Jul 06 13:41:01.788313 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:01.788229    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jhwrh" event={"ID":"891e0a85-e345-47ee-930d-8361eab9b666","Type":"ContainerStarted","Data":"3dc3761d039590a12f4207f5d13dbcca89b137523b627301c56afaecebd3afeb"}
Jul 06 13:41:01.788313 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:01.788310    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jhwrh" event={"ID":"891e0a85-e345-47ee-930d-8361eab9b666","Type":"ContainerStarted","Data":"c223140215c1bd595ec727422038821d134f04f1e1b9a748ab69e6120175b27e"}
Jul 06 13:41:01.788827 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:01.788334    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:41:01.789811 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:01.789779    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t" event={"ID":"bde376ac-638b-4b47-87be-70ef25a0e41e","Type":"ContainerStarted","Data":"37d25b86defe3cd0efd02479119f4ddc7d58f3ee6d5c70ff1775c138257ac4f1"}
Jul 06 13:41:01.789962 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:01.789944    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"
Jul 06 13:41:01.791348 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:01.791307    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj" event={"ID":"ba91a8b0-ac4a-4dfe-9463-d55b27379677","Type":"ContainerStarted","Data":"846a540c4d0086f1cfb40065ec7dc362298f3eeb7bcc52a74e04b2e1acf07815"}
Jul 06 13:41:01.791823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:01.791809    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t"
Jul 06 13:41:01.806555 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:01.806506    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jhwrh" podStartSLOduration=36.774089943 podStartE2EDuration="41.806492041s" totalImagesPullingTime="5.032402098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:41:01.805484477 +0000 UTC m=+77.117048146" watchObservedRunningTime="2026-07-06 13:41:01.806492041 +0000 UTC m=+77.118055707"
Jul 06 13:41:01.822628 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:01.822577    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595dc45865-q8m7t" podStartSLOduration=2.9647491219999997 podStartE2EDuration="7.822559709s" totalImagesPullingTime="4.857810587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:41:01.821750707 +0000 UTC m=+77.133314373" watchObservedRunningTime="2026-07-06 13:41:01.822559709 +0000 UTC m=+77.134123389"
Jul 06 13:41:01.837799 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:01.837737    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-sc4fj" podStartSLOduration=33.133476915 podStartE2EDuration="37.83771775s" totalImagesPullingTime="4.704240835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:41:01.836458438 +0000 UTC m=+77.148022097" watchObservedRunningTime="2026-07-06 13:41:01.83771775 +0000 UTC m=+77.149281417"
Jul 06 13:41:04.702859 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.702820    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"]
Jul 06 13:41:04.705631 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.705590    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"
Jul 06 13:41:04.709485 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.709457    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 13:41:04.709648 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.709460    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 13:41:04.709705 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.709676    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 13:41:04.709847 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.709828    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 13:41:04.709906 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.709893    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 13:41:04.710030 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.710014    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xwsts\""
Jul 06 13:41:04.714514 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.714154    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"]
Jul 06 13:41:04.790075 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.790021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f95f6a67-b086-4048-a107-b48cb77f36b1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-zs4vh\" (UID: \"f95f6a67-b086-4048-a107-b48cb77f36b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"
Jul 06 13:41:04.790248 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.790117    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f95f6a67-b086-4048-a107-b48cb77f36b1-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-zs4vh\" (UID: \"f95f6a67-b086-4048-a107-b48cb77f36b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"
Jul 06 13:41:04.790248 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.790201    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pvfq\" (UniqueName: \"kubernetes.io/projected/f95f6a67-b086-4048-a107-b48cb77f36b1-kube-api-access-6pvfq\") pod \"prometheus-operator-567f7b8b7c-zs4vh\" (UID: \"f95f6a67-b086-4048-a107-b48cb77f36b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"
Jul 06 13:41:04.790248 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.790235    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f95f6a67-b086-4048-a107-b48cb77f36b1-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-zs4vh\" (UID: \"f95f6a67-b086-4048-a107-b48cb77f36b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"
Jul 06 13:41:04.890893 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.890861    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f95f6a67-b086-4048-a107-b48cb77f36b1-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-zs4vh\" (UID: \"f95f6a67-b086-4048-a107-b48cb77f36b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"
Jul 06 13:41:04.891128 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.890914    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f95f6a67-b086-4048-a107-b48cb77f36b1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-zs4vh\" (UID: \"f95f6a67-b086-4048-a107-b48cb77f36b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"
Jul 06 13:41:04.891128 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.890966    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f95f6a67-b086-4048-a107-b48cb77f36b1-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-zs4vh\" (UID: \"f95f6a67-b086-4048-a107-b48cb77f36b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"
Jul 06 13:41:04.891242 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.891209    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pvfq\" (UniqueName: \"kubernetes.io/projected/f95f6a67-b086-4048-a107-b48cb77f36b1-kube-api-access-6pvfq\") pod \"prometheus-operator-567f7b8b7c-zs4vh\" (UID: \"f95f6a67-b086-4048-a107-b48cb77f36b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"
Jul 06 13:41:04.891701 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.891677    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f95f6a67-b086-4048-a107-b48cb77f36b1-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-zs4vh\" (UID: \"f95f6a67-b086-4048-a107-b48cb77f36b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"
Jul 06 13:41:04.893442 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.893416    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f95f6a67-b086-4048-a107-b48cb77f36b1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-zs4vh\" (UID: \"f95f6a67-b086-4048-a107-b48cb77f36b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"
Jul 06 13:41:04.893442 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.893426    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f95f6a67-b086-4048-a107-b48cb77f36b1-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-zs4vh\" (UID: \"f95f6a67-b086-4048-a107-b48cb77f36b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"
Jul 06 13:41:04.902562 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:04.902504    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pvfq\" (UniqueName: \"kubernetes.io/projected/f95f6a67-b086-4048-a107-b48cb77f36b1-kube-api-access-6pvfq\") pod \"prometheus-operator-567f7b8b7c-zs4vh\" (UID: \"f95f6a67-b086-4048-a107-b48cb77f36b1\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"
Jul 06 13:41:05.017674 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:05.017579    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"
Jul 06 13:41:05.164153 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:05.164112    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh"]
Jul 06 13:41:05.167570 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:41:05.167539    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95f6a67_b086_4048_a107_b48cb77f36b1.slice/crio-bdbbfdd0869360a1f187abed83453b15015205846badd727c28cfde82978da2d WatchSource:0}: Error finding container bdbbfdd0869360a1f187abed83453b15015205846badd727c28cfde82978da2d: Status 404 returned error can't find the container with id bdbbfdd0869360a1f187abed83453b15015205846badd727c28cfde82978da2d
Jul 06 13:41:05.811297 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:05.811254    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh" event={"ID":"f95f6a67-b086-4048-a107-b48cb77f36b1","Type":"ContainerStarted","Data":"bdbbfdd0869360a1f187abed83453b15015205846badd727c28cfde82978da2d"}
Jul 06 13:41:06.817942 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:06.817907    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh" event={"ID":"f95f6a67-b086-4048-a107-b48cb77f36b1","Type":"ContainerStarted","Data":"f7698c2c92b1663e1f3be14cf98c9daa59ebd932f1e13a2f07a629dd025e24c7"}
Jul 06 13:41:07.823238 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:07.823167    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh" event={"ID":"f95f6a67-b086-4048-a107-b48cb77f36b1","Type":"ContainerStarted","Data":"b8bff320aad5d74f9653794d59935bc98a570c14c2f054c7676558b8704ff050"}
Jul 06 13:41:07.842318 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:07.842262    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-zs4vh" podStartSLOduration=2.327694724 podStartE2EDuration="3.842242997s" totalImagesPullingTime="1.514548273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:41:07.840162747 +0000 UTC m=+83.151726428" watchObservedRunningTime="2026-07-06 13:41:07.842242997 +0000 UTC m=+83.153806666"
Jul 06 13:41:10.100491 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.100454    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sjhp5"]
Jul 06 13:41:10.103720 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.103692    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.106789 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.106762    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 13:41:10.107698 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.107546    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h5lp7\""
Jul 06 13:41:10.107698 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.107555    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 13:41:10.108180 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.108160    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 13:41:10.241923 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.241872    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.241923 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.241925    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg2nd\" (UniqueName: \"kubernetes.io/projected/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-kube-api-access-lg2nd\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.242182 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.241968    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-metrics-client-ca\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.242182 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.241993    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.242182 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.242017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-root\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.242182 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.242034    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-wtmp\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.242182 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.242136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-sys\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.242427 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.242225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-textfile\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.242427 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.242263    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-tls\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.343139 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.343095    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-textfile\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.343139 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.343140    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-tls\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.343373 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.343167    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.343373 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.343195    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg2nd\" (UniqueName: \"kubernetes.io/projected/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-kube-api-access-lg2nd\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.343373 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.343235    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-metrics-client-ca\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.343373 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.343264    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.343373 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.343286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-root\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.343373 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.343314    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-wtmp\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.343373 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.343368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-sys\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.343696 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.343467    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-sys\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.343696 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.343486    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-root\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.343696 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.343597    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-wtmp\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.343835 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.343697    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-textfile\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.344197 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.344173    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.344266 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.344215    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-metrics-client-ca\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.345961 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.345934    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.346527 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.346508    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-node-exporter-tls\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.352990 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.352851    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg2nd\" (UniqueName: \"kubernetes.io/projected/a804ac2e-1e8e-4547-8a7a-1f35efb070ff-kube-api-access-lg2nd\") pod \"node-exporter-sjhp5\" (UID: \"a804ac2e-1e8e-4547-8a7a-1f35efb070ff\") " pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:10.417062 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:10.417012    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sjhp5"
Jul 06 13:41:11.797735 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:11.797698    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jhwrh"
Jul 06 13:41:13.292180 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.292149    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"]
Jul 06 13:41:13.478543 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.478500    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"]
Jul 06 13:41:13.478729 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.478622    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.481948 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.481873    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 13:41:13.481948 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.481921    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2na252us2lkgo\""
Jul 06 13:41:13.481948 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.481950    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 13:41:13.482234 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.481873    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 13:41:13.482290 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.482248    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 13:41:13.482351 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.482313    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 13:41:13.482652 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.482472    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ps9qt\""
Jul 06 13:41:13.675260 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.675218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.675465 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.675328    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.675536 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.675504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-tls\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.675590 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.675538    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.675590 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.675560    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.675660 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.675598    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5j74\" (UniqueName: \"kubernetes.io/projected/1a8eb93c-6fac-477f-9719-ffc8696e11b7-kube-api-access-x5j74\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.675660 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.675625    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a8eb93c-6fac-477f-9719-ffc8696e11b7-metrics-client-ca\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.675660 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.675648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-grpc-tls\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.776525 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.776487    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5j74\" (UniqueName: \"kubernetes.io/projected/1a8eb93c-6fac-477f-9719-ffc8696e11b7-kube-api-access-x5j74\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.776714 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.776537    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a8eb93c-6fac-477f-9719-ffc8696e11b7-metrics-client-ca\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.776714 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.776558    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-grpc-tls\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.776714 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.776611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.776714 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.776655    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.776714 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.776697    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-tls\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.776957 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.776724    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.776957 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.776752    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.777495 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.777444    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a8eb93c-6fac-477f-9719-ffc8696e11b7-metrics-client-ca\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.779943 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.779894    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.780081 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.779962    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.780215 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.780189    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.780779 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.780357    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-grpc-tls\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.780779 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.780580    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-tls\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.780779 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.780741    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a8eb93c-6fac-477f-9719-ffc8696e11b7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:13.799591 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:13.799560    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5j74\" (UniqueName: \"kubernetes.io/projected/1a8eb93c-6fac-477f-9719-ffc8696e11b7-kube-api-access-x5j74\") pod \"thanos-querier-5b7c49c69b-4k54l\" (UID: \"1a8eb93c-6fac-477f-9719-ffc8696e11b7\") " pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:14.091103 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.091068    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:14.496015 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:41:14.495982    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda804ac2e_1e8e_4547_8a7a_1f35efb070ff.slice/crio-43466e509e8837ad994cd0c7c1903e4429ab1c5a826ae7f18f98d94e530600a3 WatchSource:0}: Error finding container 43466e509e8837ad994cd0c7c1903e4429ab1c5a826ae7f18f98d94e530600a3: Status 404 returned error can't find the container with id 43466e509e8837ad994cd0c7c1903e4429ab1c5a826ae7f18f98d94e530600a3
Jul 06 13:41:14.631342 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.631317    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"]
Jul 06 13:41:14.632587 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:41:14.632559    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a8eb93c_6fac_477f_9719_ffc8696e11b7.slice/crio-8b0e163b3b86efe1d35b3f5c0b442658f68e0b484c7f2163fddf7ea1b44b25b0 WatchSource:0}: Error finding container 8b0e163b3b86efe1d35b3f5c0b442658f68e0b484c7f2163fddf7ea1b44b25b0: Status 404 returned error can't find the container with id 8b0e163b3b86efe1d35b3f5c0b442658f68e0b484c7f2163fddf7ea1b44b25b0
Jul 06 13:41:14.789938 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.789796    2573 patch_prober.go:28] interesting pod/image-registry-5d84559797-5zg8t container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 13:41:14.789938 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.789860    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d84559797-5zg8t" podUID="e119faea-a52c-4da5-b226-ed4dc01f7f6c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 13:41:14.849672 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.849640    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjhp5" event={"ID":"a804ac2e-1e8e-4547-8a7a-1f35efb070ff","Type":"ContainerStarted","Data":"43466e509e8837ad994cd0c7c1903e4429ab1c5a826ae7f18f98d94e530600a3"}
Jul 06 13:41:14.850835 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.850808    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l" event={"ID":"1a8eb93c-6fac-477f-9719-ffc8696e11b7","Type":"ContainerStarted","Data":"8b0e163b3b86efe1d35b3f5c0b442658f68e0b484c7f2163fddf7ea1b44b25b0"}
Jul 06 13:41:14.859845 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.859813    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm"]
Jul 06 13:41:14.877430 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.877392    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm"]
Jul 06 13:41:14.877615 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.877503    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm"
Jul 06 13:41:14.889569 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.889536    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-f6zxm\" (UID: \"4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm"
Jul 06 13:41:14.889719 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.889611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8b8g\" (UniqueName: \"kubernetes.io/projected/4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5-kube-api-access-q8b8g\") pod \"monitoring-plugin-d5dcff7cf-f6zxm\" (UID: \"4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm"
Jul 06 13:41:14.924403 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.924367    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-kvg66\""
Jul 06 13:41:14.924622 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.924367    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 13:41:14.990717 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.990688    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-f6zxm\" (UID: \"4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm"
Jul 06 13:41:14.990947 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.990750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8b8g\" (UniqueName: \"kubernetes.io/projected/4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5-kube-api-access-q8b8g\") pod \"monitoring-plugin-d5dcff7cf-f6zxm\" (UID: \"4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm"
Jul 06 13:41:14.995606 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:14.995566    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-f6zxm\" (UID: \"4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm"
Jul 06 13:41:15.002504 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:15.002471    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8b8g\" (UniqueName: \"kubernetes.io/projected/4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5-kube-api-access-q8b8g\") pod \"monitoring-plugin-d5dcff7cf-f6zxm\" (UID: \"4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm"
Jul 06 13:41:15.188515 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:15.188477    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm"
Jul 06 13:41:15.582743 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:15.582705    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm"]
Jul 06 13:41:15.586872 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:41:15.586779    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3d9f5a_17f9_4d9b_b7dc_3561fe5bcaa5.slice/crio-c86a947f7376cf6e350852abffb9398a43b2b767ac8f696e4927a3eeecc9accc WatchSource:0}: Error finding container c86a947f7376cf6e350852abffb9398a43b2b767ac8f696e4927a3eeecc9accc: Status 404 returned error can't find the container with id c86a947f7376cf6e350852abffb9398a43b2b767ac8f696e4927a3eeecc9accc
Jul 06 13:41:15.857229 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:15.857106    2573 generic.go:356] "Generic (PLEG): container finished" podID="a804ac2e-1e8e-4547-8a7a-1f35efb070ff" containerID="6770d751766765c87a52757c06d605115a68968b82ef2b02520fcccc9fc0be2b" exitCode=0
Jul 06 13:41:15.857229 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:15.857157    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjhp5" event={"ID":"a804ac2e-1e8e-4547-8a7a-1f35efb070ff","Type":"ContainerDied","Data":"6770d751766765c87a52757c06d605115a68968b82ef2b02520fcccc9fc0be2b"}
Jul 06 13:41:15.859116 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:15.859087    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-n66zm" event={"ID":"f0ab51b9-d5f8-4eea-974c-06f0f963d248","Type":"ContainerStarted","Data":"bff9d10754a06418e9f7c556bcad8215621bd09e0440ab456a633226fbf2c8ce"}
Jul 06 13:41:15.859323 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:15.859249    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-n66zm"
Jul 06 13:41:15.860782 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:15.860755    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm" event={"ID":"4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5","Type":"ContainerStarted","Data":"c86a947f7376cf6e350852abffb9398a43b2b767ac8f696e4927a3eeecc9accc"}
Jul 06 13:41:15.879215 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:15.879186    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-n66zm"
Jul 06 13:41:15.917751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:15.916399    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-n66zm" podStartSLOduration=3.616790296 podStartE2EDuration="21.91636921s" totalImagesPullingTime="18.299578914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:41:15.896459857 +0000 UTC m=+91.208023526" watchObservedRunningTime="2026-07-06 13:41:15.91636921 +0000 UTC m=+91.227932877"
Jul 06 13:41:16.873417 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:16.873383    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjhp5" event={"ID":"a804ac2e-1e8e-4547-8a7a-1f35efb070ff","Type":"ContainerStarted","Data":"5fe73f4fab00c9fdbc1ab792f21611ba2b7e4cd77cf5092862e256e8a860b95b"}
Jul 06 13:41:16.875643 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:16.874677    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjhp5" event={"ID":"a804ac2e-1e8e-4547-8a7a-1f35efb070ff","Type":"ContainerStarted","Data":"7978a8205b83f96ecb8e5e49e9f9bd7013619f3156d558b94ca2cf8577bb646b"}
Jul 06 13:41:17.778754 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:17.778001    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d84559797-5zg8t"
Jul 06 13:41:17.801108 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:17.801023    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sjhp5" podStartSLOduration=6.755691575 podStartE2EDuration="7.800999004s" totalImagesPullingTime="928.2165ms" totalInitContainerRuntime="117.090929ms" isStatefulPod=true podCreationTimestamp="2026-07-06 13:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:41:16.90243753 +0000 UTC m=+92.214001198" watchObservedRunningTime="2026-07-06 13:41:17.800999004 +0000 UTC m=+93.112562673"
Jul 06 13:41:18.885790 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:18.885759    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l" event={"ID":"1a8eb93c-6fac-477f-9719-ffc8696e11b7","Type":"ContainerStarted","Data":"c41c78a4c99c3aa4eea1223d912ff7e4b9141d295fc6992dd825c67209e5fc65"}
Jul 06 13:41:18.886216 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:18.885847    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l" event={"ID":"1a8eb93c-6fac-477f-9719-ffc8696e11b7","Type":"ContainerStarted","Data":"ae26b0f5a7e31ffcbec754f63913b771889ea0472d866b38bebc815c94eb921a"}
Jul 06 13:41:18.887605 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:18.887580    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm" event={"ID":"4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5","Type":"ContainerStarted","Data":"9f8d095908af49012c6ba13a1727fb69d5db795b3127485d9fc531d0540f7186"}
Jul 06 13:41:18.893713 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:18.893677    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm"
Jul 06 13:41:18.899544 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:18.899509    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm"
Jul 06 13:41:18.913819 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:18.913533    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f6zxm" podStartSLOduration=1.828833542 podStartE2EDuration="4.913511477s" totalImagesPullingTime="3.084677935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:41:18.91114116 +0000 UTC m=+94.222704827" watchObservedRunningTime="2026-07-06 13:41:18.913511477 +0000 UTC m=+94.225075147"
Jul 06 13:41:19.894575 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:19.894533    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l" event={"ID":"1a8eb93c-6fac-477f-9719-ffc8696e11b7","Type":"ContainerStarted","Data":"4c0fcbae1f61badbbe25857919196af0dbc2892b3fe07f2670f8c9b54e63842c"}
Jul 06 13:41:20.902846 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:20.902809    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l" event={"ID":"1a8eb93c-6fac-477f-9719-ffc8696e11b7","Type":"ContainerStarted","Data":"c87c76a27cb01f9e4050eb1ffc4a142b494e51acd14fffb565b1525397f35da8"}
Jul 06 13:41:20.903350 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:20.902893    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l" event={"ID":"1a8eb93c-6fac-477f-9719-ffc8696e11b7","Type":"ContainerStarted","Data":"453867aba949f3e53a0ec37c806bd6366aa62efd1e6f214ed2118aad78994a25"}
Jul 06 13:41:20.903350 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:20.902935    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l" event={"ID":"1a8eb93c-6fac-477f-9719-ffc8696e11b7","Type":"ContainerStarted","Data":"bf8c782c3eb231d03365daae7e9b222fdff54d16b219aa7d6bdc406c1f415c9c"}
Jul 06 13:41:20.932235 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:20.932177    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l" podStartSLOduration=2.675249706 podStartE2EDuration="7.932159428s" totalImagesPullingTime="5.256909722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:41:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:41:20.931282743 +0000 UTC m=+96.242846410" watchObservedRunningTime="2026-07-06 13:41:20.932159428 +0000 UTC m=+96.243723094"
Jul 06 13:41:21.907905 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:21.907828    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:27.775095 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:27.775043    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-98cxh"
Jul 06 13:41:27.919005 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:27.918978    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5b7c49c69b-4k54l"
Jul 06 13:41:45.000928 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:45.000839    2573 generic.go:356] "Generic (PLEG): container finished" podID="e4b8d094-6812-404e-8b6e-4da897d37c31" containerID="6ac018c8af0263b4d7f0cc7b99002b92c01c9f4539dd75a9920cf475a8b4ec02" exitCode=0
Jul 06 13:41:45.000928 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:45.000911    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-khpj2" event={"ID":"e4b8d094-6812-404e-8b6e-4da897d37c31","Type":"ContainerDied","Data":"6ac018c8af0263b4d7f0cc7b99002b92c01c9f4539dd75a9920cf475a8b4ec02"}
Jul 06 13:41:45.001482 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:45.001329    2573 scope.go:117] "RemoveContainer" containerID="6ac018c8af0263b4d7f0cc7b99002b92c01c9f4539dd75a9920cf475a8b4ec02"
Jul 06 13:41:45.002558 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:45.002539    2573 generic.go:356] "Generic (PLEG): container finished" podID="f77abc72-8afd-43b2-825a-6de62e1ca90a" containerID="3322545b2a6d95e2ff435ed63b3c401e671b167a01773568fa63d06b5055da1f" exitCode=0
Jul 06 13:41:45.002648 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:45.002573    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c" event={"ID":"f77abc72-8afd-43b2-825a-6de62e1ca90a","Type":"ContainerDied","Data":"3322545b2a6d95e2ff435ed63b3c401e671b167a01773568fa63d06b5055da1f"}
Jul 06 13:41:45.002844 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:45.002818    2573 scope.go:117] "RemoveContainer" containerID="3322545b2a6d95e2ff435ed63b3c401e671b167a01773568fa63d06b5055da1f"
Jul 06 13:41:46.008467 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:46.008399    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwt7c" event={"ID":"f77abc72-8afd-43b2-825a-6de62e1ca90a","Type":"ContainerStarted","Data":"08145a992db8422a9216a1e548dffc403a7eaeec4577fb7d7bd8d6b68645467d"}
Jul 06 13:41:46.010252 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:41:46.010227    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-khpj2" event={"ID":"e4b8d094-6812-404e-8b6e-4da897d37c31","Type":"ContainerStarted","Data":"f6c85cb0b57893bca644fa005621494e0abf7b351d4bbd061bf6d97817568ec1"}
Jul 06 13:42:00.065102 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:42:00.065043    2573 generic.go:356] "Generic (PLEG): container finished" podID="7517c60b-f9c0-4de0-b058-a0b83e3ae3f1" containerID="7f05008c295c22a659a9aec6a8f1ff70a62b18222ba144dff34e3f93b5f151c4" exitCode=0
Jul 06 13:42:00.065514 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:42:00.065119    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq" event={"ID":"7517c60b-f9c0-4de0-b058-a0b83e3ae3f1","Type":"ContainerDied","Data":"7f05008c295c22a659a9aec6a8f1ff70a62b18222ba144dff34e3f93b5f151c4"}
Jul 06 13:42:00.065514 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:42:00.065460    2573 scope.go:117] "RemoveContainer" containerID="7f05008c295c22a659a9aec6a8f1ff70a62b18222ba144dff34e3f93b5f151c4"
Jul 06 13:42:01.072524 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:42:01.072486    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-txbtq" event={"ID":"7517c60b-f9c0-4de0-b058-a0b83e3ae3f1","Type":"ContainerStarted","Data":"dcdd4fafcf51ff73320e6b6070f2c77fa928a6d8f28e9dd08b02252c6714de0d"}
Jul 06 13:44:01.225755 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:01.225719    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ffzrb"]
Jul 06 13:44:01.227955 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:01.227937    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ffzrb"
Jul 06 13:44:01.230719 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:01.230694    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 13:44:01.230840 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:01.230694    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6jsb2\""
Jul 06 13:44:01.231745 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:01.231732    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 13:44:01.247002 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:01.246969    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ffzrb"]
Jul 06 13:44:01.317157 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:01.317123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tt7h\" (UniqueName: \"kubernetes.io/projected/151f664c-7ca8-4721-bbed-d8660aebf869-kube-api-access-9tt7h\") pod \"cert-manager-55b4d954d5-ffzrb\" (UID: \"151f664c-7ca8-4721-bbed-d8660aebf869\") " pod="cert-manager/cert-manager-55b4d954d5-ffzrb"
Jul 06 13:44:01.317157 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:01.317164    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/151f664c-7ca8-4721-bbed-d8660aebf869-bound-sa-token\") pod \"cert-manager-55b4d954d5-ffzrb\" (UID: \"151f664c-7ca8-4721-bbed-d8660aebf869\") " pod="cert-manager/cert-manager-55b4d954d5-ffzrb"
Jul 06 13:44:01.418427 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:01.418386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tt7h\" (UniqueName: \"kubernetes.io/projected/151f664c-7ca8-4721-bbed-d8660aebf869-kube-api-access-9tt7h\") pod \"cert-manager-55b4d954d5-ffzrb\" (UID: \"151f664c-7ca8-4721-bbed-d8660aebf869\") " pod="cert-manager/cert-manager-55b4d954d5-ffzrb"
Jul 06 13:44:01.418427 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:01.418433    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/151f664c-7ca8-4721-bbed-d8660aebf869-bound-sa-token\") pod \"cert-manager-55b4d954d5-ffzrb\" (UID: \"151f664c-7ca8-4721-bbed-d8660aebf869\") " pod="cert-manager/cert-manager-55b4d954d5-ffzrb"
Jul 06 13:44:01.436237 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:01.436204    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tt7h\" (UniqueName: \"kubernetes.io/projected/151f664c-7ca8-4721-bbed-d8660aebf869-kube-api-access-9tt7h\") pod \"cert-manager-55b4d954d5-ffzrb\" (UID: \"151f664c-7ca8-4721-bbed-d8660aebf869\") " pod="cert-manager/cert-manager-55b4d954d5-ffzrb"
Jul 06 13:44:01.436962 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:01.436944    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/151f664c-7ca8-4721-bbed-d8660aebf869-bound-sa-token\") pod \"cert-manager-55b4d954d5-ffzrb\" (UID: \"151f664c-7ca8-4721-bbed-d8660aebf869\") " pod="cert-manager/cert-manager-55b4d954d5-ffzrb"
Jul 06 13:44:01.544930 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:01.544840    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ffzrb"
Jul 06 13:44:01.690830 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:01.690799    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ffzrb"]
Jul 06 13:44:01.695130 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:44:01.695102    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod151f664c_7ca8_4721_bbed_d8660aebf869.slice/crio-d6c24c19f79dcc0f18e0674d079adf7e6aede77d0fc7bb96a12ae0f0d4b0a8f4 WatchSource:0}: Error finding container d6c24c19f79dcc0f18e0674d079adf7e6aede77d0fc7bb96a12ae0f0d4b0a8f4: Status 404 returned error can't find the container with id d6c24c19f79dcc0f18e0674d079adf7e6aede77d0fc7bb96a12ae0f0d4b0a8f4
Jul 06 13:44:02.536994 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:02.536948    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ffzrb" event={"ID":"151f664c-7ca8-4721-bbed-d8660aebf869","Type":"ContainerStarted","Data":"d6c24c19f79dcc0f18e0674d079adf7e6aede77d0fc7bb96a12ae0f0d4b0a8f4"}
Jul 06 13:44:05.551915 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:05.551874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ffzrb" event={"ID":"151f664c-7ca8-4721-bbed-d8660aebf869","Type":"ContainerStarted","Data":"0bce616299421c483fb805c58dab19e609daf13520122cd2d403f91c28e867ed"}
Jul 06 13:44:05.573720 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:05.573662    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ffzrb" podStartSLOduration=1.5728057949999998 podStartE2EDuration="4.57364457s" totalImagesPullingTime="3.000838775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:44:05.572587086 +0000 UTC m=+260.884150767" watchObservedRunningTime="2026-07-06 13:44:05.57364457 +0000 UTC m=+260.885208237"
Jul 06 13:44:26.516841 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.516801    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"]
Jul 06 13:44:26.519248 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.519228    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.529634 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.529611    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 13:44:26.529785 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.529693    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 13:44:26.529844 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.529789    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 13:44:26.530036 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.530020    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 13:44:26.530092 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.530032    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2q29q\""
Jul 06 13:44:26.562400 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.562354    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"]
Jul 06 13:44:26.622551 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.622505    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3632a88f-a1dd-4674-a5ba-9673630b9825-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.622551 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.622553    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2z98\" (UniqueName: \"kubernetes.io/projected/3632a88f-a1dd-4674-a5ba-9673630b9825-kube-api-access-c2z98\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.622802 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.622620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3632a88f-a1dd-4674-a5ba-9673630b9825-manifests\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.622802 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.622665    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3632a88f-a1dd-4674-a5ba-9673630b9825-tmp\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.622802 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.622688    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3632a88f-a1dd-4674-a5ba-9673630b9825-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.723749 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.723709    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3632a88f-a1dd-4674-a5ba-9673630b9825-tmp\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.723749 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.723753    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3632a88f-a1dd-4674-a5ba-9673630b9825-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.724019 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.723790    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3632a88f-a1dd-4674-a5ba-9673630b9825-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.724019 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.723809    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2z98\" (UniqueName: \"kubernetes.io/projected/3632a88f-a1dd-4674-a5ba-9673630b9825-kube-api-access-c2z98\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.724019 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.723844    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3632a88f-a1dd-4674-a5ba-9673630b9825-manifests\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.724260 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.724233    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3632a88f-a1dd-4674-a5ba-9673630b9825-manifests\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.726345 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.726320    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3632a88f-a1dd-4674-a5ba-9673630b9825-tmp\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.726617 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.726601    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3632a88f-a1dd-4674-a5ba-9673630b9825-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.726658 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.726621    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3632a88f-a1dd-4674-a5ba-9673630b9825-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.764587 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.764549    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2z98\" (UniqueName: \"kubernetes.io/projected/3632a88f-a1dd-4674-a5ba-9673630b9825-kube-api-access-c2z98\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-hjl7c\" (UID: \"3632a88f-a1dd-4674-a5ba-9673630b9825\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.829452 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.829364    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:26.985977 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:26.985946    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"]
Jul 06 13:44:26.988704 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:44:26.988673    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3632a88f_a1dd_4674_a5ba_9673630b9825.slice/crio-05f399fc47ec3cc530a7ff9eac8ba05d6dba147b5728837c1eb2398379ba2fc9 WatchSource:0}: Error finding container 05f399fc47ec3cc530a7ff9eac8ba05d6dba147b5728837c1eb2398379ba2fc9: Status 404 returned error can't find the container with id 05f399fc47ec3cc530a7ff9eac8ba05d6dba147b5728837c1eb2398379ba2fc9
Jul 06 13:44:27.641328 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:27.641287    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c" event={"ID":"3632a88f-a1dd-4674-a5ba-9673630b9825","Type":"ContainerStarted","Data":"05f399fc47ec3cc530a7ff9eac8ba05d6dba147b5728837c1eb2398379ba2fc9"}
Jul 06 13:44:30.657439 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:30.657391    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c" event={"ID":"3632a88f-a1dd-4674-a5ba-9673630b9825","Type":"ContainerStarted","Data":"720d66f178242cb9e49c83c9fda477f7bb76ba00b26c6b2a135f7a3699a22a1b"}
Jul 06 13:44:31.663886 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:31.663849    2573 generic.go:356] "Generic (PLEG): container finished" podID="3632a88f-a1dd-4674-a5ba-9673630b9825" containerID="720d66f178242cb9e49c83c9fda477f7bb76ba00b26c6b2a135f7a3699a22a1b" exitCode=0
Jul 06 13:44:31.664346 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:31.663906    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c" event={"ID":"3632a88f-a1dd-4674-a5ba-9673630b9825","Type":"ContainerDied","Data":"720d66f178242cb9e49c83c9fda477f7bb76ba00b26c6b2a135f7a3699a22a1b"}
Jul 06 13:44:32.670506 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:32.670464    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c" event={"ID":"3632a88f-a1dd-4674-a5ba-9673630b9825","Type":"ContainerStarted","Data":"30f1ee50ff7b60f7961ca32f7320cda8a8df7347720531eacbdfac33b66da700"}
Jul 06 13:44:32.670941 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:32.670577    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:32.719762 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:32.719703    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c" podStartSLOduration=2.307921022 podStartE2EDuration="6.71968487s" totalImagesPullingTime="3.389544078s" totalInitContainerRuntime="1.02221977s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:44:32.717603021 +0000 UTC m=+288.029166702" watchObservedRunningTime="2026-07-06 13:44:32.71968487 +0000 UTC m=+288.031248538"
Jul 06 13:44:43.677528 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:43.677492    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-hjl7c"
Jul 06 13:44:45.124771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:45.124741    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 13:44:45.128954 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:45.128927    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 13:44:45.130004 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:45.129984    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 13:44:47.179938 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.179906    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g"]
Jul 06 13:44:47.181793 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.181775    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g"
Jul 06 13:44:47.191605 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.191581    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 13:44:47.198584 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.198560    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 13:44:47.198584 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.198578    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g6pvw\""
Jul 06 13:44:47.205641 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.205611    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g"]
Jul 06 13:44:47.320015 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.319978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/535fd6b9-00c9-433d-ac21-4649061cfd9c-tmp\") pod \"kube-auth-proxy-85bfc8ccc9-6v29g\" (UID: \"535fd6b9-00c9-433d-ac21-4649061cfd9c\") " pod="openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g"
Jul 06 13:44:47.320015 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.320017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz6k5\" (UniqueName: \"kubernetes.io/projected/535fd6b9-00c9-433d-ac21-4649061cfd9c-kube-api-access-bz6k5\") pod \"kube-auth-proxy-85bfc8ccc9-6v29g\" (UID: \"535fd6b9-00c9-433d-ac21-4649061cfd9c\") " pod="openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g"
Jul 06 13:44:47.320265 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.320073    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/535fd6b9-00c9-433d-ac21-4649061cfd9c-tls-certs\") pod \"kube-auth-proxy-85bfc8ccc9-6v29g\" (UID: \"535fd6b9-00c9-433d-ac21-4649061cfd9c\") " pod="openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g"
Jul 06 13:44:47.360720 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.360683    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2qndn"]
Jul 06 13:44:47.362957 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.362935    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2qndn"
Jul 06 13:44:47.372320 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.372296    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 13:44:47.372475 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.372458    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wfvv5\""
Jul 06 13:44:47.421277 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.421245    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/535fd6b9-00c9-433d-ac21-4649061cfd9c-tmp\") pod \"kube-auth-proxy-85bfc8ccc9-6v29g\" (UID: \"535fd6b9-00c9-433d-ac21-4649061cfd9c\") " pod="openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g"
Jul 06 13:44:47.421277 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.421281    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz6k5\" (UniqueName: \"kubernetes.io/projected/535fd6b9-00c9-433d-ac21-4649061cfd9c-kube-api-access-bz6k5\") pod \"kube-auth-proxy-85bfc8ccc9-6v29g\" (UID: \"535fd6b9-00c9-433d-ac21-4649061cfd9c\") " pod="openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g"
Jul 06 13:44:47.421534 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.421312    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/535fd6b9-00c9-433d-ac21-4649061cfd9c-tls-certs\") pod \"kube-auth-proxy-85bfc8ccc9-6v29g\" (UID: \"535fd6b9-00c9-433d-ac21-4649061cfd9c\") " pod="openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g"
Jul 06 13:44:47.423657 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.423625    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/535fd6b9-00c9-433d-ac21-4649061cfd9c-tmp\") pod \"kube-auth-proxy-85bfc8ccc9-6v29g\" (UID: \"535fd6b9-00c9-433d-ac21-4649061cfd9c\") " pod="openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g"
Jul 06 13:44:47.423944 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.423922    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/535fd6b9-00c9-433d-ac21-4649061cfd9c-tls-certs\") pod \"kube-auth-proxy-85bfc8ccc9-6v29g\" (UID: \"535fd6b9-00c9-433d-ac21-4649061cfd9c\") " pod="openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g"
Jul 06 13:44:47.452113 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.452017    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz6k5\" (UniqueName: \"kubernetes.io/projected/535fd6b9-00c9-433d-ac21-4649061cfd9c-kube-api-access-bz6k5\") pod \"kube-auth-proxy-85bfc8ccc9-6v29g\" (UID: \"535fd6b9-00c9-433d-ac21-4649061cfd9c\") " pod="openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g"
Jul 06 13:44:47.491510 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.491468    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g"
Jul 06 13:44:47.522604 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.522566    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5c4t\" (UniqueName: \"kubernetes.io/projected/a65f52a7-99e9-41e2-aaf4-389a6ec47909-kube-api-access-g5c4t\") pod \"odh-model-controller-7998c67dc4-2qndn\" (UID: \"a65f52a7-99e9-41e2-aaf4-389a6ec47909\") " pod="opendatahub/odh-model-controller-7998c67dc4-2qndn"
Jul 06 13:44:47.522795 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.522630    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a65f52a7-99e9-41e2-aaf4-389a6ec47909-cert\") pod \"odh-model-controller-7998c67dc4-2qndn\" (UID: \"a65f52a7-99e9-41e2-aaf4-389a6ec47909\") " pod="opendatahub/odh-model-controller-7998c67dc4-2qndn"
Jul 06 13:44:47.540466 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.540422    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2qndn"]
Jul 06 13:44:47.624001 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.623952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5c4t\" (UniqueName: \"kubernetes.io/projected/a65f52a7-99e9-41e2-aaf4-389a6ec47909-kube-api-access-g5c4t\") pod \"odh-model-controller-7998c67dc4-2qndn\" (UID: \"a65f52a7-99e9-41e2-aaf4-389a6ec47909\") " pod="opendatahub/odh-model-controller-7998c67dc4-2qndn"
Jul 06 13:44:47.624201 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.624019    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a65f52a7-99e9-41e2-aaf4-389a6ec47909-cert\") pod \"odh-model-controller-7998c67dc4-2qndn\" (UID: \"a65f52a7-99e9-41e2-aaf4-389a6ec47909\") " pod="opendatahub/odh-model-controller-7998c67dc4-2qndn"
Jul 06 13:44:47.624201 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:44:47.624154    2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 13:44:47.624299 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:44:47.624218    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a65f52a7-99e9-41e2-aaf4-389a6ec47909-cert podName:a65f52a7-99e9-41e2-aaf4-389a6ec47909 nodeName:}" failed. No retries permitted until 2026-07-06 13:44:48.124199938 +0000 UTC m=+303.435763585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a65f52a7-99e9-41e2-aaf4-389a6ec47909-cert") pod "odh-model-controller-7998c67dc4-2qndn" (UID: "a65f52a7-99e9-41e2-aaf4-389a6ec47909") : secret "odh-model-controller-webhook-cert" not found
Jul 06 13:44:47.644489 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.644459    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5c4t\" (UniqueName: \"kubernetes.io/projected/a65f52a7-99e9-41e2-aaf4-389a6ec47909-kube-api-access-g5c4t\") pod \"odh-model-controller-7998c67dc4-2qndn\" (UID: \"a65f52a7-99e9-41e2-aaf4-389a6ec47909\") " pod="opendatahub/odh-model-controller-7998c67dc4-2qndn"
Jul 06 13:44:47.673308 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.673240    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g"]
Jul 06 13:44:47.677625 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:44:47.677592    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod535fd6b9_00c9_433d_ac21_4649061cfd9c.slice/crio-ea71c53f6f37674ca9960c40ed1bce6ea08d624814c2a260c0da7b160ef7410d WatchSource:0}: Error finding container ea71c53f6f37674ca9960c40ed1bce6ea08d624814c2a260c0da7b160ef7410d: Status 404 returned error can't find the container with id ea71c53f6f37674ca9960c40ed1bce6ea08d624814c2a260c0da7b160ef7410d
Jul 06 13:44:47.679810 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.679789    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 13:44:47.735569 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:47.735485    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g" event={"ID":"535fd6b9-00c9-433d-ac21-4649061cfd9c","Type":"ContainerStarted","Data":"ea71c53f6f37674ca9960c40ed1bce6ea08d624814c2a260c0da7b160ef7410d"}
Jul 06 13:44:48.128842 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.128793    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a65f52a7-99e9-41e2-aaf4-389a6ec47909-cert\") pod \"odh-model-controller-7998c67dc4-2qndn\" (UID: \"a65f52a7-99e9-41e2-aaf4-389a6ec47909\") " pod="opendatahub/odh-model-controller-7998c67dc4-2qndn"
Jul 06 13:44:48.131396 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.131374    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a65f52a7-99e9-41e2-aaf4-389a6ec47909-cert\") pod \"odh-model-controller-7998c67dc4-2qndn\" (UID: \"a65f52a7-99e9-41e2-aaf4-389a6ec47909\") " pod="opendatahub/odh-model-controller-7998c67dc4-2qndn"
Jul 06 13:44:48.273481 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.273443    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2qndn"
Jul 06 13:44:48.421640 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.421614    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2qndn"]
Jul 06 13:44:48.423710 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:44:48.423676    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65f52a7_99e9_41e2_aaf4_389a6ec47909.slice/crio-ce22054be5a4a07af0441bf0f1f33a6582b9639a72dc5af60957fee9c89e7029 WatchSource:0}: Error finding container ce22054be5a4a07af0441bf0f1f33a6582b9639a72dc5af60957fee9c89e7029: Status 404 returned error can't find the container with id ce22054be5a4a07af0441bf0f1f33a6582b9639a72dc5af60957fee9c89e7029
Jul 06 13:44:48.652267 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.652193    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-czzwh"]
Jul 06 13:44:48.654802 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.654770    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-czzwh"
Jul 06 13:44:48.658143 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.658114    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 13:44:48.670383 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.670349    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-czzwh"]
Jul 06 13:44:48.735390 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.735303    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-926zl\" (UniqueName: \"kubernetes.io/projected/c65276a5-d955-4f8a-ba22-b613beaee814-kube-api-access-926zl\") pod \"model-serving-api-54d89bd5fc-czzwh\" (UID: \"c65276a5-d955-4f8a-ba22-b613beaee814\") " pod="opendatahub/model-serving-api-54d89bd5fc-czzwh"
Jul 06 13:44:48.735390 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.735344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c65276a5-d955-4f8a-ba22-b613beaee814-tls-certs\") pod \"model-serving-api-54d89bd5fc-czzwh\" (UID: \"c65276a5-d955-4f8a-ba22-b613beaee814\") " pod="opendatahub/model-serving-api-54d89bd5fc-czzwh"
Jul 06 13:44:48.741368 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.741326    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2qndn" event={"ID":"a65f52a7-99e9-41e2-aaf4-389a6ec47909","Type":"ContainerStarted","Data":"ce22054be5a4a07af0441bf0f1f33a6582b9639a72dc5af60957fee9c89e7029"}
Jul 06 13:44:48.831279 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.831242    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"]
Jul 06 13:44:48.833833 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.833809    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:48.836625 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.836598    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926zl\" (UniqueName: \"kubernetes.io/projected/c65276a5-d955-4f8a-ba22-b613beaee814-kube-api-access-926zl\") pod \"model-serving-api-54d89bd5fc-czzwh\" (UID: \"c65276a5-d955-4f8a-ba22-b613beaee814\") " pod="opendatahub/model-serving-api-54d89bd5fc-czzwh"
Jul 06 13:44:48.836847 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.836638    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c65276a5-d955-4f8a-ba22-b613beaee814-tls-certs\") pod \"model-serving-api-54d89bd5fc-czzwh\" (UID: \"c65276a5-d955-4f8a-ba22-b613beaee814\") " pod="opendatahub/model-serving-api-54d89bd5fc-czzwh"
Jul 06 13:44:48.836946 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:44:48.836852    2573 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 06 13:44:48.836946 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:44:48.836915    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c65276a5-d955-4f8a-ba22-b613beaee814-tls-certs podName:c65276a5-d955-4f8a-ba22-b613beaee814 nodeName:}" failed. No retries permitted until 2026-07-06 13:44:49.336892914 +0000 UTC m=+304.648456559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c65276a5-d955-4f8a-ba22-b613beaee814-tls-certs") pod "model-serving-api-54d89bd5fc-czzwh" (UID: "c65276a5-d955-4f8a-ba22-b613beaee814") : secret "model-serving-api-tls" not found
Jul 06 13:44:48.837089 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.837018    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 13:44:48.837089 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.837045    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 13:44:48.837565 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.837483    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 13:44:48.837565 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.837512    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-564mz\""
Jul 06 13:44:48.837784 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.837763    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 13:44:48.859803 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.859760    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-926zl\" (UniqueName: \"kubernetes.io/projected/c65276a5-d955-4f8a-ba22-b613beaee814-kube-api-access-926zl\") pod \"model-serving-api-54d89bd5fc-czzwh\" (UID: \"c65276a5-d955-4f8a-ba22-b613beaee814\") " pod="opendatahub/model-serving-api-54d89bd5fc-czzwh"
Jul 06 13:44:48.910667 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.910584    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"]
Jul 06 13:44:48.938148 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.938105    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c51a9c-abac-4b35-8544-eaddeea22068-istio-token\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:48.938148 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.938149    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:48.938382 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.938237    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:48.938382 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.938284    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcz49\" (UniqueName: \"kubernetes.io/projected/62c51a9c-abac-4b35-8544-eaddeea22068-kube-api-access-mcz49\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:48.938382 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.938307    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/62c51a9c-abac-4b35-8544-eaddeea22068-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:48.938382 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.938361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c51a9c-abac-4b35-8544-eaddeea22068-local-certs\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:48.938507 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:48.938408    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-cacerts\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.039121 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.039009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.039121 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.039098    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.039352 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.039135    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcz49\" (UniqueName: \"kubernetes.io/projected/62c51a9c-abac-4b35-8544-eaddeea22068-kube-api-access-mcz49\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.039352 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.039167    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/62c51a9c-abac-4b35-8544-eaddeea22068-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.039352 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.039283    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c51a9c-abac-4b35-8544-eaddeea22068-local-certs\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.039503 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.039356    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-cacerts\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.039503 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.039401    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c51a9c-abac-4b35-8544-eaddeea22068-istio-token\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.039828 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.039790    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/62c51a9c-abac-4b35-8544-eaddeea22068-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.041711 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.041687    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.041863 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.041780    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.041863 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.041851    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c51a9c-abac-4b35-8544-eaddeea22068-local-certs\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.042118 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.042103    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-cacerts\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.049478 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.049448    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcz49\" (UniqueName: \"kubernetes.io/projected/62c51a9c-abac-4b35-8544-eaddeea22068-kube-api-access-mcz49\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.052549 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.052522    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c51a9c-abac-4b35-8544-eaddeea22068-istio-token\") pod \"istiod-openshift-gateway-7574459656-jd6nk\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.147232 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.147199    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:49.343614 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.342892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c65276a5-d955-4f8a-ba22-b613beaee814-tls-certs\") pod \"model-serving-api-54d89bd5fc-czzwh\" (UID: \"c65276a5-d955-4f8a-ba22-b613beaee814\") " pod="opendatahub/model-serving-api-54d89bd5fc-czzwh"
Jul 06 13:44:49.343614 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:44:49.343150    2573 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 06 13:44:49.343614 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:44:49.343215    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c65276a5-d955-4f8a-ba22-b613beaee814-tls-certs podName:c65276a5-d955-4f8a-ba22-b613beaee814 nodeName:}" failed. No retries permitted until 2026-07-06 13:44:50.34319618 +0000 UTC m=+305.654759831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c65276a5-d955-4f8a-ba22-b613beaee814-tls-certs") pod "model-serving-api-54d89bd5fc-czzwh" (UID: "c65276a5-d955-4f8a-ba22-b613beaee814") : secret "model-serving-api-tls" not found
Jul 06 13:44:49.362869 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.359119    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"]
Jul 06 13:44:49.747780 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:49.747695    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk" event={"ID":"62c51a9c-abac-4b35-8544-eaddeea22068","Type":"ContainerStarted","Data":"1ab75b3bcbd9d5282fea0f405d0e29bee57ee43ecaa0db2c898282e993cb1969"}
Jul 06 13:44:50.353841 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:50.353771    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c65276a5-d955-4f8a-ba22-b613beaee814-tls-certs\") pod \"model-serving-api-54d89bd5fc-czzwh\" (UID: \"c65276a5-d955-4f8a-ba22-b613beaee814\") " pod="opendatahub/model-serving-api-54d89bd5fc-czzwh"
Jul 06 13:44:50.357420 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:50.357374    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c65276a5-d955-4f8a-ba22-b613beaee814-tls-certs\") pod \"model-serving-api-54d89bd5fc-czzwh\" (UID: \"c65276a5-d955-4f8a-ba22-b613beaee814\") " pod="opendatahub/model-serving-api-54d89bd5fc-czzwh"
Jul 06 13:44:50.470173 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:50.470133    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-czzwh"
Jul 06 13:44:50.716195 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:50.716006    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-czzwh"]
Jul 06 13:44:51.366596 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:44:51.366538    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65276a5_d955_4f8a_ba22_b613beaee814.slice/crio-c49601356ab20ccae9a55f3d71c53fa074c024fdee1c22b5757148077fdd1e54 WatchSource:0}: Error finding container c49601356ab20ccae9a55f3d71c53fa074c024fdee1c22b5757148077fdd1e54: Status 404 returned error can't find the container with id c49601356ab20ccae9a55f3d71c53fa074c024fdee1c22b5757148077fdd1e54
Jul 06 13:44:51.759955 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:51.759856    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-czzwh" event={"ID":"c65276a5-d955-4f8a-ba22-b613beaee814","Type":"ContainerStarted","Data":"c49601356ab20ccae9a55f3d71c53fa074c024fdee1c22b5757148077fdd1e54"}
Jul 06 13:44:52.766418 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:52.766383    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g" event={"ID":"535fd6b9-00c9-433d-ac21-4649061cfd9c","Type":"ContainerStarted","Data":"a24c67bbb4a83fa81c42c1d324ac92a015187ab83c5e043d1930b726cf3ddf38"}
Jul 06 13:44:53.588906 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:53.588861    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:44:53.589018 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:53.588930    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:44:53.773783 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:53.773740    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2qndn" event={"ID":"a65f52a7-99e9-41e2-aaf4-389a6ec47909","Type":"ContainerStarted","Data":"af314a3d67039e8ff569c36d4cf28d47bf617d5cace9a266fe3db7727099b5be"}
Jul 06 13:44:53.774286 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:53.773844    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2qndn"
Jul 06 13:44:53.775648 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:53.775620    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk" event={"ID":"62c51a9c-abac-4b35-8544-eaddeea22068","Type":"ContainerStarted","Data":"7f8a44596a74e382a01f78d0cb5eea4bb71614fe93351980ae7103b7348df182"}
Jul 06 13:44:53.775770 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:53.775752    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:53.779344 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:53.779067    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-czzwh" event={"ID":"c65276a5-d955-4f8a-ba22-b613beaee814","Type":"ContainerStarted","Data":"bc5436455e87456a7999b2712925579fa1829088f446437585f9f05d1a48172a"}
Jul 06 13:44:53.779344 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:53.779123    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-czzwh"
Jul 06 13:44:53.799895 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:53.799840    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85bfc8ccc9-6v29g" podStartSLOduration=2.2654432030000002 podStartE2EDuration="6.799822632s" totalImagesPullingTime="4.534379429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:44:52.79528548 +0000 UTC m=+308.106849167" watchObservedRunningTime="2026-07-06 13:44:53.799822632 +0000 UTC m=+309.111386301"
Jul 06 13:44:53.800095 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:53.800037    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2qndn" podStartSLOduration=2.99805497 podStartE2EDuration="6.800031447s" totalImagesPullingTime="3.801976477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:44:53.797832385 +0000 UTC m=+309.109396076" watchObservedRunningTime="2026-07-06 13:44:53.800031447 +0000 UTC m=+309.111595137"
Jul 06 13:44:53.828187 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:53.828138    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk" podStartSLOduration=1.600918493 podStartE2EDuration="5.828114159s" totalImagesPullingTime="4.227195666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:44:53.827178825 +0000 UTC m=+309.138742494" watchObservedRunningTime="2026-07-06 13:44:53.828114159 +0000 UTC m=+309.139677828"
Jul 06 13:44:53.853635 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:53.853508    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-czzwh" podStartSLOduration=3.5882365309999997 podStartE2EDuration="5.853492242s" totalImagesPullingTime="2.265255711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:44:53.852146564 +0000 UTC m=+309.163710237" watchObservedRunningTime="2026-07-06 13:44:53.853492242 +0000 UTC m=+309.165055910"
Jul 06 13:44:54.784263 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:54.784225    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-jd6nk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 13:44:54.784695 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:54.784287    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk" podUID="62c51a9c-abac-4b35-8544-eaddeea22068" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 13:44:55.666911 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.666873    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"]
Jul 06 13:44:55.670329 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.670310    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.673814 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.673791    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8pwvl\""
Jul 06 13:44:55.698801 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.698765    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"]
Jul 06 13:44:55.722418 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.722373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.722618 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.722458    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.722618 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.722481    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.722618 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.722497    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.722618 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.722553    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.722618 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.722597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.722861 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.722668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.722861 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.722715    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.722861 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.722746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6b2m\" (UniqueName: \"kubernetes.io/projected/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-kube-api-access-p6b2m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.823608 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.823563    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.823608 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.823612    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.824227 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.823631    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.824227 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.823657    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.824227 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.823680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.824227 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.823721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.824227 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.823758    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.824227 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.823882    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6b2m\" (UniqueName: \"kubernetes.io/projected/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-kube-api-access-p6b2m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.824227 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.823930    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.824227 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.824092    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.824227 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.824168    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.824227 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.824193    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.824642 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.824321    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.824642 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.824487    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.826520 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.826500    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.826520 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.826510    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.854494 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.854458    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.860037 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.860008    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6b2m\" (UniqueName: \"kubernetes.io/projected/9719f926-ff1f-4e1d-8674-cd03f9ce7e70-kube-api-access-p6b2m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v8qkn\" (UID: \"9719f926-ff1f-4e1d-8674-cd03f9ce7e70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:55.982025 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:55.981927    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:44:56.153995 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:56.153757    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"]
Jul 06 13:44:56.157035 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:44:56.157008    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9719f926_ff1f_4e1d_8674_cd03f9ce7e70.slice/crio-58eebf84407db7e3c51bdf71747793ec7d8a8261e63dfbb0ced6e4275ca0d61e WatchSource:0}: Error finding container 58eebf84407db7e3c51bdf71747793ec7d8a8261e63dfbb0ced6e4275ca0d61e: Status 404 returned error can't find the container with id 58eebf84407db7e3c51bdf71747793ec7d8a8261e63dfbb0ced6e4275ca0d61e
Jul 06 13:44:56.793529 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:56.793494    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn" event={"ID":"9719f926-ff1f-4e1d-8674-cd03f9ce7e70","Type":"ContainerStarted","Data":"58eebf84407db7e3c51bdf71747793ec7d8a8261e63dfbb0ced6e4275ca0d61e"}
Jul 06 13:44:57.783519 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:57.783488    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:44:59.110396 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.110350    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:44:59.110715 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.110447    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:44:59.110715 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.110486    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:44:59.213558 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.213522    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz"]
Jul 06 13:44:59.217237 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.217212    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz"
Jul 06 13:44:59.222579 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.222554    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 13:44:59.223529 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.223500    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bzqbx\""
Jul 06 13:44:59.261454 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.261212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d5d4\" (UniqueName: \"kubernetes.io/projected/43628a7d-a32c-4565-85cd-7f6a77e53be0-kube-api-access-7d5d4\") pod \"kserve-controller-manager-d6f4b65b8-nbxmz\" (UID: \"43628a7d-a32c-4565-85cd-7f6a77e53be0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz"
Jul 06 13:44:59.261454 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.261335    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43628a7d-a32c-4565-85cd-7f6a77e53be0-cert\") pod \"kserve-controller-manager-d6f4b65b8-nbxmz\" (UID: \"43628a7d-a32c-4565-85cd-7f6a77e53be0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz"
Jul 06 13:44:59.267976 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.267942    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb"]
Jul 06 13:44:59.271443 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.271412    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz"]
Jul 06 13:44:59.271624 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.271516    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb"
Jul 06 13:44:59.275002 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.274965    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-2f9h7\""
Jul 06 13:44:59.275217 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.275167    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 13:44:59.295589 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.295553    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb"]
Jul 06 13:44:59.362431 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.362323    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43628a7d-a32c-4565-85cd-7f6a77e53be0-cert\") pod \"kserve-controller-manager-d6f4b65b8-nbxmz\" (UID: \"43628a7d-a32c-4565-85cd-7f6a77e53be0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz"
Jul 06 13:44:59.362431 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.362423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5zmd\" (UniqueName: \"kubernetes.io/projected/03d756e5-e2ec-4aa0-adb5-3279504dca39-kube-api-access-d5zmd\") pod \"llmisvc-controller-manager-777c6bd7d5-kgqbb\" (UID: \"03d756e5-e2ec-4aa0-adb5-3279504dca39\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb"
Jul 06 13:44:59.362673 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.362472    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03d756e5-e2ec-4aa0-adb5-3279504dca39-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kgqbb\" (UID: \"03d756e5-e2ec-4aa0-adb5-3279504dca39\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb"
Jul 06 13:44:59.362673 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.362505    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d5d4\" (UniqueName: \"kubernetes.io/projected/43628a7d-a32c-4565-85cd-7f6a77e53be0-kube-api-access-7d5d4\") pod \"kserve-controller-manager-d6f4b65b8-nbxmz\" (UID: \"43628a7d-a32c-4565-85cd-7f6a77e53be0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz"
Jul 06 13:44:59.365549 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.365502    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43628a7d-a32c-4565-85cd-7f6a77e53be0-cert\") pod \"kserve-controller-manager-d6f4b65b8-nbxmz\" (UID: \"43628a7d-a32c-4565-85cd-7f6a77e53be0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz"
Jul 06 13:44:59.382661 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.382629    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d5d4\" (UniqueName: \"kubernetes.io/projected/43628a7d-a32c-4565-85cd-7f6a77e53be0-kube-api-access-7d5d4\") pod \"kserve-controller-manager-d6f4b65b8-nbxmz\" (UID: \"43628a7d-a32c-4565-85cd-7f6a77e53be0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz"
Jul 06 13:44:59.463751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.463715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5zmd\" (UniqueName: \"kubernetes.io/projected/03d756e5-e2ec-4aa0-adb5-3279504dca39-kube-api-access-d5zmd\") pod \"llmisvc-controller-manager-777c6bd7d5-kgqbb\" (UID: \"03d756e5-e2ec-4aa0-adb5-3279504dca39\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb"
Jul 06 13:44:59.463751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.463763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03d756e5-e2ec-4aa0-adb5-3279504dca39-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kgqbb\" (UID: \"03d756e5-e2ec-4aa0-adb5-3279504dca39\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb"
Jul 06 13:44:59.466586 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.466560    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03d756e5-e2ec-4aa0-adb5-3279504dca39-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kgqbb\" (UID: \"03d756e5-e2ec-4aa0-adb5-3279504dca39\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb"
Jul 06 13:44:59.482539 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.482505    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5zmd\" (UniqueName: \"kubernetes.io/projected/03d756e5-e2ec-4aa0-adb5-3279504dca39-kube-api-access-d5zmd\") pod \"llmisvc-controller-manager-777c6bd7d5-kgqbb\" (UID: \"03d756e5-e2ec-4aa0-adb5-3279504dca39\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb"
Jul 06 13:44:59.529159 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.529112    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz"
Jul 06 13:44:59.582369 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.582313    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb"
Jul 06 13:44:59.721279 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.721245    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz"]
Jul 06 13:44:59.723568 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:44:59.723537    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43628a7d_a32c_4565_85cd_7f6a77e53be0.slice/crio-c1c1cfc7f865b0c8b058d194d4126b24f9251db37f754f4c83221bd01b256908 WatchSource:0}: Error finding container c1c1cfc7f865b0c8b058d194d4126b24f9251db37f754f4c83221bd01b256908: Status 404 returned error can't find the container with id c1c1cfc7f865b0c8b058d194d4126b24f9251db37f754f4c83221bd01b256908
Jul 06 13:44:59.771630 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.771597    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb"]
Jul 06 13:44:59.774793 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:44:59.774764    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod03d756e5_e2ec_4aa0_adb5_3279504dca39.slice/crio-a37da0d27a5882dadb3861d90bfcf234af45e51e313faaeb755da2555096dd82 WatchSource:0}: Error finding container a37da0d27a5882dadb3861d90bfcf234af45e51e313faaeb755da2555096dd82: Status 404 returned error can't find the container with id a37da0d27a5882dadb3861d90bfcf234af45e51e313faaeb755da2555096dd82
Jul 06 13:44:59.809866 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.809829    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn" event={"ID":"9719f926-ff1f-4e1d-8674-cd03f9ce7e70","Type":"ContainerStarted","Data":"290d0f4579aeabaf177e4a90e7b8dc239f9118bd48031f610305fcc49c80da92"}
Jul 06 13:44:59.811160 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.811131    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb" event={"ID":"03d756e5-e2ec-4aa0-adb5-3279504dca39","Type":"ContainerStarted","Data":"a37da0d27a5882dadb3861d90bfcf234af45e51e313faaeb755da2555096dd82"}
Jul 06 13:44:59.812233 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.812208    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz" event={"ID":"43628a7d-a32c-4565-85cd-7f6a77e53be0","Type":"ContainerStarted","Data":"c1c1cfc7f865b0c8b058d194d4126b24f9251db37f754f4c83221bd01b256908"}
Jul 06 13:44:59.879386 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.879271    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn" podStartSLOduration=1.928364979 podStartE2EDuration="4.879252794s" totalImagesPullingTime="2.950887815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:44:59.87764255 +0000 UTC m=+315.189206219" watchObservedRunningTime="2026-07-06 13:44:59.879252794 +0000 UTC m=+315.190816539"
Jul 06 13:44:59.982286 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:44:59.982244    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:45:00.989587 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:00.989556    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:45:01.823827 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:01.823793    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:45:01.824862 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:01.824841    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v8qkn"
Jul 06 13:45:03.834668 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:03.834634    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb" event={"ID":"03d756e5-e2ec-4aa0-adb5-3279504dca39","Type":"ContainerStarted","Data":"e6aeb4ee35e31be81e9f5e88c7f785db16bcc61aa5c0f5c2406a2480f5d75241"}
Jul 06 13:45:03.835162 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:03.834770    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb"
Jul 06 13:45:03.836272 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:03.836230    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz" event={"ID":"43628a7d-a32c-4565-85cd-7f6a77e53be0","Type":"ContainerStarted","Data":"cd9bcd08d342e9c84fdbd38e1e68d7ebb75288797986926a66a116365f27caf6"}
Jul 06 13:45:03.836454 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:03.836433    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz"
Jul 06 13:45:03.873428 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:03.873370    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb" podStartSLOduration=1.2071660770000001 podStartE2EDuration="4.873350196s" totalImagesPullingTime="3.666184119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:03.872200148 +0000 UTC m=+319.183763845" watchObservedRunningTime="2026-07-06 13:45:03.873350196 +0000 UTC m=+319.184913867"
Jul 06 13:45:03.912751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:03.912703    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz" podStartSLOduration=1.199315293 podStartE2EDuration="4.912687182s" totalImagesPullingTime="3.713371889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:03.90983806 +0000 UTC m=+319.221401748" watchObservedRunningTime="2026-07-06 13:45:03.912687182 +0000 UTC m=+319.224250849"
Jul 06 13:45:04.785285 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:04.785253    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2qndn"
Jul 06 13:45:04.787392 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:04.787363    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-czzwh"
Jul 06 13:45:08.496305 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.496272    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"]
Jul 06 13:45:08.496741 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.496464    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk" podUID="62c51a9c-abac-4b35-8544-eaddeea22068" containerName="discovery" containerID="cri-o://7f8a44596a74e382a01f78d0cb5eea4bb71614fe93351980ae7103b7348df182" gracePeriod=30
Jul 06 13:45:08.753751 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.753664    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:45:08.853530 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.853491    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-istio-csr-dns-cert\") pod \"62c51a9c-abac-4b35-8544-eaddeea22068\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") "
Jul 06 13:45:08.853721 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.853542    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c51a9c-abac-4b35-8544-eaddeea22068-local-certs\") pod \"62c51a9c-abac-4b35-8544-eaddeea22068\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") "
Jul 06 13:45:08.853721 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.853584    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c51a9c-abac-4b35-8544-eaddeea22068-istio-token\") pod \"62c51a9c-abac-4b35-8544-eaddeea22068\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") "
Jul 06 13:45:08.853721 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.853601    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/62c51a9c-abac-4b35-8544-eaddeea22068-istio-csr-ca-configmap\") pod \"62c51a9c-abac-4b35-8544-eaddeea22068\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") "
Jul 06 13:45:08.853721 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.853625    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-istio-kubeconfig\") pod \"62c51a9c-abac-4b35-8544-eaddeea22068\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") "
Jul 06 13:45:08.853721 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.853649    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-cacerts\") pod \"62c51a9c-abac-4b35-8544-eaddeea22068\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") "
Jul 06 13:45:08.853721 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.853701    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcz49\" (UniqueName: \"kubernetes.io/projected/62c51a9c-abac-4b35-8544-eaddeea22068-kube-api-access-mcz49\") pod \"62c51a9c-abac-4b35-8544-eaddeea22068\" (UID: \"62c51a9c-abac-4b35-8544-eaddeea22068\") "
Jul 06 13:45:08.854401 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.854347    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62c51a9c-abac-4b35-8544-eaddeea22068-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "62c51a9c-abac-4b35-8544-eaddeea22068" (UID: "62c51a9c-abac-4b35-8544-eaddeea22068"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:45:08.856563 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.856530    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c51a9c-abac-4b35-8544-eaddeea22068-local-certs" (OuterVolumeSpecName: "local-certs") pod "62c51a9c-abac-4b35-8544-eaddeea22068" (UID: "62c51a9c-abac-4b35-8544-eaddeea22068"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:45:08.856731 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.856702    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62c51a9c-abac-4b35-8544-eaddeea22068-kube-api-access-mcz49" (OuterVolumeSpecName: "kube-api-access-mcz49") pod "62c51a9c-abac-4b35-8544-eaddeea22068" (UID: "62c51a9c-abac-4b35-8544-eaddeea22068"). InnerVolumeSpecName "kube-api-access-mcz49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:45:08.856731 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.856712    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-cacerts" (OuterVolumeSpecName: "cacerts") pod "62c51a9c-abac-4b35-8544-eaddeea22068" (UID: "62c51a9c-abac-4b35-8544-eaddeea22068"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:45:08.856731 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.856725    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62c51a9c-abac-4b35-8544-eaddeea22068-istio-token" (OuterVolumeSpecName: "istio-token") pod "62c51a9c-abac-4b35-8544-eaddeea22068" (UID: "62c51a9c-abac-4b35-8544-eaddeea22068"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:45:08.856968 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.856949    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "62c51a9c-abac-4b35-8544-eaddeea22068" (UID: "62c51a9c-abac-4b35-8544-eaddeea22068"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:45:08.857530 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.857510    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "62c51a9c-abac-4b35-8544-eaddeea22068" (UID: "62c51a9c-abac-4b35-8544-eaddeea22068"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:45:08.871189 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.871158    2573 generic.go:356] "Generic (PLEG): container finished" podID="62c51a9c-abac-4b35-8544-eaddeea22068" containerID="7f8a44596a74e382a01f78d0cb5eea4bb71614fe93351980ae7103b7348df182" exitCode=0
Jul 06 13:45:08.871373 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.871217    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"
Jul 06 13:45:08.871373 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.871238    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk" event={"ID":"62c51a9c-abac-4b35-8544-eaddeea22068","Type":"ContainerDied","Data":"7f8a44596a74e382a01f78d0cb5eea4bb71614fe93351980ae7103b7348df182"}
Jul 06 13:45:08.871373 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.871325    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk" event={"ID":"62c51a9c-abac-4b35-8544-eaddeea22068","Type":"ContainerDied","Data":"1ab75b3bcbd9d5282fea0f405d0e29bee57ee43ecaa0db2c898282e993cb1969"}
Jul 06 13:45:08.871373 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.871352    2573 scope.go:117] "RemoveContainer" containerID="7f8a44596a74e382a01f78d0cb5eea4bb71614fe93351980ae7103b7348df182"
Jul 06 13:45:08.882113 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.882092    2573 scope.go:117] "RemoveContainer" containerID="7f8a44596a74e382a01f78d0cb5eea4bb71614fe93351980ae7103b7348df182"
Jul 06 13:45:08.882438 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:45:08.882416    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f8a44596a74e382a01f78d0cb5eea4bb71614fe93351980ae7103b7348df182\": container with ID starting with 7f8a44596a74e382a01f78d0cb5eea4bb71614fe93351980ae7103b7348df182 not found: ID does not exist" containerID="7f8a44596a74e382a01f78d0cb5eea4bb71614fe93351980ae7103b7348df182"
Jul 06 13:45:08.882502 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.882448    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8a44596a74e382a01f78d0cb5eea4bb71614fe93351980ae7103b7348df182"} err="failed to get container status \"7f8a44596a74e382a01f78d0cb5eea4bb71614fe93351980ae7103b7348df182\": rpc error: code = NotFound desc = could not find container \"7f8a44596a74e382a01f78d0cb5eea4bb71614fe93351980ae7103b7348df182\": container with ID starting with 7f8a44596a74e382a01f78d0cb5eea4bb71614fe93351980ae7103b7348df182 not found: ID does not exist"
Jul 06 13:45:08.898483 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.898428    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"]
Jul 06 13:45:08.900383 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.900359    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jd6nk"]
Jul 06 13:45:08.955295 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.955265    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c51a9c-abac-4b35-8544-eaddeea22068-istio-token\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:45:08.955295 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.955291    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/62c51a9c-abac-4b35-8544-eaddeea22068-istio-csr-ca-configmap\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:45:08.955295 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.955302    2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-istio-kubeconfig\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:45:08.955588 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.955312    2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-cacerts\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:45:08.955588 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.955319    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcz49\" (UniqueName: \"kubernetes.io/projected/62c51a9c-abac-4b35-8544-eaddeea22068-kube-api-access-mcz49\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:45:08.955588 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.955328    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/62c51a9c-abac-4b35-8544-eaddeea22068-istio-csr-dns-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:45:08.955588 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:08.955336    2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c51a9c-abac-4b35-8544-eaddeea22068-local-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:45:09.313874 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:09.313840    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62c51a9c-abac-4b35-8544-eaddeea22068" path="/var/lib/kubelet/pods/62c51a9c-abac-4b35-8544-eaddeea22068/volumes"
Jul 06 13:45:34.843810 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:34.843776    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgqbb"
Jul 06 13:45:34.847391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:34.847366    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nbxmz"
Jul 06 13:45:47.793896 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:47.793860    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc8tm"]
Jul 06 13:45:47.794324 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:47.794237    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c51a9c-abac-4b35-8544-eaddeea22068" containerName="discovery"
Jul 06 13:45:47.794324 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:47.794249    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c51a9c-abac-4b35-8544-eaddeea22068" containerName="discovery"
Jul 06 13:45:47.794324 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:47.794298    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="62c51a9c-abac-4b35-8544-eaddeea22068" containerName="discovery"
Jul 06 13:45:47.797341 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:47.797319    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rc8tm"
Jul 06 13:45:47.800192 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:47.800170    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 13:45:47.800853 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:47.800838    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 13:45:47.828297 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:47.828257    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc8tm"]
Jul 06 13:45:47.890280 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:47.890234    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlnxw\" (UniqueName: \"kubernetes.io/projected/8a3d93d2-ee85-437e-ab26-b0af976a1535-kube-api-access-xlnxw\") pod \"kuadrant-operator-catalog-rc8tm\" (UID: \"8a3d93d2-ee85-437e-ab26-b0af976a1535\") " pod="kuadrant-system/kuadrant-operator-catalog-rc8tm"
Jul 06 13:45:47.991169 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:47.991114    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlnxw\" (UniqueName: \"kubernetes.io/projected/8a3d93d2-ee85-437e-ab26-b0af976a1535-kube-api-access-xlnxw\") pod \"kuadrant-operator-catalog-rc8tm\" (UID: \"8a3d93d2-ee85-437e-ab26-b0af976a1535\") " pod="kuadrant-system/kuadrant-operator-catalog-rc8tm"
Jul 06 13:45:48.004536 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:48.004501    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlnxw\" (UniqueName: \"kubernetes.io/projected/8a3d93d2-ee85-437e-ab26-b0af976a1535-kube-api-access-xlnxw\") pod \"kuadrant-operator-catalog-rc8tm\" (UID: \"8a3d93d2-ee85-437e-ab26-b0af976a1535\") " pod="kuadrant-system/kuadrant-operator-catalog-rc8tm"
Jul 06 13:45:48.093929 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:48.093896    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc8tm"]
Jul 06 13:45:48.094178 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:48.094164    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rc8tm"
Jul 06 13:45:48.242963 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:48.242927    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc8tm"]
Jul 06 13:45:48.246642 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:45:48.246609    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3d93d2_ee85_437e_ab26_b0af976a1535.slice/crio-8c7a56320ea10bf9c7d32015ad5dc48cd60c7332c62da1e956afb70b17d31550 WatchSource:0}: Error finding container 8c7a56320ea10bf9c7d32015ad5dc48cd60c7332c62da1e956afb70b17d31550: Status 404 returned error can't find the container with id 8c7a56320ea10bf9c7d32015ad5dc48cd60c7332c62da1e956afb70b17d31550
Jul 06 13:45:48.313854 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:48.313818    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vghs"]
Jul 06 13:45:48.317159 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:48.317138    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7vghs"
Jul 06 13:45:48.322374 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:48.322348    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-944qd\""
Jul 06 13:45:48.327358 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:48.327329    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vghs"]
Jul 06 13:45:48.395256 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:48.395166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl6xd\" (UniqueName: \"kubernetes.io/projected/a0fb2ab3-e7a8-462a-a365-d61fe8e35307-kube-api-access-kl6xd\") pod \"kuadrant-operator-catalog-7vghs\" (UID: \"a0fb2ab3-e7a8-462a-a365-d61fe8e35307\") " pod="kuadrant-system/kuadrant-operator-catalog-7vghs"
Jul 06 13:45:48.496079 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:48.496017    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl6xd\" (UniqueName: \"kubernetes.io/projected/a0fb2ab3-e7a8-462a-a365-d61fe8e35307-kube-api-access-kl6xd\") pod \"kuadrant-operator-catalog-7vghs\" (UID: \"a0fb2ab3-e7a8-462a-a365-d61fe8e35307\") " pod="kuadrant-system/kuadrant-operator-catalog-7vghs"
Jul 06 13:45:48.507036 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:48.507010    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl6xd\" (UniqueName: \"kubernetes.io/projected/a0fb2ab3-e7a8-462a-a365-d61fe8e35307-kube-api-access-kl6xd\") pod \"kuadrant-operator-catalog-7vghs\" (UID: \"a0fb2ab3-e7a8-462a-a365-d61fe8e35307\") " pod="kuadrant-system/kuadrant-operator-catalog-7vghs"
Jul 06 13:45:48.628221 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:48.628181    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7vghs"
Jul 06 13:45:48.800721 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:48.800687    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vghs"]
Jul 06 13:45:48.814246 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:45:48.814207    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0fb2ab3_e7a8_462a_a365_d61fe8e35307.slice/crio-7083ba39d7724e9d3e2c37ff5fb396884e3ea52c16dd29f45df837c487c68281 WatchSource:0}: Error finding container 7083ba39d7724e9d3e2c37ff5fb396884e3ea52c16dd29f45df837c487c68281: Status 404 returned error can't find the container with id 7083ba39d7724e9d3e2c37ff5fb396884e3ea52c16dd29f45df837c487c68281
Jul 06 13:45:49.064290 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:49.064186    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7vghs" event={"ID":"a0fb2ab3-e7a8-462a-a365-d61fe8e35307","Type":"ContainerStarted","Data":"7083ba39d7724e9d3e2c37ff5fb396884e3ea52c16dd29f45df837c487c68281"}
Jul 06 13:45:49.065399 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:49.065368    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rc8tm" event={"ID":"8a3d93d2-ee85-437e-ab26-b0af976a1535","Type":"ContainerStarted","Data":"8c7a56320ea10bf9c7d32015ad5dc48cd60c7332c62da1e956afb70b17d31550"}
Jul 06 13:45:51.077487 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:51.077456    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rc8tm" event={"ID":"8a3d93d2-ee85-437e-ab26-b0af976a1535","Type":"ContainerStarted","Data":"2e842d33575de86597e57f868e8bce23567e899dafa07719882b3893563636c0"}
Jul 06 13:45:51.077979 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:51.077484    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rc8tm" podUID="8a3d93d2-ee85-437e-ab26-b0af976a1535" containerName="registry-server" containerID="cri-o://2e842d33575de86597e57f868e8bce23567e899dafa07719882b3893563636c0" gracePeriod=2
Jul 06 13:45:51.079093 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:51.079045    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7vghs" event={"ID":"a0fb2ab3-e7a8-462a-a365-d61fe8e35307","Type":"ContainerStarted","Data":"acdb6be21b165425f729fae814e9919de3eaf42c5d29e1d0c23a76932f2e817e"}
Jul 06 13:45:51.137403 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:51.137352    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7vghs" podStartSLOduration=1.639072803 podStartE2EDuration="3.137333732s" totalImagesPullingTime="1.498260929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:51.13655879 +0000 UTC m=+366.448122458" watchObservedRunningTime="2026-07-06 13:45:51.137333732 +0000 UTC m=+366.448897399"
Jul 06 13:45:51.137783 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:51.137762    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rc8tm" podStartSLOduration=2.075574759 podStartE2EDuration="4.137756366s" totalImagesPullingTime="2.062181607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:51.109974632 +0000 UTC m=+366.421538313" watchObservedRunningTime="2026-07-06 13:45:51.137756366 +0000 UTC m=+366.449320033"
Jul 06 13:45:51.329081 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:51.328996    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rc8tm"
Jul 06 13:45:51.418917 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:51.418875    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlnxw\" (UniqueName: \"kubernetes.io/projected/8a3d93d2-ee85-437e-ab26-b0af976a1535-kube-api-access-xlnxw\") pod \"8a3d93d2-ee85-437e-ab26-b0af976a1535\" (UID: \"8a3d93d2-ee85-437e-ab26-b0af976a1535\") "
Jul 06 13:45:51.421198 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:51.421167    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a3d93d2-ee85-437e-ab26-b0af976a1535-kube-api-access-xlnxw" (OuterVolumeSpecName: "kube-api-access-xlnxw") pod "8a3d93d2-ee85-437e-ab26-b0af976a1535" (UID: "8a3d93d2-ee85-437e-ab26-b0af976a1535"). InnerVolumeSpecName "kube-api-access-xlnxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:45:51.522392 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:51.522348    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlnxw\" (UniqueName: \"kubernetes.io/projected/8a3d93d2-ee85-437e-ab26-b0af976a1535-kube-api-access-xlnxw\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:45:52.085183 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:52.085146    2573 generic.go:356] "Generic (PLEG): container finished" podID="8a3d93d2-ee85-437e-ab26-b0af976a1535" containerID="2e842d33575de86597e57f868e8bce23567e899dafa07719882b3893563636c0" exitCode=0
Jul 06 13:45:52.085637 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:52.085212    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rc8tm"
Jul 06 13:45:52.085637 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:52.085242    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rc8tm" event={"ID":"8a3d93d2-ee85-437e-ab26-b0af976a1535","Type":"ContainerDied","Data":"2e842d33575de86597e57f868e8bce23567e899dafa07719882b3893563636c0"}
Jul 06 13:45:52.085637 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:52.085330    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rc8tm" event={"ID":"8a3d93d2-ee85-437e-ab26-b0af976a1535","Type":"ContainerDied","Data":"8c7a56320ea10bf9c7d32015ad5dc48cd60c7332c62da1e956afb70b17d31550"}
Jul 06 13:45:52.085637 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:52.085360    2573 scope.go:117] "RemoveContainer" containerID="2e842d33575de86597e57f868e8bce23567e899dafa07719882b3893563636c0"
Jul 06 13:45:52.094964 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:52.094938    2573 scope.go:117] "RemoveContainer" containerID="2e842d33575de86597e57f868e8bce23567e899dafa07719882b3893563636c0"
Jul 06 13:45:52.095304 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:45:52.095284    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e842d33575de86597e57f868e8bce23567e899dafa07719882b3893563636c0\": container with ID starting with 2e842d33575de86597e57f868e8bce23567e899dafa07719882b3893563636c0 not found: ID does not exist" containerID="2e842d33575de86597e57f868e8bce23567e899dafa07719882b3893563636c0"
Jul 06 13:45:52.095374 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:52.095317    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e842d33575de86597e57f868e8bce23567e899dafa07719882b3893563636c0"} err="failed to get container status \"2e842d33575de86597e57f868e8bce23567e899dafa07719882b3893563636c0\": rpc error: code = NotFound desc = could not find container \"2e842d33575de86597e57f868e8bce23567e899dafa07719882b3893563636c0\": container with ID starting with 2e842d33575de86597e57f868e8bce23567e899dafa07719882b3893563636c0 not found: ID does not exist"
Jul 06 13:45:52.124747 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:52.124705    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc8tm"]
Jul 06 13:45:52.127515 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:52.127487    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc8tm"]
Jul 06 13:45:53.313947 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:53.313910    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a3d93d2-ee85-437e-ab26-b0af976a1535" path="/var/lib/kubelet/pods/8a3d93d2-ee85-437e-ab26-b0af976a1535/volumes"
Jul 06 13:45:58.628563 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:58.628523    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-7vghs"
Jul 06 13:45:58.629115 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:58.628585    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-7vghs"
Jul 06 13:45:58.651695 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:58.651665    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-7vghs"
Jul 06 13:45:59.141548 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:45:59.141524    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-7vghs"
Jul 06 13:46:15.469217 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.469184    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"]
Jul 06 13:46:15.469691 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.469597    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a3d93d2-ee85-437e-ab26-b0af976a1535" containerName="registry-server"
Jul 06 13:46:15.469691 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.469614    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a3d93d2-ee85-437e-ab26-b0af976a1535" containerName="registry-server"
Jul 06 13:46:15.469775 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.469698    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a3d93d2-ee85-437e-ab26-b0af976a1535" containerName="registry-server"
Jul 06 13:46:15.471863 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.471845    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:15.475468 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.475449    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wjqtl\""
Jul 06 13:46:15.491037 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.491011    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"]
Jul 06 13:46:15.525867 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.521523    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkvpp\" (UniqueName: \"kubernetes.io/projected/7018cb0d-a30f-4023-8f80-7dfdb07dfa15-kube-api-access-dkvpp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6rqh5\" (UID: \"7018cb0d-a30f-4023-8f80-7dfdb07dfa15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:15.525867 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.521596    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7018cb0d-a30f-4023-8f80-7dfdb07dfa15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6rqh5\" (UID: \"7018cb0d-a30f-4023-8f80-7dfdb07dfa15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:15.622426 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.622378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkvpp\" (UniqueName: \"kubernetes.io/projected/7018cb0d-a30f-4023-8f80-7dfdb07dfa15-kube-api-access-dkvpp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6rqh5\" (UID: \"7018cb0d-a30f-4023-8f80-7dfdb07dfa15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:15.622623 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.622438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7018cb0d-a30f-4023-8f80-7dfdb07dfa15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6rqh5\" (UID: \"7018cb0d-a30f-4023-8f80-7dfdb07dfa15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:15.622842 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.622822    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7018cb0d-a30f-4023-8f80-7dfdb07dfa15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6rqh5\" (UID: \"7018cb0d-a30f-4023-8f80-7dfdb07dfa15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:15.650500 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.650464    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkvpp\" (UniqueName: \"kubernetes.io/projected/7018cb0d-a30f-4023-8f80-7dfdb07dfa15-kube-api-access-dkvpp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6rqh5\" (UID: \"7018cb0d-a30f-4023-8f80-7dfdb07dfa15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:15.782084 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.781967    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:15.943434 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:15.943398    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"]
Jul 06 13:46:15.944360 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:46:15.944329    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7018cb0d_a30f_4023_8f80_7dfdb07dfa15.slice/crio-fe573d75bba0082e6298405ca84f2b2b8eb6b128d4945d78d8ac7f43ebea4b32 WatchSource:0}: Error finding container fe573d75bba0082e6298405ca84f2b2b8eb6b128d4945d78d8ac7f43ebea4b32: Status 404 returned error can't find the container with id fe573d75bba0082e6298405ca84f2b2b8eb6b128d4945d78d8ac7f43ebea4b32
Jul 06 13:46:16.200104 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:16.200072    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5" event={"ID":"7018cb0d-a30f-4023-8f80-7dfdb07dfa15","Type":"ContainerStarted","Data":"fe573d75bba0082e6298405ca84f2b2b8eb6b128d4945d78d8ac7f43ebea4b32"}
Jul 06 13:46:18.203536 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:18.203497    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xrv2r"]
Jul 06 13:46:18.206222 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:18.206192    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xrv2r"
Jul 06 13:46:18.209741 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:18.209709    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fb5sq\""
Jul 06 13:46:18.234637 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:18.234605    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xrv2r"]
Jul 06 13:46:18.242372 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:18.242339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dv56\" (UniqueName: \"kubernetes.io/projected/847d8d1d-6bb1-42f9-be75-ca7ff339705c-kube-api-access-2dv56\") pod \"authorino-operator-75cc8d5cb7-xrv2r\" (UID: \"847d8d1d-6bb1-42f9-be75-ca7ff339705c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xrv2r"
Jul 06 13:46:18.342961 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:18.342919    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dv56\" (UniqueName: \"kubernetes.io/projected/847d8d1d-6bb1-42f9-be75-ca7ff339705c-kube-api-access-2dv56\") pod \"authorino-operator-75cc8d5cb7-xrv2r\" (UID: \"847d8d1d-6bb1-42f9-be75-ca7ff339705c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xrv2r"
Jul 06 13:46:18.355689 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:18.355651    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dv56\" (UniqueName: \"kubernetes.io/projected/847d8d1d-6bb1-42f9-be75-ca7ff339705c-kube-api-access-2dv56\") pod \"authorino-operator-75cc8d5cb7-xrv2r\" (UID: \"847d8d1d-6bb1-42f9-be75-ca7ff339705c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xrv2r"
Jul 06 13:46:18.520754 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:18.520651    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xrv2r"
Jul 06 13:46:18.706630 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:18.706595    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xrv2r"]
Jul 06 13:46:18.708117 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:46:18.708086    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod847d8d1d_6bb1_42f9_be75_ca7ff339705c.slice/crio-7eb52fa630e9709f76d3e2d6a7175159f05ed2f6c3da82926f9dfaac7a56e7c7 WatchSource:0}: Error finding container 7eb52fa630e9709f76d3e2d6a7175159f05ed2f6c3da82926f9dfaac7a56e7c7: Status 404 returned error can't find the container with id 7eb52fa630e9709f76d3e2d6a7175159f05ed2f6c3da82926f9dfaac7a56e7c7
Jul 06 13:46:19.218910 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:19.218870    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xrv2r" event={"ID":"847d8d1d-6bb1-42f9-be75-ca7ff339705c","Type":"ContainerStarted","Data":"7eb52fa630e9709f76d3e2d6a7175159f05ed2f6c3da82926f9dfaac7a56e7c7"}
Jul 06 13:46:20.238552 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:20.238521    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"]
Jul 06 13:46:20.242382 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:20.242357    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"
Jul 06 13:46:20.247393 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:20.247367    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xz57v\""
Jul 06 13:46:20.274774 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:20.274739    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"]
Jul 06 13:46:20.362406 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:20.362367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87vfb\" (UniqueName: \"kubernetes.io/projected/69939fce-c97b-417d-bff3-1c0147ede707-kube-api-access-87vfb\") pod \"limitador-operator-controller-manager-859d7b78bd-l9rrk\" (UID: \"69939fce-c97b-417d-bff3-1c0147ede707\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"
Jul 06 13:46:20.463104 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:20.463043    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87vfb\" (UniqueName: \"kubernetes.io/projected/69939fce-c97b-417d-bff3-1c0147ede707-kube-api-access-87vfb\") pod \"limitador-operator-controller-manager-859d7b78bd-l9rrk\" (UID: \"69939fce-c97b-417d-bff3-1c0147ede707\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"
Jul 06 13:46:20.485830 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:20.485797    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87vfb\" (UniqueName: \"kubernetes.io/projected/69939fce-c97b-417d-bff3-1c0147ede707-kube-api-access-87vfb\") pod \"limitador-operator-controller-manager-859d7b78bd-l9rrk\" (UID: \"69939fce-c97b-417d-bff3-1c0147ede707\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"
Jul 06 13:46:20.556176 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:20.556087    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"
Jul 06 13:46:22.545176 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:22.545142    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"]
Jul 06 13:46:22.546982 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:46:22.546936    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69939fce_c97b_417d_bff3_1c0147ede707.slice/crio-4f5e318b1bec77edb7bf8fc77e248f26b7063b88e9804358d140c67220bd800f WatchSource:0}: Error finding container 4f5e318b1bec77edb7bf8fc77e248f26b7063b88e9804358d140c67220bd800f: Status 404 returned error can't find the container with id 4f5e318b1bec77edb7bf8fc77e248f26b7063b88e9804358d140c67220bd800f
Jul 06 13:46:23.247315 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:23.247224    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5" event={"ID":"7018cb0d-a30f-4023-8f80-7dfdb07dfa15","Type":"ContainerStarted","Data":"0c5701ff6aaaa91d8f13818b0c8b9f02e2cdccb0636794d22a4542cefbf5bb3d"}
Jul 06 13:46:23.247511 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:23.247415    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:23.249275 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:23.249242    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk" event={"ID":"69939fce-c97b-417d-bff3-1c0147ede707","Type":"ContainerStarted","Data":"4f5e318b1bec77edb7bf8fc77e248f26b7063b88e9804358d140c67220bd800f"}
Jul 06 13:46:23.251227 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:23.251184    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xrv2r" event={"ID":"847d8d1d-6bb1-42f9-be75-ca7ff339705c","Type":"ContainerStarted","Data":"01b3ba1383a8643ee644e24e28851eafec4cec0bcd5bf3b13e7eb3403d974c11"}
Jul 06 13:46:23.251371 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:23.251276    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xrv2r"
Jul 06 13:46:23.313614 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:23.313176    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5" podStartSLOduration=1.857778916 podStartE2EDuration="8.313154136s" totalImagesPullingTime="6.45537522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:23.311221342 +0000 UTC m=+398.622785009" watchObservedRunningTime="2026-07-06 13:46:23.313154136 +0000 UTC m=+398.624717806"
Jul 06 13:46:23.389347 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:23.389293    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xrv2r" podStartSLOduration=1.698051926 podStartE2EDuration="5.38927601s" totalImagesPullingTime="3.691224084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:23.387426134 +0000 UTC m=+398.698989802" watchObservedRunningTime="2026-07-06 13:46:23.38927601 +0000 UTC m=+398.700839731"
Jul 06 13:46:24.258775 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:24.258733    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk" event={"ID":"69939fce-c97b-417d-bff3-1c0147ede707","Type":"ContainerStarted","Data":"e18d8ededd050427b0f988d812ffd5dbc01abb2a3547e62ecf1c3854ccfeb05f"}
Jul 06 13:46:24.259253 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:24.258832    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"
Jul 06 13:46:24.275873 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:24.275813    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk" podStartSLOduration=2.637816418 podStartE2EDuration="4.275796524s" totalImagesPullingTime="1.637980106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:24.275034166 +0000 UTC m=+399.586597847" watchObservedRunningTime="2026-07-06 13:46:24.275796524 +0000 UTC m=+399.587360191"
Jul 06 13:46:34.260989 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:34.260957    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:34.261410 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:34.261032    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xrv2r"
Jul 06 13:46:35.266391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:35.266362    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"
Jul 06 13:46:36.572040 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.572002    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"]
Jul 06 13:46:36.572499 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.572218    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5" podUID="7018cb0d-a30f-4023-8f80-7dfdb07dfa15" containerName="manager" containerID="cri-o://0c5701ff6aaaa91d8f13818b0c8b9f02e2cdccb0636794d22a4542cefbf5bb3d" gracePeriod=2
Jul 06 13:46:36.583147 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.583115    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"]
Jul 06 13:46:36.613712 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.613678    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"]
Jul 06 13:46:36.613892 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.613869    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk" podUID="69939fce-c97b-417d-bff3-1c0147ede707" containerName="manager" containerID="cri-o://e18d8ededd050427b0f988d812ffd5dbc01abb2a3547e62ecf1c3854ccfeb05f" gracePeriod=2
Jul 06 13:46:36.627223 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.627190    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"]
Jul 06 13:46:36.627787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.627750    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7018cb0d-a30f-4023-8f80-7dfdb07dfa15" containerName="manager"
Jul 06 13:46:36.627787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.627771    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7018cb0d-a30f-4023-8f80-7dfdb07dfa15" containerName="manager"
Jul 06 13:46:36.627956 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.627883    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7018cb0d-a30f-4023-8f80-7dfdb07dfa15" containerName="manager"
Jul 06 13:46:36.630136 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.630076    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"]
Jul 06 13:46:36.630241 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.630158    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"
Jul 06 13:46:36.678437 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.678404    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qgz4h"]
Jul 06 13:46:36.678828 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.678812    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69939fce-c97b-417d-bff3-1c0147ede707" containerName="manager"
Jul 06 13:46:36.678900 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.678831    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="69939fce-c97b-417d-bff3-1c0147ede707" containerName="manager"
Jul 06 13:46:36.678957 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.678911    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="69939fce-c97b-417d-bff3-1c0147ede707" containerName="manager"
Jul 06 13:46:36.680926 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.680905    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qgz4h"
Jul 06 13:46:36.703817 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:46:36.703775    2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"69939fce-c97b-417d-bff3-1c0147ede707\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-l9rrk\": pods \"limitador-operator-controller-manager-859d7b78bd-l9rrk\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"
Jul 06 13:46:36.705407 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.705384    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"]
Jul 06 13:46:36.709328 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.709304    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckxql\" (UniqueName: \"kubernetes.io/projected/8670528d-51c5-430c-bf0d-8a82dc62e865-kube-api-access-ckxql\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kcvv4\" (UID: \"8670528d-51c5-430c-bf0d-8a82dc62e865\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"
Jul 06 13:46:36.709503 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.709361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8670528d-51c5-430c-bf0d-8a82dc62e865-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kcvv4\" (UID: \"8670528d-51c5-430c-bf0d-8a82dc62e865\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"
Jul 06 13:46:36.713190 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:46:36.713154    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6rqh5\" is forbidden: User \"system:node:ip-10-0-134-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-86.ec2.internal' and this object" podUID="7018cb0d-a30f-4023-8f80-7dfdb07dfa15" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:36.717649 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:46:36.717618    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l9rrk\" is forbidden: User \"system:node:ip-10-0-134-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-86.ec2.internal' and this object" podUID="69939fce-c97b-417d-bff3-1c0147ede707" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"
Jul 06 13:46:36.721137 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:46:36.721028    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6rqh5\" is forbidden: User \"system:node:ip-10-0-134-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-86.ec2.internal' and this object" podUID="7018cb0d-a30f-4023-8f80-7dfdb07dfa15" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:36.747008 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.746971    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qgz4h"]
Jul 06 13:46:36.810622 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.810588    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckxql\" (UniqueName: \"kubernetes.io/projected/8670528d-51c5-430c-bf0d-8a82dc62e865-kube-api-access-ckxql\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kcvv4\" (UID: \"8670528d-51c5-430c-bf0d-8a82dc62e865\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"
Jul 06 13:46:36.810786 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.810646    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92bf6\" (UniqueName: \"kubernetes.io/projected/b909490c-bff1-49a5-a8f4-1bb878c48223-kube-api-access-92bf6\") pod \"limitador-operator-controller-manager-859d7b78bd-qgz4h\" (UID: \"b909490c-bff1-49a5-a8f4-1bb878c48223\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qgz4h"
Jul 06 13:46:36.810786 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.810669    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8670528d-51c5-430c-bf0d-8a82dc62e865-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kcvv4\" (UID: \"8670528d-51c5-430c-bf0d-8a82dc62e865\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"
Jul 06 13:46:36.811149 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.811123    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8670528d-51c5-430c-bf0d-8a82dc62e865-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kcvv4\" (UID: \"8670528d-51c5-430c-bf0d-8a82dc62e865\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"
Jul 06 13:46:36.855506 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.855475    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckxql\" (UniqueName: \"kubernetes.io/projected/8670528d-51c5-430c-bf0d-8a82dc62e865-kube-api-access-ckxql\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kcvv4\" (UID: \"8670528d-51c5-430c-bf0d-8a82dc62e865\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"
Jul 06 13:46:36.877864 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.877837    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:36.880951 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.880919    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"
Jul 06 13:46:36.883920 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:46:36.883891    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l9rrk\" is forbidden: User \"system:node:ip-10-0-134-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-86.ec2.internal' and this object" podUID="69939fce-c97b-417d-bff3-1c0147ede707" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"
Jul 06 13:46:36.893546 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:46:36.893516    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6rqh5\" is forbidden: User \"system:node:ip-10-0-134-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-86.ec2.internal' and this object" podUID="7018cb0d-a30f-4023-8f80-7dfdb07dfa15" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:36.896877 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:46:36.896851    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l9rrk\" is forbidden: User \"system:node:ip-10-0-134-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-86.ec2.internal' and this object" podUID="69939fce-c97b-417d-bff3-1c0147ede707" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"
Jul 06 13:46:36.902595 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:46:36.902567    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6rqh5\" is forbidden: User \"system:node:ip-10-0-134-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-86.ec2.internal' and this object" podUID="7018cb0d-a30f-4023-8f80-7dfdb07dfa15" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:36.912015 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.911989    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92bf6\" (UniqueName: \"kubernetes.io/projected/b909490c-bff1-49a5-a8f4-1bb878c48223-kube-api-access-92bf6\") pod \"limitador-operator-controller-manager-859d7b78bd-qgz4h\" (UID: \"b909490c-bff1-49a5-a8f4-1bb878c48223\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qgz4h"
Jul 06 13:46:36.929472 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:36.929443    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92bf6\" (UniqueName: \"kubernetes.io/projected/b909490c-bff1-49a5-a8f4-1bb878c48223-kube-api-access-92bf6\") pod \"limitador-operator-controller-manager-859d7b78bd-qgz4h\" (UID: \"b909490c-bff1-49a5-a8f4-1bb878c48223\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qgz4h"
Jul 06 13:46:37.012607 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.012573    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7018cb0d-a30f-4023-8f80-7dfdb07dfa15-extensions-socket-volume\") pod \"7018cb0d-a30f-4023-8f80-7dfdb07dfa15\" (UID: \"7018cb0d-a30f-4023-8f80-7dfdb07dfa15\") "
Jul 06 13:46:37.012776 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.012665    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkvpp\" (UniqueName: \"kubernetes.io/projected/7018cb0d-a30f-4023-8f80-7dfdb07dfa15-kube-api-access-dkvpp\") pod \"7018cb0d-a30f-4023-8f80-7dfdb07dfa15\" (UID: \"7018cb0d-a30f-4023-8f80-7dfdb07dfa15\") "
Jul 06 13:46:37.012776 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.012712    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87vfb\" (UniqueName: \"kubernetes.io/projected/69939fce-c97b-417d-bff3-1c0147ede707-kube-api-access-87vfb\") pod \"69939fce-c97b-417d-bff3-1c0147ede707\" (UID: \"69939fce-c97b-417d-bff3-1c0147ede707\") "
Jul 06 13:46:37.013206 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.013173    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7018cb0d-a30f-4023-8f80-7dfdb07dfa15-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7018cb0d-a30f-4023-8f80-7dfdb07dfa15" (UID: "7018cb0d-a30f-4023-8f80-7dfdb07dfa15"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:46:37.014660 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.014638    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7018cb0d-a30f-4023-8f80-7dfdb07dfa15-kube-api-access-dkvpp" (OuterVolumeSpecName: "kube-api-access-dkvpp") pod "7018cb0d-a30f-4023-8f80-7dfdb07dfa15" (UID: "7018cb0d-a30f-4023-8f80-7dfdb07dfa15"). InnerVolumeSpecName "kube-api-access-dkvpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:46:37.014732 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.014702    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69939fce-c97b-417d-bff3-1c0147ede707-kube-api-access-87vfb" (OuterVolumeSpecName: "kube-api-access-87vfb") pod "69939fce-c97b-417d-bff3-1c0147ede707" (UID: "69939fce-c97b-417d-bff3-1c0147ede707"). InnerVolumeSpecName "kube-api-access-87vfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:46:37.018891 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.018867    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"
Jul 06 13:46:37.027799 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.027768    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qgz4h"
Jul 06 13:46:37.113634 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.113599    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87vfb\" (UniqueName: \"kubernetes.io/projected/69939fce-c97b-417d-bff3-1c0147ede707-kube-api-access-87vfb\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:46:37.113634 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.113634    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7018cb0d-a30f-4023-8f80-7dfdb07dfa15-extensions-socket-volume\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:46:37.113779 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.113648    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkvpp\" (UniqueName: \"kubernetes.io/projected/7018cb0d-a30f-4023-8f80-7dfdb07dfa15-kube-api-access-dkvpp\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:46:37.216527 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.216487    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"]
Jul 06 13:46:37.231916 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:46:37.231887    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8670528d_51c5_430c_bf0d_8a82dc62e865.slice/crio-ddd9c14d0c950b4b742ab1e57af0de0350d601a9adc1fe2ea7a1e2bc9d445721 WatchSource:0}: Error finding container ddd9c14d0c950b4b742ab1e57af0de0350d601a9adc1fe2ea7a1e2bc9d445721: Status 404 returned error can't find the container with id ddd9c14d0c950b4b742ab1e57af0de0350d601a9adc1fe2ea7a1e2bc9d445721
Jul 06 13:46:37.265086 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.260885    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qgz4h"]
Jul 06 13:46:37.277266 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:46:37.277235    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb909490c_bff1_49a5_a8f4_1bb878c48223.slice/crio-b292767079c65d0158b4c3bda7b0c5e9d9e2bd6850842ca7b3565cdc632e1be6 WatchSource:0}: Error finding container b292767079c65d0158b4c3bda7b0c5e9d9e2bd6850842ca7b3565cdc632e1be6: Status 404 returned error can't find the container with id b292767079c65d0158b4c3bda7b0c5e9d9e2bd6850842ca7b3565cdc632e1be6
Jul 06 13:46:37.313878 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.313836    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69939fce-c97b-417d-bff3-1c0147ede707" path="/var/lib/kubelet/pods/69939fce-c97b-417d-bff3-1c0147ede707/volumes"
Jul 06 13:46:37.314227 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.314212    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7018cb0d-a30f-4023-8f80-7dfdb07dfa15" path="/var/lib/kubelet/pods/7018cb0d-a30f-4023-8f80-7dfdb07dfa15/volumes"
Jul 06 13:46:37.323990 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.323959    2573 generic.go:356] "Generic (PLEG): container finished" podID="7018cb0d-a30f-4023-8f80-7dfdb07dfa15" containerID="0c5701ff6aaaa91d8f13818b0c8b9f02e2cdccb0636794d22a4542cefbf5bb3d" exitCode=0
Jul 06 13:46:37.324168 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.324014    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6rqh5"
Jul 06 13:46:37.324168 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.324064    2573 scope.go:117] "RemoveContainer" containerID="0c5701ff6aaaa91d8f13818b0c8b9f02e2cdccb0636794d22a4542cefbf5bb3d"
Jul 06 13:46:37.326204 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.326180    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4" event={"ID":"8670528d-51c5-430c-bf0d-8a82dc62e865","Type":"ContainerStarted","Data":"2cde2e05adebe68182efd5135caace445076d6cda1ff70aa1a480d2fc9dc349d"}
Jul 06 13:46:37.326306 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.326232    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4" event={"ID":"8670528d-51c5-430c-bf0d-8a82dc62e865","Type":"ContainerStarted","Data":"ddd9c14d0c950b4b742ab1e57af0de0350d601a9adc1fe2ea7a1e2bc9d445721"}
Jul 06 13:46:37.326306 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.326258    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"
Jul 06 13:46:37.327845 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.327821    2573 generic.go:356] "Generic (PLEG): container finished" podID="69939fce-c97b-417d-bff3-1c0147ede707" containerID="e18d8ededd050427b0f988d812ffd5dbc01abb2a3547e62ecf1c3854ccfeb05f" exitCode=0
Jul 06 13:46:37.327956 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.327913    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9rrk"
Jul 06 13:46:37.329312 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.329283    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qgz4h" event={"ID":"b909490c-bff1-49a5-a8f4-1bb878c48223","Type":"ContainerStarted","Data":"b292767079c65d0158b4c3bda7b0c5e9d9e2bd6850842ca7b3565cdc632e1be6"}
Jul 06 13:46:37.347796 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.347766    2573 scope.go:117] "RemoveContainer" containerID="0c5701ff6aaaa91d8f13818b0c8b9f02e2cdccb0636794d22a4542cefbf5bb3d"
Jul 06 13:46:37.348282 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:46:37.348254    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c5701ff6aaaa91d8f13818b0c8b9f02e2cdccb0636794d22a4542cefbf5bb3d\": container with ID starting with 0c5701ff6aaaa91d8f13818b0c8b9f02e2cdccb0636794d22a4542cefbf5bb3d not found: ID does not exist" containerID="0c5701ff6aaaa91d8f13818b0c8b9f02e2cdccb0636794d22a4542cefbf5bb3d"
Jul 06 13:46:37.348398 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.348293    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c5701ff6aaaa91d8f13818b0c8b9f02e2cdccb0636794d22a4542cefbf5bb3d"} err="failed to get container status \"0c5701ff6aaaa91d8f13818b0c8b9f02e2cdccb0636794d22a4542cefbf5bb3d\": rpc error: code = NotFound desc = could not find container \"0c5701ff6aaaa91d8f13818b0c8b9f02e2cdccb0636794d22a4542cefbf5bb3d\": container with ID starting with 0c5701ff6aaaa91d8f13818b0c8b9f02e2cdccb0636794d22a4542cefbf5bb3d not found: ID does not exist"
Jul 06 13:46:37.348398 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.348317    2573 scope.go:117] "RemoveContainer" containerID="e18d8ededd050427b0f988d812ffd5dbc01abb2a3547e62ecf1c3854ccfeb05f"
Jul 06 13:46:37.357742 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.357718    2573 scope.go:117] "RemoveContainer" containerID="e18d8ededd050427b0f988d812ffd5dbc01abb2a3547e62ecf1c3854ccfeb05f"
Jul 06 13:46:37.358092 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:46:37.358073    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e18d8ededd050427b0f988d812ffd5dbc01abb2a3547e62ecf1c3854ccfeb05f\": container with ID starting with e18d8ededd050427b0f988d812ffd5dbc01abb2a3547e62ecf1c3854ccfeb05f not found: ID does not exist" containerID="e18d8ededd050427b0f988d812ffd5dbc01abb2a3547e62ecf1c3854ccfeb05f"
Jul 06 13:46:37.358175 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.358101    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e18d8ededd050427b0f988d812ffd5dbc01abb2a3547e62ecf1c3854ccfeb05f"} err="failed to get container status \"e18d8ededd050427b0f988d812ffd5dbc01abb2a3547e62ecf1c3854ccfeb05f\": rpc error: code = NotFound desc = could not find container \"e18d8ededd050427b0f988d812ffd5dbc01abb2a3547e62ecf1c3854ccfeb05f\": container with ID starting with e18d8ededd050427b0f988d812ffd5dbc01abb2a3547e62ecf1c3854ccfeb05f not found: ID does not exist"
Jul 06 13:46:37.387211 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:37.387095    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4" podStartSLOduration=1.38707646 podStartE2EDuration="1.38707646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:37.386127236 +0000 UTC m=+412.697690932" watchObservedRunningTime="2026-07-06 13:46:37.38707646 +0000 UTC m=+412.698640127"
Jul 06 13:46:38.338388 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:38.338354    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qgz4h" event={"ID":"b909490c-bff1-49a5-a8f4-1bb878c48223","Type":"ContainerStarted","Data":"074781a19b7a1f9dc7021f66ce53216d9b37702ba7cd61244d0ac9e2f3dacc46"}
Jul 06 13:46:38.338828 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:38.338632    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qgz4h"
Jul 06 13:46:48.340613 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:48.340581    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"
Jul 06 13:46:48.371767 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:48.371715    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qgz4h" podStartSLOduration=12.371698572 podStartE2EDuration="12.371698572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:38.39459403 +0000 UTC m=+413.706157712" watchObservedRunningTime="2026-07-06 13:46:48.371698572 +0000 UTC m=+423.683262239"
Jul 06 13:46:49.346200 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:49.346171    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qgz4h"
Jul 06 13:46:55.885915 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:55.885873    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"]
Jul 06 13:46:55.886498 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:55.886091    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4" podUID="8670528d-51c5-430c-bf0d-8a82dc62e865" containerName="manager" containerID="cri-o://2cde2e05adebe68182efd5135caace445076d6cda1ff70aa1a480d2fc9dc349d" gracePeriod=10
Jul 06 13:46:56.170731 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.170699    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"
Jul 06 13:46:56.179271 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.179243    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8670528d-51c5-430c-bf0d-8a82dc62e865-extensions-socket-volume\") pod \"8670528d-51c5-430c-bf0d-8a82dc62e865\" (UID: \"8670528d-51c5-430c-bf0d-8a82dc62e865\") "
Jul 06 13:46:56.179439 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.179305    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckxql\" (UniqueName: \"kubernetes.io/projected/8670528d-51c5-430c-bf0d-8a82dc62e865-kube-api-access-ckxql\") pod \"8670528d-51c5-430c-bf0d-8a82dc62e865\" (UID: \"8670528d-51c5-430c-bf0d-8a82dc62e865\") "
Jul 06 13:46:56.179709 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.179683    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8670528d-51c5-430c-bf0d-8a82dc62e865-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8670528d-51c5-430c-bf0d-8a82dc62e865" (UID: "8670528d-51c5-430c-bf0d-8a82dc62e865"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:46:56.181487 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.181444    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8670528d-51c5-430c-bf0d-8a82dc62e865-kube-api-access-ckxql" (OuterVolumeSpecName: "kube-api-access-ckxql") pod "8670528d-51c5-430c-bf0d-8a82dc62e865" (UID: "8670528d-51c5-430c-bf0d-8a82dc62e865"). InnerVolumeSpecName "kube-api-access-ckxql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:46:56.280276 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.280229    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8670528d-51c5-430c-bf0d-8a82dc62e865-extensions-socket-volume\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:46:56.280276 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.280262    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckxql\" (UniqueName: \"kubernetes.io/projected/8670528d-51c5-430c-bf0d-8a82dc62e865-kube-api-access-ckxql\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:46:56.427224 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.427121    2573 generic.go:356] "Generic (PLEG): container finished" podID="8670528d-51c5-430c-bf0d-8a82dc62e865" containerID="2cde2e05adebe68182efd5135caace445076d6cda1ff70aa1a480d2fc9dc349d" exitCode=0
Jul 06 13:46:56.427224 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.427171    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"
Jul 06 13:46:56.427224 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.427208    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4" event={"ID":"8670528d-51c5-430c-bf0d-8a82dc62e865","Type":"ContainerDied","Data":"2cde2e05adebe68182efd5135caace445076d6cda1ff70aa1a480d2fc9dc349d"}
Jul 06 13:46:56.427464 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.427263    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4" event={"ID":"8670528d-51c5-430c-bf0d-8a82dc62e865","Type":"ContainerDied","Data":"ddd9c14d0c950b4b742ab1e57af0de0350d601a9adc1fe2ea7a1e2bc9d445721"}
Jul 06 13:46:56.427464 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.427286    2573 scope.go:117] "RemoveContainer" containerID="2cde2e05adebe68182efd5135caace445076d6cda1ff70aa1a480d2fc9dc349d"
Jul 06 13:46:56.438219 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.438160    2573 scope.go:117] "RemoveContainer" containerID="2cde2e05adebe68182efd5135caace445076d6cda1ff70aa1a480d2fc9dc349d"
Jul 06 13:46:56.438657 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:46:56.438628    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cde2e05adebe68182efd5135caace445076d6cda1ff70aa1a480d2fc9dc349d\": container with ID starting with 2cde2e05adebe68182efd5135caace445076d6cda1ff70aa1a480d2fc9dc349d not found: ID does not exist" containerID="2cde2e05adebe68182efd5135caace445076d6cda1ff70aa1a480d2fc9dc349d"
Jul 06 13:46:56.438752 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.438667    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cde2e05adebe68182efd5135caace445076d6cda1ff70aa1a480d2fc9dc349d"} err="failed to get container status \"2cde2e05adebe68182efd5135caace445076d6cda1ff70aa1a480d2fc9dc349d\": rpc error: code = NotFound desc = could not find container \"2cde2e05adebe68182efd5135caace445076d6cda1ff70aa1a480d2fc9dc349d\": container with ID starting with 2cde2e05adebe68182efd5135caace445076d6cda1ff70aa1a480d2fc9dc349d not found: ID does not exist"
Jul 06 13:46:56.457159 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.457124    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"]
Jul 06 13:46:56.465483 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:56.465452    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kcvv4"]
Jul 06 13:46:57.313975 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:46:57.313943    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8670528d-51c5-430c-bf0d-8a82dc62e865" path="/var/lib/kubelet/pods/8670528d-51c5-430c-bf0d-8a82dc62e865/volumes"
Jul 06 13:47:12.639000 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.638898    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"]
Jul 06 13:47:12.639614 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.639536    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8670528d-51c5-430c-bf0d-8a82dc62e865" containerName="manager"
Jul 06 13:47:12.639614 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.639560    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8670528d-51c5-430c-bf0d-8a82dc62e865" containerName="manager"
Jul 06 13:47:12.639732 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.639632    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8670528d-51c5-430c-bf0d-8a82dc62e865" containerName="manager"
Jul 06 13:47:12.641884 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.641857    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.660591 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:47:12.660546    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" is forbidden: User \"system:node:ip-10-0-134-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-86.ec2.internal' and this object" podUID="30405940-ed0a-4e35-844f-e8aa9ba80f3b" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.660780 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:47:12.660761    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-default-gateway-openshift-default-dockercfg-9n2bb\" is forbidden: User \"system:node:ip-10-0-134-86.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-86.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9n2bb\"" type="*v1.Secret"
Jul 06 13:47:12.715209 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.715173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.715413 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.715217    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.715413 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.715257    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.715413 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.715284    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.715579 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.715443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.715579 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.715511    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.715579 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.715538    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.715729 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.715575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wsnt\" (UniqueName: \"kubernetes.io/projected/30405940-ed0a-4e35-844f-e8aa9ba80f3b-kube-api-access-9wsnt\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.715729 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.715668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.738772 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.738735    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"]
Jul 06 13:47:12.816598 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.816562    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.816806 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.816609    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.816806 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.816630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.816806 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.816648    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wsnt\" (UniqueName: \"kubernetes.io/projected/30405940-ed0a-4e35-844f-e8aa9ba80f3b-kube-api-access-9wsnt\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.816806 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.816682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.816806 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.816723    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.816806 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.816745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.816806 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.816781    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.816806 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.816804    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.817262 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.817102    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.817262 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.817167    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.817262 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.817202    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.817443 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.817412    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.817576 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.817410    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.819357 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.819326    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.819516 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.819495    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.834026 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.833984    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30405940-ed0a-4e35-844f-e8aa9ba80f3b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:12.848351 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:12.848321    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wsnt\" (UniqueName: \"kubernetes.io/projected/30405940-ed0a-4e35-844f-e8aa9ba80f3b-kube-api-access-9wsnt\") pod \"maas-default-gateway-openshift-default-56654dcf7-lw78z\" (UID: \"30405940-ed0a-4e35-844f-e8aa9ba80f3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:13.953628 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:13.953581    2573 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z" secret="" err="failed to sync secret cache: timed out waiting for the condition"
Jul 06 13:47:13.954132 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:13.953692    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:14.125842 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:14.125779    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"]
Jul 06 13:47:14.128178 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:47:14.128151    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30405940_ed0a_4e35_844f_e8aa9ba80f3b.slice/crio-d3b6e143e14ff9281c3a019dfe615680c629d5438d3636e4a81b3017ec10bd95 WatchSource:0}: Error finding container d3b6e143e14ff9281c3a019dfe615680c629d5438d3636e4a81b3017ec10bd95: Status 404 returned error can't find the container with id d3b6e143e14ff9281c3a019dfe615680c629d5438d3636e4a81b3017ec10bd95
Jul 06 13:47:14.130647 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:14.130605    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:47:14.130740 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:14.130704    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:47:14.130786 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:14.130750    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:47:14.233954 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:14.233924    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9n2bb\""
Jul 06 13:47:14.518361 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:14.518258    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z" event={"ID":"30405940-ed0a-4e35-844f-e8aa9ba80f3b","Type":"ContainerStarted","Data":"abb46c1bdc4b554d6c269f309ee7485d7dbb4b857f4ba9e1546cdcab560edd56"}
Jul 06 13:47:14.518361 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:14.518327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z" event={"ID":"30405940-ed0a-4e35-844f-e8aa9ba80f3b","Type":"ContainerStarted","Data":"d3b6e143e14ff9281c3a019dfe615680c629d5438d3636e4a81b3017ec10bd95"}
Jul 06 13:47:14.554152 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:14.554079    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z" podStartSLOduration=2.554021543 podStartE2EDuration="2.554021543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:47:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:14.550111792 +0000 UTC m=+449.861675454" watchObservedRunningTime="2026-07-06 13:47:14.554021543 +0000 UTC m=+449.865585213"
Jul 06 13:47:14.954549 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:14.954505    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:15.852255 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:15.852204    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"]
Jul 06 13:47:15.854668 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:15.854647    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"
Jul 06 13:47:15.857695 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:15.857671    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 13:47:15.857851 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:15.857671    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f8f7k\""
Jul 06 13:47:15.870114 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:15.870079    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"]
Jul 06 13:47:15.941933 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:15.941894    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"]
Jul 06 13:47:15.943380 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:15.943350    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6fxl\" (UniqueName: \"kubernetes.io/projected/ad92bfd0-8ec0-4193-8af1-572d2d94cc5e-kube-api-access-m6fxl\") pod \"limitador-limitador-64c94fd64f-4kn7z\" (UID: \"ad92bfd0-8ec0-4193-8af1-572d2d94cc5e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"
Jul 06 13:47:15.943493 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:15.943400    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad92bfd0-8ec0-4193-8af1-572d2d94cc5e-config-file\") pod \"limitador-limitador-64c94fd64f-4kn7z\" (UID: \"ad92bfd0-8ec0-4193-8af1-572d2d94cc5e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"
Jul 06 13:47:15.959245 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:15.959210    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:16.045046 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.045005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6fxl\" (UniqueName: \"kubernetes.io/projected/ad92bfd0-8ec0-4193-8af1-572d2d94cc5e-kube-api-access-m6fxl\") pod \"limitador-limitador-64c94fd64f-4kn7z\" (UID: \"ad92bfd0-8ec0-4193-8af1-572d2d94cc5e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"
Jul 06 13:47:16.045290 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.045090    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad92bfd0-8ec0-4193-8af1-572d2d94cc5e-config-file\") pod \"limitador-limitador-64c94fd64f-4kn7z\" (UID: \"ad92bfd0-8ec0-4193-8af1-572d2d94cc5e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"
Jul 06 13:47:16.045781 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.045760    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad92bfd0-8ec0-4193-8af1-572d2d94cc5e-config-file\") pod \"limitador-limitador-64c94fd64f-4kn7z\" (UID: \"ad92bfd0-8ec0-4193-8af1-572d2d94cc5e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"
Jul 06 13:47:16.070151 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.070120    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6fxl\" (UniqueName: \"kubernetes.io/projected/ad92bfd0-8ec0-4193-8af1-572d2d94cc5e-kube-api-access-m6fxl\") pod \"limitador-limitador-64c94fd64f-4kn7z\" (UID: \"ad92bfd0-8ec0-4193-8af1-572d2d94cc5e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"
Jul 06 13:47:16.165576 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.165473    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"
Jul 06 13:47:16.335199 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.335175    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"]
Jul 06 13:47:16.338000 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:47:16.337963    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad92bfd0_8ec0_4193_8af1_572d2d94cc5e.slice/crio-aba58ae6a77aa149e4c149eea6d073b8efa072357488890182ae83dff598eb5c WatchSource:0}: Error finding container aba58ae6a77aa149e4c149eea6d073b8efa072357488890182ae83dff598eb5c: Status 404 returned error can't find the container with id aba58ae6a77aa149e4c149eea6d073b8efa072357488890182ae83dff598eb5c
Jul 06 13:47:16.533113 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.532983    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z" event={"ID":"ad92bfd0-8ec0-4193-8af1-572d2d94cc5e","Type":"ContainerStarted","Data":"aba58ae6a77aa149e4c149eea6d073b8efa072357488890182ae83dff598eb5c"}
Jul 06 13:47:16.533297 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.533232    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:16.534262 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.534240    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:47:16.781094 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.781047    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-nl6gc"]
Jul 06 13:47:16.784191 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.784116    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nl6gc"
Jul 06 13:47:16.786689 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.786666    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-n7mbc\""
Jul 06 13:47:16.796794 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.796763    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-nl6gc"]
Jul 06 13:47:16.853314 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.853279    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cchk\" (UniqueName: \"kubernetes.io/projected/025216a0-f4a2-47c9-b7f8-b1bf4aefe01f-kube-api-access-5cchk\") pod \"authorino-58cd955675-nl6gc\" (UID: \"025216a0-f4a2-47c9-b7f8-b1bf4aefe01f\") " pod="kuadrant-system/authorino-58cd955675-nl6gc"
Jul 06 13:47:16.954187 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.954149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cchk\" (UniqueName: \"kubernetes.io/projected/025216a0-f4a2-47c9-b7f8-b1bf4aefe01f-kube-api-access-5cchk\") pod \"authorino-58cd955675-nl6gc\" (UID: \"025216a0-f4a2-47c9-b7f8-b1bf4aefe01f\") " pod="kuadrant-system/authorino-58cd955675-nl6gc"
Jul 06 13:47:16.964716 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:16.964691    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cchk\" (UniqueName: \"kubernetes.io/projected/025216a0-f4a2-47c9-b7f8-b1bf4aefe01f-kube-api-access-5cchk\") pod \"authorino-58cd955675-nl6gc\" (UID: \"025216a0-f4a2-47c9-b7f8-b1bf4aefe01f\") " pod="kuadrant-system/authorino-58cd955675-nl6gc"
Jul 06 13:47:17.072167 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:17.072076    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-pchdb"]
Jul 06 13:47:17.074792 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:17.074761    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pchdb"
Jul 06 13:47:17.094439 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:17.094408    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nl6gc"
Jul 06 13:47:17.101190 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:17.101112    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pchdb"]
Jul 06 13:47:17.156585 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:17.156512    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5zv4\" (UniqueName: \"kubernetes.io/projected/38dcd8c6-322a-4dd0-b4d8-ee8575d01f20-kube-api-access-q5zv4\") pod \"authorino-75d556bd77-pchdb\" (UID: \"38dcd8c6-322a-4dd0-b4d8-ee8575d01f20\") " pod="kuadrant-system/authorino-75d556bd77-pchdb"
Jul 06 13:47:17.258581 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:17.258141    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5zv4\" (UniqueName: \"kubernetes.io/projected/38dcd8c6-322a-4dd0-b4d8-ee8575d01f20-kube-api-access-q5zv4\") pod \"authorino-75d556bd77-pchdb\" (UID: \"38dcd8c6-322a-4dd0-b4d8-ee8575d01f20\") " pod="kuadrant-system/authorino-75d556bd77-pchdb"
Jul 06 13:47:17.284199 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:17.284132    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5zv4\" (UniqueName: \"kubernetes.io/projected/38dcd8c6-322a-4dd0-b4d8-ee8575d01f20-kube-api-access-q5zv4\") pod \"authorino-75d556bd77-pchdb\" (UID: \"38dcd8c6-322a-4dd0-b4d8-ee8575d01f20\") " pod="kuadrant-system/authorino-75d556bd77-pchdb"
Jul 06 13:47:17.313295 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:47:17.313256    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod025216a0_f4a2_47c9_b7f8_b1bf4aefe01f.slice/crio-aa8d089ac9164c3a2cdae50f7db88aee7b7d921109f88d2560428996777e4540 WatchSource:0}: Error finding container aa8d089ac9164c3a2cdae50f7db88aee7b7d921109f88d2560428996777e4540: Status 404 returned error can't find the container with id aa8d089ac9164c3a2cdae50f7db88aee7b7d921109f88d2560428996777e4540
Jul 06 13:47:17.318329 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:17.318301    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-nl6gc"]
Jul 06 13:47:17.390163 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:17.390130    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pchdb"
Jul 06 13:47:17.541519 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:17.541431    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nl6gc" event={"ID":"025216a0-f4a2-47c9-b7f8-b1bf4aefe01f","Type":"ContainerStarted","Data":"aa8d089ac9164c3a2cdae50f7db88aee7b7d921109f88d2560428996777e4540"}
Jul 06 13:47:17.582758 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:17.582718    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pchdb"]
Jul 06 13:47:17.587342 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:47:17.587302    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38dcd8c6_322a_4dd0_b4d8_ee8575d01f20.slice/crio-9bd91bcf906c4678beca97ed349b3c9f71c350b3fb40919da9ab9d4e2f42cac3 WatchSource:0}: Error finding container 9bd91bcf906c4678beca97ed349b3c9f71c350b3fb40919da9ab9d4e2f42cac3: Status 404 returned error can't find the container with id 9bd91bcf906c4678beca97ed349b3c9f71c350b3fb40919da9ab9d4e2f42cac3
Jul 06 13:47:18.548758 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:18.548718    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pchdb" event={"ID":"38dcd8c6-322a-4dd0-b4d8-ee8575d01f20","Type":"ContainerStarted","Data":"9bd91bcf906c4678beca97ed349b3c9f71c350b3fb40919da9ab9d4e2f42cac3"}
Jul 06 13:47:20.568960 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:20.568877    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z" event={"ID":"ad92bfd0-8ec0-4193-8af1-572d2d94cc5e","Type":"ContainerStarted","Data":"04289e0e8a4bd845b3867b860d013d4c538ac3cd57012ca53e7cfdc9676152e4"}
Jul 06 13:47:20.569524 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:20.569500    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"
Jul 06 13:47:20.602687 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:20.602624    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z" podStartSLOduration=2.435559268 podStartE2EDuration="5.602604881s" totalImagesPullingTime="3.167045613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:20.600707932 +0000 UTC m=+455.912271601" watchObservedRunningTime="2026-07-06 13:47:20.602604881 +0000 UTC m=+455.914168550"
Jul 06 13:47:22.581683 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:22.581647    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pchdb" event={"ID":"38dcd8c6-322a-4dd0-b4d8-ee8575d01f20","Type":"ContainerStarted","Data":"2956fd4a517082ee7c001a911be86b20ec0c851f277382200825a8ef5761155c"}
Jul 06 13:47:22.583209 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:22.583181    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nl6gc" event={"ID":"025216a0-f4a2-47c9-b7f8-b1bf4aefe01f","Type":"ContainerStarted","Data":"ae50c096a8bc3de826790000595ddbbfb3f102f05732b93df96f2729b94d8daf"}
Jul 06 13:47:22.607594 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:22.607533    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-pchdb" podStartSLOduration=1.5697639319999999 podStartE2EDuration="5.607510895s" totalImagesPullingTime="4.037746963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:22.60570851 +0000 UTC m=+457.917272196" watchObservedRunningTime="2026-07-06 13:47:22.607510895 +0000 UTC m=+457.919074563"
Jul 06 13:47:22.625229 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:22.625168    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-nl6gc" podStartSLOduration=2.319554483 podStartE2EDuration="6.625147725s" totalImagesPullingTime="4.305593242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:22.62493624 +0000 UTC m=+457.936499927" watchObservedRunningTime="2026-07-06 13:47:22.625147725 +0000 UTC m=+457.936711395"
Jul 06 13:47:22.668987 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:22.668941    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-nl6gc"]
Jul 06 13:47:24.593160 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:24.593121    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-nl6gc" podUID="025216a0-f4a2-47c9-b7f8-b1bf4aefe01f" containerName="authorino" containerID="cri-o://ae50c096a8bc3de826790000595ddbbfb3f102f05732b93df96f2729b94d8daf" gracePeriod=30
Jul 06 13:47:24.851909 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:24.851836    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nl6gc"
Jul 06 13:47:24.938139 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:24.938107    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cchk\" (UniqueName: \"kubernetes.io/projected/025216a0-f4a2-47c9-b7f8-b1bf4aefe01f-kube-api-access-5cchk\") pod \"025216a0-f4a2-47c9-b7f8-b1bf4aefe01f\" (UID: \"025216a0-f4a2-47c9-b7f8-b1bf4aefe01f\") "
Jul 06 13:47:24.940288 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:24.940246    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/025216a0-f4a2-47c9-b7f8-b1bf4aefe01f-kube-api-access-5cchk" (OuterVolumeSpecName: "kube-api-access-5cchk") pod "025216a0-f4a2-47c9-b7f8-b1bf4aefe01f" (UID: "025216a0-f4a2-47c9-b7f8-b1bf4aefe01f"). InnerVolumeSpecName "kube-api-access-5cchk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:47:25.039514 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:25.039462    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cchk\" (UniqueName: \"kubernetes.io/projected/025216a0-f4a2-47c9-b7f8-b1bf4aefe01f-kube-api-access-5cchk\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:47:25.599542 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:25.599502    2573 generic.go:356] "Generic (PLEG): container finished" podID="025216a0-f4a2-47c9-b7f8-b1bf4aefe01f" containerID="ae50c096a8bc3de826790000595ddbbfb3f102f05732b93df96f2729b94d8daf" exitCode=0
Jul 06 13:47:25.599965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:25.599550    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nl6gc"
Jul 06 13:47:25.599965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:25.599590    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nl6gc" event={"ID":"025216a0-f4a2-47c9-b7f8-b1bf4aefe01f","Type":"ContainerDied","Data":"ae50c096a8bc3de826790000595ddbbfb3f102f05732b93df96f2729b94d8daf"}
Jul 06 13:47:25.599965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:25.599630    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nl6gc" event={"ID":"025216a0-f4a2-47c9-b7f8-b1bf4aefe01f","Type":"ContainerDied","Data":"aa8d089ac9164c3a2cdae50f7db88aee7b7d921109f88d2560428996777e4540"}
Jul 06 13:47:25.599965 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:25.599647    2573 scope.go:117] "RemoveContainer" containerID="ae50c096a8bc3de826790000595ddbbfb3f102f05732b93df96f2729b94d8daf"
Jul 06 13:47:25.608352 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:25.608331    2573 scope.go:117] "RemoveContainer" containerID="ae50c096a8bc3de826790000595ddbbfb3f102f05732b93df96f2729b94d8daf"
Jul 06 13:47:25.608667 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:47:25.608645    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae50c096a8bc3de826790000595ddbbfb3f102f05732b93df96f2729b94d8daf\": container with ID starting with ae50c096a8bc3de826790000595ddbbfb3f102f05732b93df96f2729b94d8daf not found: ID does not exist" containerID="ae50c096a8bc3de826790000595ddbbfb3f102f05732b93df96f2729b94d8daf"
Jul 06 13:47:25.608719 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:25.608678    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae50c096a8bc3de826790000595ddbbfb3f102f05732b93df96f2729b94d8daf"} err="failed to get container status \"ae50c096a8bc3de826790000595ddbbfb3f102f05732b93df96f2729b94d8daf\": rpc error: code = NotFound desc = could not find container \"ae50c096a8bc3de826790000595ddbbfb3f102f05732b93df96f2729b94d8daf\": container with ID starting with ae50c096a8bc3de826790000595ddbbfb3f102f05732b93df96f2729b94d8daf not found: ID does not exist"
Jul 06 13:47:25.630839 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:25.630803    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-nl6gc"]
Jul 06 13:47:25.634232 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:25.634201    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-nl6gc"]
Jul 06 13:47:27.314339 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:27.314305    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="025216a0-f4a2-47c9-b7f8-b1bf4aefe01f" path="/var/lib/kubelet/pods/025216a0-f4a2-47c9-b7f8-b1bf4aefe01f/volumes"
Jul 06 13:47:31.115989 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:31.115946    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"]
Jul 06 13:47:31.116522 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:31.116182    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z" podUID="ad92bfd0-8ec0-4193-8af1-572d2d94cc5e" containerName="limitador" containerID="cri-o://04289e0e8a4bd845b3867b860d013d4c538ac3cd57012ca53e7cfdc9676152e4" gracePeriod=30
Jul 06 13:47:31.116949 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:31.116930    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"
Jul 06 13:47:31.638342 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:31.638306    2573 generic.go:356] "Generic (PLEG): container finished" podID="ad92bfd0-8ec0-4193-8af1-572d2d94cc5e" containerID="04289e0e8a4bd845b3867b860d013d4c538ac3cd57012ca53e7cfdc9676152e4" exitCode=0
Jul 06 13:47:31.638527 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:31.638380    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z" event={"ID":"ad92bfd0-8ec0-4193-8af1-572d2d94cc5e","Type":"ContainerDied","Data":"04289e0e8a4bd845b3867b860d013d4c538ac3cd57012ca53e7cfdc9676152e4"}
Jul 06 13:47:31.678872 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:31.678798    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"
Jul 06 13:47:31.800452 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:31.800411    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad92bfd0-8ec0-4193-8af1-572d2d94cc5e-config-file\") pod \"ad92bfd0-8ec0-4193-8af1-572d2d94cc5e\" (UID: \"ad92bfd0-8ec0-4193-8af1-572d2d94cc5e\") "
Jul 06 13:47:31.800452 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:31.800458    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6fxl\" (UniqueName: \"kubernetes.io/projected/ad92bfd0-8ec0-4193-8af1-572d2d94cc5e-kube-api-access-m6fxl\") pod \"ad92bfd0-8ec0-4193-8af1-572d2d94cc5e\" (UID: \"ad92bfd0-8ec0-4193-8af1-572d2d94cc5e\") "
Jul 06 13:47:31.800857 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:31.800831    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad92bfd0-8ec0-4193-8af1-572d2d94cc5e-config-file" (OuterVolumeSpecName: "config-file") pod "ad92bfd0-8ec0-4193-8af1-572d2d94cc5e" (UID: "ad92bfd0-8ec0-4193-8af1-572d2d94cc5e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:47:31.802588 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:31.802565    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad92bfd0-8ec0-4193-8af1-572d2d94cc5e-kube-api-access-m6fxl" (OuterVolumeSpecName: "kube-api-access-m6fxl") pod "ad92bfd0-8ec0-4193-8af1-572d2d94cc5e" (UID: "ad92bfd0-8ec0-4193-8af1-572d2d94cc5e"). InnerVolumeSpecName "kube-api-access-m6fxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:47:31.901097 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:31.901033    2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad92bfd0-8ec0-4193-8af1-572d2d94cc5e-config-file\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:47:31.901097 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:31.901087    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6fxl\" (UniqueName: \"kubernetes.io/projected/ad92bfd0-8ec0-4193-8af1-572d2d94cc5e-kube-api-access-m6fxl\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:47:32.645238 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:32.645207    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"
Jul 06 13:47:32.645728 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:32.645244    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kn7z" event={"ID":"ad92bfd0-8ec0-4193-8af1-572d2d94cc5e","Type":"ContainerDied","Data":"aba58ae6a77aa149e4c149eea6d073b8efa072357488890182ae83dff598eb5c"}
Jul 06 13:47:32.645728 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:32.645319    2573 scope.go:117] "RemoveContainer" containerID="04289e0e8a4bd845b3867b860d013d4c538ac3cd57012ca53e7cfdc9676152e4"
Jul 06 13:47:32.668662 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:32.668618    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"]
Jul 06 13:47:32.672060 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:32.672021    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4kn7z"]
Jul 06 13:47:33.314732 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:33.314698    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad92bfd0-8ec0-4193-8af1-572d2d94cc5e" path="/var/lib/kubelet/pods/ad92bfd0-8ec0-4193-8af1-572d2d94cc5e/volumes"
Jul 06 13:47:37.382074 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.382027    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-cpsvn"]
Jul 06 13:47:37.382531 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.382515    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad92bfd0-8ec0-4193-8af1-572d2d94cc5e" containerName="limitador"
Jul 06 13:47:37.382588 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.382534    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad92bfd0-8ec0-4193-8af1-572d2d94cc5e" containerName="limitador"
Jul 06 13:47:37.382588 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.382542    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="025216a0-f4a2-47c9-b7f8-b1bf4aefe01f" containerName="authorino"
Jul 06 13:47:37.382588 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.382547    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="025216a0-f4a2-47c9-b7f8-b1bf4aefe01f" containerName="authorino"
Jul 06 13:47:37.382686 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.382616    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="025216a0-f4a2-47c9-b7f8-b1bf4aefe01f" containerName="authorino"
Jul 06 13:47:37.382686 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.382628    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad92bfd0-8ec0-4193-8af1-572d2d94cc5e" containerName="limitador"
Jul 06 13:47:37.385036 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.385017    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-cpsvn"
Jul 06 13:47:37.387784 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.387767    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-z94kt\""
Jul 06 13:47:37.387895 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.387814    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 06 13:47:37.393857 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.393834    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-cpsvn"]
Jul 06 13:47:37.453169 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.453128    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fmm4\" (UniqueName: \"kubernetes.io/projected/78a93b21-8da2-4a12-b765-32a78ce65c52-kube-api-access-2fmm4\") pod \"postgres-69fb4594cf-cpsvn\" (UID: \"78a93b21-8da2-4a12-b765-32a78ce65c52\") " pod="opendatahub/postgres-69fb4594cf-cpsvn"
Jul 06 13:47:37.453350 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.453242    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/78a93b21-8da2-4a12-b765-32a78ce65c52-data\") pod \"postgres-69fb4594cf-cpsvn\" (UID: \"78a93b21-8da2-4a12-b765-32a78ce65c52\") " pod="opendatahub/postgres-69fb4594cf-cpsvn"
Jul 06 13:47:37.554452 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.554407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/78a93b21-8da2-4a12-b765-32a78ce65c52-data\") pod \"postgres-69fb4594cf-cpsvn\" (UID: \"78a93b21-8da2-4a12-b765-32a78ce65c52\") " pod="opendatahub/postgres-69fb4594cf-cpsvn"
Jul 06 13:47:37.554636 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.554486    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fmm4\" (UniqueName: \"kubernetes.io/projected/78a93b21-8da2-4a12-b765-32a78ce65c52-kube-api-access-2fmm4\") pod \"postgres-69fb4594cf-cpsvn\" (UID: \"78a93b21-8da2-4a12-b765-32a78ce65c52\") " pod="opendatahub/postgres-69fb4594cf-cpsvn"
Jul 06 13:47:37.554820 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.554796    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/78a93b21-8da2-4a12-b765-32a78ce65c52-data\") pod \"postgres-69fb4594cf-cpsvn\" (UID: \"78a93b21-8da2-4a12-b765-32a78ce65c52\") " pod="opendatahub/postgres-69fb4594cf-cpsvn"
Jul 06 13:47:37.563485 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.563451    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fmm4\" (UniqueName: \"kubernetes.io/projected/78a93b21-8da2-4a12-b765-32a78ce65c52-kube-api-access-2fmm4\") pod \"postgres-69fb4594cf-cpsvn\" (UID: \"78a93b21-8da2-4a12-b765-32a78ce65c52\") " pod="opendatahub/postgres-69fb4594cf-cpsvn"
Jul 06 13:47:37.697760 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.697661    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-cpsvn"
Jul 06 13:47:37.871154 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:37.871129    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-cpsvn"]
Jul 06 13:47:37.873571 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:47:37.873542    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78a93b21_8da2_4a12_b765_32a78ce65c52.slice/crio-27f9720235a3e4630cab28707bc3d06e53167a0b72ce8832e29eac8aa7927e2d WatchSource:0}: Error finding container 27f9720235a3e4630cab28707bc3d06e53167a0b72ce8832e29eac8aa7927e2d: Status 404 returned error can't find the container with id 27f9720235a3e4630cab28707bc3d06e53167a0b72ce8832e29eac8aa7927e2d
Jul 06 13:47:38.677270 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:38.677234    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-cpsvn" event={"ID":"78a93b21-8da2-4a12-b765-32a78ce65c52","Type":"ContainerStarted","Data":"27f9720235a3e4630cab28707bc3d06e53167a0b72ce8832e29eac8aa7927e2d"}
Jul 06 13:47:43.704383 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:43.704347    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-cpsvn" event={"ID":"78a93b21-8da2-4a12-b765-32a78ce65c52","Type":"ContainerStarted","Data":"fbdebb6c38a33672b77520da9f12d831d98785e6b389aff80aff549ec34ee2c4"}
Jul 06 13:47:43.704818 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:43.704465    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-cpsvn"
Jul 06 13:47:43.721715 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:43.721653    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-cpsvn" podStartSLOduration=1.664140654 podStartE2EDuration="6.721634176s" totalImagesPullingTime="5.057493522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:43.721016903 +0000 UTC m=+479.032580593" watchObservedRunningTime="2026-07-06 13:47:43.721634176 +0000 UTC m=+479.033197849"
Jul 06 13:47:49.740905 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:49.740875    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-cpsvn"
Jul 06 13:47:50.385538 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:50.385506    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vxk2j"]
Jul 06 13:47:50.391764 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:50.391743    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vxk2j"
Jul 06 13:47:50.411479 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:50.411446    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vxk2j"]
Jul 06 13:47:50.492925 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:50.492882    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6z8s\" (UniqueName: \"kubernetes.io/projected/e2b9163b-e20f-4031-8fc7-25f8f4f44ee8-kube-api-access-g6z8s\") pod \"authorino-5d4b67c446-vxk2j\" (UID: \"e2b9163b-e20f-4031-8fc7-25f8f4f44ee8\") " pod="kuadrant-system/authorino-5d4b67c446-vxk2j"
Jul 06 13:47:50.575584 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:50.575540    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vxk2j"]
Jul 06 13:47:50.576408 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:47:50.576374    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-g6z8s], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-vxk2j" podUID="e2b9163b-e20f-4031-8fc7-25f8f4f44ee8"
Jul 06 13:47:50.593761 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:50.593718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6z8s\" (UniqueName: \"kubernetes.io/projected/e2b9163b-e20f-4031-8fc7-25f8f4f44ee8-kube-api-access-g6z8s\") pod \"authorino-5d4b67c446-vxk2j\" (UID: \"e2b9163b-e20f-4031-8fc7-25f8f4f44ee8\") " pod="kuadrant-system/authorino-5d4b67c446-vxk2j"
Jul 06 13:47:50.605482 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:50.605445    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6z8s\" (UniqueName: \"kubernetes.io/projected/e2b9163b-e20f-4031-8fc7-25f8f4f44ee8-kube-api-access-g6z8s\") pod \"authorino-5d4b67c446-vxk2j\" (UID: \"e2b9163b-e20f-4031-8fc7-25f8f4f44ee8\") " pod="kuadrant-system/authorino-5d4b67c446-vxk2j"
Jul 06 13:47:50.743802 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:50.743717    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vxk2j"
Jul 06 13:47:50.751769 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:50.751743    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vxk2j"
Jul 06 13:47:50.795975 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:50.795943    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6z8s\" (UniqueName: \"kubernetes.io/projected/e2b9163b-e20f-4031-8fc7-25f8f4f44ee8-kube-api-access-g6z8s\") pod \"e2b9163b-e20f-4031-8fc7-25f8f4f44ee8\" (UID: \"e2b9163b-e20f-4031-8fc7-25f8f4f44ee8\") "
Jul 06 13:47:50.798237 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:50.798206    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2b9163b-e20f-4031-8fc7-25f8f4f44ee8-kube-api-access-g6z8s" (OuterVolumeSpecName: "kube-api-access-g6z8s") pod "e2b9163b-e20f-4031-8fc7-25f8f4f44ee8" (UID: "e2b9163b-e20f-4031-8fc7-25f8f4f44ee8"). InnerVolumeSpecName "kube-api-access-g6z8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:47:50.896991 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:50.896954    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6z8s\" (UniqueName: \"kubernetes.io/projected/e2b9163b-e20f-4031-8fc7-25f8f4f44ee8-kube-api-access-g6z8s\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:47:51.056285 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.056190    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77fb8b98fb-fqslq"]
Jul 06 13:47:51.060153 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.060126    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77fb8b98fb-fqslq"
Jul 06 13:47:51.063830 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.063805    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 13:47:51.093188 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.093152    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77fb8b98fb-fqslq"]
Jul 06 13:47:51.098288 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.098250    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lh54\" (UniqueName: \"kubernetes.io/projected/eb3cb7fd-9a88-4074-80db-efa622a2f30f-kube-api-access-6lh54\") pod \"authorino-77fb8b98fb-fqslq\" (UID: \"eb3cb7fd-9a88-4074-80db-efa622a2f30f\") " pod="kuadrant-system/authorino-77fb8b98fb-fqslq"
Jul 06 13:47:51.098471 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.098345    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eb3cb7fd-9a88-4074-80db-efa622a2f30f-tls-cert\") pod \"authorino-77fb8b98fb-fqslq\" (UID: \"eb3cb7fd-9a88-4074-80db-efa622a2f30f\") " pod="kuadrant-system/authorino-77fb8b98fb-fqslq"
Jul 06 13:47:51.198988 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.198948    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eb3cb7fd-9a88-4074-80db-efa622a2f30f-tls-cert\") pod \"authorino-77fb8b98fb-fqslq\" (UID: \"eb3cb7fd-9a88-4074-80db-efa622a2f30f\") " pod="kuadrant-system/authorino-77fb8b98fb-fqslq"
Jul 06 13:47:51.199223 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.199079    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lh54\" (UniqueName: \"kubernetes.io/projected/eb3cb7fd-9a88-4074-80db-efa622a2f30f-kube-api-access-6lh54\") pod \"authorino-77fb8b98fb-fqslq\" (UID: \"eb3cb7fd-9a88-4074-80db-efa622a2f30f\") " pod="kuadrant-system/authorino-77fb8b98fb-fqslq"
Jul 06 13:47:51.201525 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.201495    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eb3cb7fd-9a88-4074-80db-efa622a2f30f-tls-cert\") pod \"authorino-77fb8b98fb-fqslq\" (UID: \"eb3cb7fd-9a88-4074-80db-efa622a2f30f\") " pod="kuadrant-system/authorino-77fb8b98fb-fqslq"
Jul 06 13:47:51.208727 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.208693    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lh54\" (UniqueName: \"kubernetes.io/projected/eb3cb7fd-9a88-4074-80db-efa622a2f30f-kube-api-access-6lh54\") pod \"authorino-77fb8b98fb-fqslq\" (UID: \"eb3cb7fd-9a88-4074-80db-efa622a2f30f\") " pod="kuadrant-system/authorino-77fb8b98fb-fqslq"
Jul 06 13:47:51.370136 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.370097    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77fb8b98fb-fqslq"
Jul 06 13:47:51.532125 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.532091    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77fb8b98fb-fqslq"]
Jul 06 13:47:51.535929 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:47:51.535896    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb3cb7fd_9a88_4074_80db_efa622a2f30f.slice/crio-fc5fdffca0aa6dd5e09eb99db6a878504a1669313f4d71332b4298d3198beee0 WatchSource:0}: Error finding container fc5fdffca0aa6dd5e09eb99db6a878504a1669313f4d71332b4298d3198beee0: Status 404 returned error can't find the container with id fc5fdffca0aa6dd5e09eb99db6a878504a1669313f4d71332b4298d3198beee0
Jul 06 13:47:51.751318 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.751291    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vxk2j"
Jul 06 13:47:51.751729 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.751286    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77fb8b98fb-fqslq" event={"ID":"eb3cb7fd-9a88-4074-80db-efa622a2f30f","Type":"ContainerStarted","Data":"fc5fdffca0aa6dd5e09eb99db6a878504a1669313f4d71332b4298d3198beee0"}
Jul 06 13:47:51.804127 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.804079    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vxk2j"]
Jul 06 13:47:51.807500 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:51.807464    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vxk2j"]
Jul 06 13:47:52.758662 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:52.758625    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77fb8b98fb-fqslq" event={"ID":"eb3cb7fd-9a88-4074-80db-efa622a2f30f","Type":"ContainerStarted","Data":"b970ccc174b47494bdd00430389952590ca515997585c79d71bfca9024866464"}
Jul 06 13:47:52.786343 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:52.786290    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-77fb8b98fb-fqslq" podStartSLOduration=1.3464282349999999 podStartE2EDuration="1.786272231s" totalImagesPullingTime="439.843996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:52.784954776 +0000 UTC m=+488.096518444" watchObservedRunningTime="2026-07-06 13:47:52.786272231 +0000 UTC m=+488.097835937"
Jul 06 13:47:52.835586 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:52.835541    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pchdb"]
Jul 06 13:47:52.835810 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:52.835784    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-pchdb" podUID="38dcd8c6-322a-4dd0-b4d8-ee8575d01f20" containerName="authorino" containerID="cri-o://2956fd4a517082ee7c001a911be86b20ec0c851f277382200825a8ef5761155c" gracePeriod=30
Jul 06 13:47:53.101970 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:53.101937    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pchdb"
Jul 06 13:47:53.115566 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:53.115537    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5zv4\" (UniqueName: \"kubernetes.io/projected/38dcd8c6-322a-4dd0-b4d8-ee8575d01f20-kube-api-access-q5zv4\") pod \"38dcd8c6-322a-4dd0-b4d8-ee8575d01f20\" (UID: \"38dcd8c6-322a-4dd0-b4d8-ee8575d01f20\") "
Jul 06 13:47:53.117744 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:53.117709    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38dcd8c6-322a-4dd0-b4d8-ee8575d01f20-kube-api-access-q5zv4" (OuterVolumeSpecName: "kube-api-access-q5zv4") pod "38dcd8c6-322a-4dd0-b4d8-ee8575d01f20" (UID: "38dcd8c6-322a-4dd0-b4d8-ee8575d01f20"). InnerVolumeSpecName "kube-api-access-q5zv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:47:53.216505 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:53.216461    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5zv4\" (UniqueName: \"kubernetes.io/projected/38dcd8c6-322a-4dd0-b4d8-ee8575d01f20-kube-api-access-q5zv4\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:47:53.314305 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:53.314213    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2b9163b-e20f-4031-8fc7-25f8f4f44ee8" path="/var/lib/kubelet/pods/e2b9163b-e20f-4031-8fc7-25f8f4f44ee8/volumes"
Jul 06 13:47:53.764391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:53.764354    2573 generic.go:356] "Generic (PLEG): container finished" podID="38dcd8c6-322a-4dd0-b4d8-ee8575d01f20" containerID="2956fd4a517082ee7c001a911be86b20ec0c851f277382200825a8ef5761155c" exitCode=0
Jul 06 13:47:53.764391 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:53.764391    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pchdb"
Jul 06 13:47:53.764871 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:53.764430    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pchdb" event={"ID":"38dcd8c6-322a-4dd0-b4d8-ee8575d01f20","Type":"ContainerDied","Data":"2956fd4a517082ee7c001a911be86b20ec0c851f277382200825a8ef5761155c"}
Jul 06 13:47:53.764871 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:53.764468    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pchdb" event={"ID":"38dcd8c6-322a-4dd0-b4d8-ee8575d01f20","Type":"ContainerDied","Data":"9bd91bcf906c4678beca97ed349b3c9f71c350b3fb40919da9ab9d4e2f42cac3"}
Jul 06 13:47:53.764871 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:53.764487    2573 scope.go:117] "RemoveContainer" containerID="2956fd4a517082ee7c001a911be86b20ec0c851f277382200825a8ef5761155c"
Jul 06 13:47:53.773460 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:53.773440    2573 scope.go:117] "RemoveContainer" containerID="2956fd4a517082ee7c001a911be86b20ec0c851f277382200825a8ef5761155c"
Jul 06 13:47:53.773787 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:47:53.773767    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2956fd4a517082ee7c001a911be86b20ec0c851f277382200825a8ef5761155c\": container with ID starting with 2956fd4a517082ee7c001a911be86b20ec0c851f277382200825a8ef5761155c not found: ID does not exist" containerID="2956fd4a517082ee7c001a911be86b20ec0c851f277382200825a8ef5761155c"
Jul 06 13:47:53.773826 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:53.773798    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2956fd4a517082ee7c001a911be86b20ec0c851f277382200825a8ef5761155c"} err="failed to get container status \"2956fd4a517082ee7c001a911be86b20ec0c851f277382200825a8ef5761155c\": rpc error: code = NotFound desc = could not find container \"2956fd4a517082ee7c001a911be86b20ec0c851f277382200825a8ef5761155c\": container with ID starting with 2956fd4a517082ee7c001a911be86b20ec0c851f277382200825a8ef5761155c not found: ID does not exist"
Jul 06 13:47:53.780869 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:53.780837    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pchdb"]
Jul 06 13:47:53.787152 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:53.787120    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pchdb"]
Jul 06 13:47:55.314661 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:55.314629    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38dcd8c6-322a-4dd0-b4d8-ee8575d01f20" path="/var/lib/kubelet/pods/38dcd8c6-322a-4dd0-b4d8-ee8575d01f20/volumes"
Jul 06 13:47:57.329988 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.329945    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78b85d8477-s6b8x"]
Jul 06 13:47:57.330474 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.330438    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38dcd8c6-322a-4dd0-b4d8-ee8575d01f20" containerName="authorino"
Jul 06 13:47:57.330474 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.330451    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="38dcd8c6-322a-4dd0-b4d8-ee8575d01f20" containerName="authorino"
Jul 06 13:47:57.330548 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.330520    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="38dcd8c6-322a-4dd0-b4d8-ee8575d01f20" containerName="authorino"
Jul 06 13:47:57.549754 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.549718    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78b85d8477-s6b8x"]
Jul 06 13:47:57.549754 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.549760    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6875d9b67d-zms5c"]
Jul 06 13:47:57.549975 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.549840    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b85d8477-s6b8x"
Jul 06 13:47:57.554108 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.554081    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mcgg7\""
Jul 06 13:47:57.554786 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.554763    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 13:47:57.554910 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.554847    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 13:47:57.582509 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.582461    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6875d9b67d-zms5c"]
Jul 06 13:47:57.582667 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.582610    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6875d9b67d-zms5c"
Jul 06 13:47:57.655104 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.655030    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc178e4f-6423-439b-90ee-311d688d365c-webhook-cert\") pod \"maas-controller-6875d9b67d-zms5c\" (UID: \"cc178e4f-6423-439b-90ee-311d688d365c\") " pod="opendatahub/maas-controller-6875d9b67d-zms5c"
Jul 06 13:47:57.655305 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.655139    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zbwd\" (UniqueName: \"kubernetes.io/projected/cc178e4f-6423-439b-90ee-311d688d365c-kube-api-access-8zbwd\") pod \"maas-controller-6875d9b67d-zms5c\" (UID: \"cc178e4f-6423-439b-90ee-311d688d365c\") " pod="opendatahub/maas-controller-6875d9b67d-zms5c"
Jul 06 13:47:57.655305 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.655181    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b501268d-e69b-4fa2-ab20-28f0ba1465c0-webhook-cert\") pod \"maas-controller-78b85d8477-s6b8x\" (UID: \"b501268d-e69b-4fa2-ab20-28f0ba1465c0\") " pod="opendatahub/maas-controller-78b85d8477-s6b8x"
Jul 06 13:47:57.655305 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.655198    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsd58\" (UniqueName: \"kubernetes.io/projected/b501268d-e69b-4fa2-ab20-28f0ba1465c0-kube-api-access-nsd58\") pod \"maas-controller-78b85d8477-s6b8x\" (UID: \"b501268d-e69b-4fa2-ab20-28f0ba1465c0\") " pod="opendatahub/maas-controller-78b85d8477-s6b8x"
Jul 06 13:47:57.756669 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.756629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc178e4f-6423-439b-90ee-311d688d365c-webhook-cert\") pod \"maas-controller-6875d9b67d-zms5c\" (UID: \"cc178e4f-6423-439b-90ee-311d688d365c\") " pod="opendatahub/maas-controller-6875d9b67d-zms5c"
Jul 06 13:47:57.756858 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.756682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zbwd\" (UniqueName: \"kubernetes.io/projected/cc178e4f-6423-439b-90ee-311d688d365c-kube-api-access-8zbwd\") pod \"maas-controller-6875d9b67d-zms5c\" (UID: \"cc178e4f-6423-439b-90ee-311d688d365c\") " pod="opendatahub/maas-controller-6875d9b67d-zms5c"
Jul 06 13:47:57.756858 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.756731    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b501268d-e69b-4fa2-ab20-28f0ba1465c0-webhook-cert\") pod \"maas-controller-78b85d8477-s6b8x\" (UID: \"b501268d-e69b-4fa2-ab20-28f0ba1465c0\") " pod="opendatahub/maas-controller-78b85d8477-s6b8x"
Jul 06 13:47:57.756858 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.756754    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsd58\" (UniqueName: \"kubernetes.io/projected/b501268d-e69b-4fa2-ab20-28f0ba1465c0-kube-api-access-nsd58\") pod \"maas-controller-78b85d8477-s6b8x\" (UID: \"b501268d-e69b-4fa2-ab20-28f0ba1465c0\") " pod="opendatahub/maas-controller-78b85d8477-s6b8x"
Jul 06 13:47:57.759259 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.759230    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b501268d-e69b-4fa2-ab20-28f0ba1465c0-webhook-cert\") pod \"maas-controller-78b85d8477-s6b8x\" (UID: \"b501268d-e69b-4fa2-ab20-28f0ba1465c0\") " pod="opendatahub/maas-controller-78b85d8477-s6b8x"
Jul 06 13:47:57.759259 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.759241    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc178e4f-6423-439b-90ee-311d688d365c-webhook-cert\") pod \"maas-controller-6875d9b67d-zms5c\" (UID: \"cc178e4f-6423-439b-90ee-311d688d365c\") " pod="opendatahub/maas-controller-6875d9b67d-zms5c"
Jul 06 13:47:57.766811 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.766771    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zbwd\" (UniqueName: \"kubernetes.io/projected/cc178e4f-6423-439b-90ee-311d688d365c-kube-api-access-8zbwd\") pod \"maas-controller-6875d9b67d-zms5c\" (UID: \"cc178e4f-6423-439b-90ee-311d688d365c\") " pod="opendatahub/maas-controller-6875d9b67d-zms5c"
Jul 06 13:47:57.766975 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.766826    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsd58\" (UniqueName: \"kubernetes.io/projected/b501268d-e69b-4fa2-ab20-28f0ba1465c0-kube-api-access-nsd58\") pod \"maas-controller-78b85d8477-s6b8x\" (UID: \"b501268d-e69b-4fa2-ab20-28f0ba1465c0\") " pod="opendatahub/maas-controller-78b85d8477-s6b8x"
Jul 06 13:47:57.863439 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.863350    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b85d8477-s6b8x"
Jul 06 13:47:57.896955 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:57.896919    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6875d9b67d-zms5c"
Jul 06 13:47:58.031036 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:58.030820    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78b85d8477-s6b8x"]
Jul 06 13:47:58.032094 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:47:58.032063    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb501268d_e69b_4fa2_ab20_28f0ba1465c0.slice/crio-eeec31c2539a6c53c18f5908bbfa6974c2e9162148bb7203c54dcaee8f233125 WatchSource:0}: Error finding container eeec31c2539a6c53c18f5908bbfa6974c2e9162148bb7203c54dcaee8f233125: Status 404 returned error can't find the container with id eeec31c2539a6c53c18f5908bbfa6974c2e9162148bb7203c54dcaee8f233125
Jul 06 13:47:58.088255 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:58.088227    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6875d9b67d-zms5c"]
Jul 06 13:47:58.089615 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:47:58.089590    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc178e4f_6423_439b_90ee_311d688d365c.slice/crio-b5cc56f5ff810a7137fab8cd76037f1c9f49c4866fcd7e2dcaaddb094691b81e WatchSource:0}: Error finding container b5cc56f5ff810a7137fab8cd76037f1c9f49c4866fcd7e2dcaaddb094691b81e: Status 404 returned error can't find the container with id b5cc56f5ff810a7137fab8cd76037f1c9f49c4866fcd7e2dcaaddb094691b81e
Jul 06 13:47:58.798149 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:58.798104    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b85d8477-s6b8x" event={"ID":"b501268d-e69b-4fa2-ab20-28f0ba1465c0","Type":"ContainerStarted","Data":"eeec31c2539a6c53c18f5908bbfa6974c2e9162148bb7203c54dcaee8f233125"}
Jul 06 13:47:58.799973 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:47:58.799932    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6875d9b67d-zms5c" event={"ID":"cc178e4f-6423-439b-90ee-311d688d365c","Type":"ContainerStarted","Data":"b5cc56f5ff810a7137fab8cd76037f1c9f49c4866fcd7e2dcaaddb094691b81e"}
Jul 06 13:48:00.812016 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:00.811974    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6875d9b67d-zms5c" event={"ID":"cc178e4f-6423-439b-90ee-311d688d365c","Type":"ContainerStarted","Data":"3f3f2af0a959de91d8241ae868e68e295d988ee7db44f2155bfd2c79becbc355"}
Jul 06 13:48:00.812497 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:00.812154    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6875d9b67d-zms5c"
Jul 06 13:48:00.813518 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:00.813496    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b85d8477-s6b8x" event={"ID":"b501268d-e69b-4fa2-ab20-28f0ba1465c0","Type":"ContainerStarted","Data":"cc0f84bbe464fa259d4b5ae01adda3beea7c4d63376abe582b580cfc865b5d8c"}
Jul 06 13:48:00.813622 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:00.813611    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78b85d8477-s6b8x"
Jul 06 13:48:00.838329 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:00.838279    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6875d9b67d-zms5c" podStartSLOduration=1.883412439 podStartE2EDuration="3.838262576s" totalImagesPullingTime="1.954850137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:48:00.837308994 +0000 UTC m=+496.148872662" watchObservedRunningTime="2026-07-06 13:48:00.838262576 +0000 UTC m=+496.149826222"
Jul 06 13:48:00.863279 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:00.863226    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78b85d8477-s6b8x" podStartSLOduration=1.858363914 podStartE2EDuration="3.863206997s" totalImagesPullingTime="2.004843083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:48:00.86176614 +0000 UTC m=+496.173329826" watchObservedRunningTime="2026-07-06 13:48:00.863206997 +0000 UTC m=+496.174770665"
Jul 06 13:48:11.830375 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:11.830342    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6875d9b67d-zms5c"
Jul 06 13:48:11.830786 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:11.830420    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78b85d8477-s6b8x"
Jul 06 13:48:11.933739 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:11.933704    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78b85d8477-s6b8x"]
Jul 06 13:48:11.933955 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:11.933894    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-78b85d8477-s6b8x" podUID="b501268d-e69b-4fa2-ab20-28f0ba1465c0" containerName="manager" containerID="cri-o://cc0f84bbe464fa259d4b5ae01adda3beea7c4d63376abe582b580cfc865b5d8c" gracePeriod=30
Jul 06 13:48:12.192996 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.192962    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b85d8477-s6b8x"
Jul 06 13:48:12.299547 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.299506    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b501268d-e69b-4fa2-ab20-28f0ba1465c0-webhook-cert\") pod \"b501268d-e69b-4fa2-ab20-28f0ba1465c0\" (UID: \"b501268d-e69b-4fa2-ab20-28f0ba1465c0\") "
Jul 06 13:48:12.299752 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.299642    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsd58\" (UniqueName: \"kubernetes.io/projected/b501268d-e69b-4fa2-ab20-28f0ba1465c0-kube-api-access-nsd58\") pod \"b501268d-e69b-4fa2-ab20-28f0ba1465c0\" (UID: \"b501268d-e69b-4fa2-ab20-28f0ba1465c0\") "
Jul 06 13:48:12.301842 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.301796    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b501268d-e69b-4fa2-ab20-28f0ba1465c0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b501268d-e69b-4fa2-ab20-28f0ba1465c0" (UID: "b501268d-e69b-4fa2-ab20-28f0ba1465c0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:12.301842 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.301825    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b501268d-e69b-4fa2-ab20-28f0ba1465c0-kube-api-access-nsd58" (OuterVolumeSpecName: "kube-api-access-nsd58") pod "b501268d-e69b-4fa2-ab20-28f0ba1465c0" (UID: "b501268d-e69b-4fa2-ab20-28f0ba1465c0"). InnerVolumeSpecName "kube-api-access-nsd58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:48:12.401038 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.400931    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsd58\" (UniqueName: \"kubernetes.io/projected/b501268d-e69b-4fa2-ab20-28f0ba1465c0-kube-api-access-nsd58\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:48:12.401038 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.400973    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b501268d-e69b-4fa2-ab20-28f0ba1465c0-webhook-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:48:12.876836 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.876800    2573 generic.go:356] "Generic (PLEG): container finished" podID="b501268d-e69b-4fa2-ab20-28f0ba1465c0" containerID="cc0f84bbe464fa259d4b5ae01adda3beea7c4d63376abe582b580cfc865b5d8c" exitCode=0
Jul 06 13:48:12.877295 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.876838    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b85d8477-s6b8x" event={"ID":"b501268d-e69b-4fa2-ab20-28f0ba1465c0","Type":"ContainerDied","Data":"cc0f84bbe464fa259d4b5ae01adda3beea7c4d63376abe582b580cfc865b5d8c"}
Jul 06 13:48:12.877295 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.876858    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b85d8477-s6b8x"
Jul 06 13:48:12.877295 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.876899    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b85d8477-s6b8x" event={"ID":"b501268d-e69b-4fa2-ab20-28f0ba1465c0","Type":"ContainerDied","Data":"eeec31c2539a6c53c18f5908bbfa6974c2e9162148bb7203c54dcaee8f233125"}
Jul 06 13:48:12.877295 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.876924    2573 scope.go:117] "RemoveContainer" containerID="cc0f84bbe464fa259d4b5ae01adda3beea7c4d63376abe582b580cfc865b5d8c"
Jul 06 13:48:12.886127 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.886104    2573 scope.go:117] "RemoveContainer" containerID="cc0f84bbe464fa259d4b5ae01adda3beea7c4d63376abe582b580cfc865b5d8c"
Jul 06 13:48:12.886449 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:48:12.886431    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc0f84bbe464fa259d4b5ae01adda3beea7c4d63376abe582b580cfc865b5d8c\": container with ID starting with cc0f84bbe464fa259d4b5ae01adda3beea7c4d63376abe582b580cfc865b5d8c not found: ID does not exist" containerID="cc0f84bbe464fa259d4b5ae01adda3beea7c4d63376abe582b580cfc865b5d8c"
Jul 06 13:48:12.886514 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.886456    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0f84bbe464fa259d4b5ae01adda3beea7c4d63376abe582b580cfc865b5d8c"} err="failed to get container status \"cc0f84bbe464fa259d4b5ae01adda3beea7c4d63376abe582b580cfc865b5d8c\": rpc error: code = NotFound desc = could not find container \"cc0f84bbe464fa259d4b5ae01adda3beea7c4d63376abe582b580cfc865b5d8c\": container with ID starting with cc0f84bbe464fa259d4b5ae01adda3beea7c4d63376abe582b580cfc865b5d8c not found: ID does not exist"
Jul 06 13:48:12.908460 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.908416    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78b85d8477-s6b8x"]
Jul 06 13:48:12.916921 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:12.916887    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-78b85d8477-s6b8x"]
Jul 06 13:48:13.314142 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:13.314041    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b501268d-e69b-4fa2-ab20-28f0ba1465c0" path="/var/lib/kubelet/pods/b501268d-e69b-4fa2-ab20-28f0ba1465c0/volumes"
Jul 06 13:48:31.913956 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:31.913915    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6d756dd5d6-w8whm"]
Jul 06 13:48:31.914581 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:31.914561    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b501268d-e69b-4fa2-ab20-28f0ba1465c0" containerName="manager"
Jul 06 13:48:31.914632 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:31.914586    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b501268d-e69b-4fa2-ab20-28f0ba1465c0" containerName="manager"
Jul 06 13:48:31.914725 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:31.914713    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b501268d-e69b-4fa2-ab20-28f0ba1465c0" containerName="manager"
Jul 06 13:48:31.919784 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:31.919756    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6d756dd5d6-w8whm"
Jul 06 13:48:31.922928 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:31.922899    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 06 13:48:31.923092 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:31.923018    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hq6cd\""
Jul 06 13:48:31.927128 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:31.927101    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6d756dd5d6-w8whm"]
Jul 06 13:48:31.980536 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:31.980499    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd6d6793-78e9-4cea-b4b2-3783a6feb5c9-openshift-service-ca\") pod \"maas-api-6d756dd5d6-w8whm\" (UID: \"cd6d6793-78e9-4cea-b4b2-3783a6feb5c9\") " pod="opendatahub/maas-api-6d756dd5d6-w8whm"
Jul 06 13:48:31.980536 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:31.980536    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xsbc\" (UniqueName: \"kubernetes.io/projected/cd6d6793-78e9-4cea-b4b2-3783a6feb5c9-kube-api-access-8xsbc\") pod \"maas-api-6d756dd5d6-w8whm\" (UID: \"cd6d6793-78e9-4cea-b4b2-3783a6feb5c9\") " pod="opendatahub/maas-api-6d756dd5d6-w8whm"
Jul 06 13:48:31.980746 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:31.980572    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd6d6793-78e9-4cea-b4b2-3783a6feb5c9-maas-api-tls\") pod \"maas-api-6d756dd5d6-w8whm\" (UID: \"cd6d6793-78e9-4cea-b4b2-3783a6feb5c9\") " pod="opendatahub/maas-api-6d756dd5d6-w8whm"
Jul 06 13:48:32.081171 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.081134    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd6d6793-78e9-4cea-b4b2-3783a6feb5c9-openshift-service-ca\") pod \"maas-api-6d756dd5d6-w8whm\" (UID: \"cd6d6793-78e9-4cea-b4b2-3783a6feb5c9\") " pod="opendatahub/maas-api-6d756dd5d6-w8whm"
Jul 06 13:48:32.081171 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.081174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xsbc\" (UniqueName: \"kubernetes.io/projected/cd6d6793-78e9-4cea-b4b2-3783a6feb5c9-kube-api-access-8xsbc\") pod \"maas-api-6d756dd5d6-w8whm\" (UID: \"cd6d6793-78e9-4cea-b4b2-3783a6feb5c9\") " pod="opendatahub/maas-api-6d756dd5d6-w8whm"
Jul 06 13:48:32.081443 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.081208    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd6d6793-78e9-4cea-b4b2-3783a6feb5c9-maas-api-tls\") pod \"maas-api-6d756dd5d6-w8whm\" (UID: \"cd6d6793-78e9-4cea-b4b2-3783a6feb5c9\") " pod="opendatahub/maas-api-6d756dd5d6-w8whm"
Jul 06 13:48:32.081443 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:48:32.081338    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 06 13:48:32.081443 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:48:32.081398    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd6d6793-78e9-4cea-b4b2-3783a6feb5c9-maas-api-tls podName:cd6d6793-78e9-4cea-b4b2-3783a6feb5c9 nodeName:}" failed. No retries permitted until 2026-07-06 13:48:32.581383436 +0000 UTC m=+527.892947083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cd6d6793-78e9-4cea-b4b2-3783a6feb5c9-maas-api-tls") pod "maas-api-6d756dd5d6-w8whm" (UID: "cd6d6793-78e9-4cea-b4b2-3783a6feb5c9") : secret "maas-api-serving-cert" not found
Jul 06 13:48:32.081931 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.081912    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd6d6793-78e9-4cea-b4b2-3783a6feb5c9-openshift-service-ca\") pod \"maas-api-6d756dd5d6-w8whm\" (UID: \"cd6d6793-78e9-4cea-b4b2-3783a6feb5c9\") " pod="opendatahub/maas-api-6d756dd5d6-w8whm"
Jul 06 13:48:32.097996 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.097956    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xsbc\" (UniqueName: \"kubernetes.io/projected/cd6d6793-78e9-4cea-b4b2-3783a6feb5c9-kube-api-access-8xsbc\") pod \"maas-api-6d756dd5d6-w8whm\" (UID: \"cd6d6793-78e9-4cea-b4b2-3783a6feb5c9\") " pod="opendatahub/maas-api-6d756dd5d6-w8whm"
Jul 06 13:48:32.562487 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.562449    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x29pb"]
Jul 06 13:48:32.570741 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.570702    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-x29pb"
Jul 06 13:48:32.573837 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.573803    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fq6nt\""
Jul 06 13:48:32.574042 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.573857    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 13:48:32.582103 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.582075    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x29pb"]
Jul 06 13:48:32.585956 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.585903    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd6d6793-78e9-4cea-b4b2-3783a6feb5c9-maas-api-tls\") pod \"maas-api-6d756dd5d6-w8whm\" (UID: \"cd6d6793-78e9-4cea-b4b2-3783a6feb5c9\") " pod="opendatahub/maas-api-6d756dd5d6-w8whm"
Jul 06 13:48:32.585956 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.585952    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fd49e00-3560-41fb-9e9b-528710a4ace6-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x29pb\" (UID: \"9fd49e00-3560-41fb-9e9b-528710a4ace6\") " pod="openshift-ingress/payload-pre-processing-7964457696-x29pb"
Jul 06 13:48:32.586214 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.586017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tggt6\" (UniqueName: \"kubernetes.io/projected/9fd49e00-3560-41fb-9e9b-528710a4ace6-kube-api-access-tggt6\") pod \"payload-pre-processing-7964457696-x29pb\" (UID: \"9fd49e00-3560-41fb-9e9b-528710a4ace6\") " pod="openshift-ingress/payload-pre-processing-7964457696-x29pb"
Jul 06 13:48:32.588440 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.588410    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd6d6793-78e9-4cea-b4b2-3783a6feb5c9-maas-api-tls\") pod \"maas-api-6d756dd5d6-w8whm\" (UID: \"cd6d6793-78e9-4cea-b4b2-3783a6feb5c9\") " pod="opendatahub/maas-api-6d756dd5d6-w8whm"
Jul 06 13:48:32.661450 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.661414    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-88zsj"]
Jul 06 13:48:32.665023 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.665001    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-88zsj"
Jul 06 13:48:32.675490 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.675463    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-88zsj"]
Jul 06 13:48:32.686949 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.686913    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fd49e00-3560-41fb-9e9b-528710a4ace6-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x29pb\" (UID: \"9fd49e00-3560-41fb-9e9b-528710a4ace6\") " pod="openshift-ingress/payload-pre-processing-7964457696-x29pb"
Jul 06 13:48:32.687255 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.687226    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/029f1e78-7647-4513-931f-4567da2e4558-plugins-config-volume\") pod \"payload-processing-58f86c7798-88zsj\" (UID: \"029f1e78-7647-4513-931f-4567da2e4558\") " pod="openshift-ingress/payload-processing-58f86c7798-88zsj"
Jul 06 13:48:32.687380 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.687361    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tggt6\" (UniqueName: \"kubernetes.io/projected/9fd49e00-3560-41fb-9e9b-528710a4ace6-kube-api-access-tggt6\") pod \"payload-pre-processing-7964457696-x29pb\" (UID: \"9fd49e00-3560-41fb-9e9b-528710a4ace6\") " pod="openshift-ingress/payload-pre-processing-7964457696-x29pb"
Jul 06 13:48:32.687452 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.687390    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgz54\" (UniqueName: \"kubernetes.io/projected/029f1e78-7647-4513-931f-4567da2e4558-kube-api-access-tgz54\") pod \"payload-processing-58f86c7798-88zsj\" (UID: \"029f1e78-7647-4513-931f-4567da2e4558\") " pod="openshift-ingress/payload-processing-58f86c7798-88zsj"
Jul 06 13:48:32.687997 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.687977    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fd49e00-3560-41fb-9e9b-528710a4ace6-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x29pb\" (UID: \"9fd49e00-3560-41fb-9e9b-528710a4ace6\") " pod="openshift-ingress/payload-pre-processing-7964457696-x29pb"
Jul 06 13:48:32.703422 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.703383    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tggt6\" (UniqueName: \"kubernetes.io/projected/9fd49e00-3560-41fb-9e9b-528710a4ace6-kube-api-access-tggt6\") pod \"payload-pre-processing-7964457696-x29pb\" (UID: \"9fd49e00-3560-41fb-9e9b-528710a4ace6\") " pod="openshift-ingress/payload-pre-processing-7964457696-x29pb"
Jul 06 13:48:32.788450 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.788407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/029f1e78-7647-4513-931f-4567da2e4558-plugins-config-volume\") pod \"payload-processing-58f86c7798-88zsj\" (UID: \"029f1e78-7647-4513-931f-4567da2e4558\") " pod="openshift-ingress/payload-processing-58f86c7798-88zsj"
Jul 06 13:48:32.788637 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.788496    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgz54\" (UniqueName: \"kubernetes.io/projected/029f1e78-7647-4513-931f-4567da2e4558-kube-api-access-tgz54\") pod \"payload-processing-58f86c7798-88zsj\" (UID: \"029f1e78-7647-4513-931f-4567da2e4558\") " pod="openshift-ingress/payload-processing-58f86c7798-88zsj"
Jul 06 13:48:32.789146 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.789124    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/029f1e78-7647-4513-931f-4567da2e4558-plugins-config-volume\") pod \"payload-processing-58f86c7798-88zsj\" (UID: \"029f1e78-7647-4513-931f-4567da2e4558\") " pod="openshift-ingress/payload-processing-58f86c7798-88zsj"
Jul 06 13:48:32.797454 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.797428    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgz54\" (UniqueName: \"kubernetes.io/projected/029f1e78-7647-4513-931f-4567da2e4558-kube-api-access-tgz54\") pod \"payload-processing-58f86c7798-88zsj\" (UID: \"029f1e78-7647-4513-931f-4567da2e4558\") " pod="openshift-ingress/payload-processing-58f86c7798-88zsj"
Jul 06 13:48:32.833246 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.833213    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6d756dd5d6-w8whm"
Jul 06 13:48:32.883589 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.883555    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-x29pb"
Jul 06 13:48:32.977522 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:32.977487    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-88zsj"
Jul 06 13:48:33.000300 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:33.000257    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6d756dd5d6-w8whm"]
Jul 06 13:48:33.002353 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:48:33.002320    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd6d6793_78e9_4cea_b4b2_3783a6feb5c9.slice/crio-d1371291b97df832effd3fb6b0a85419622b60b3fd7d7eadb527f1b195cde677 WatchSource:0}: Error finding container d1371291b97df832effd3fb6b0a85419622b60b3fd7d7eadb527f1b195cde677: Status 404 returned error can't find the container with id d1371291b97df832effd3fb6b0a85419622b60b3fd7d7eadb527f1b195cde677
Jul 06 13:48:33.050320 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:33.049722    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x29pb"]
Jul 06 13:48:33.052462 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:48:33.052422    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd49e00_3560_41fb_9e9b_528710a4ace6.slice/crio-b008a248fe38a442884c59b4dee65c1bdb6b4fc5eadd943cb055770e8789ec07 WatchSource:0}: Error finding container b008a248fe38a442884c59b4dee65c1bdb6b4fc5eadd943cb055770e8789ec07: Status 404 returned error can't find the container with id b008a248fe38a442884c59b4dee65c1bdb6b4fc5eadd943cb055770e8789ec07
Jul 06 13:48:33.135997 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:33.135967    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-88zsj"]
Jul 06 13:48:33.138240 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:48:33.138198    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod029f1e78_7647_4513_931f_4567da2e4558.slice/crio-6b7548514e40a3256fa0065f8fb85d96de7db2e7e352e6fed5655eb3a93efbaa WatchSource:0}: Error finding container 6b7548514e40a3256fa0065f8fb85d96de7db2e7e352e6fed5655eb3a93efbaa: Status 404 returned error can't find the container with id 6b7548514e40a3256fa0065f8fb85d96de7db2e7e352e6fed5655eb3a93efbaa
Jul 06 13:48:33.995743 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:33.995648    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6d756dd5d6-w8whm" event={"ID":"cd6d6793-78e9-4cea-b4b2-3783a6feb5c9","Type":"ContainerStarted","Data":"d1371291b97df832effd3fb6b0a85419622b60b3fd7d7eadb527f1b195cde677"}
Jul 06 13:48:33.998234 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:33.998196    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-88zsj" event={"ID":"029f1e78-7647-4513-931f-4567da2e4558","Type":"ContainerStarted","Data":"6b7548514e40a3256fa0065f8fb85d96de7db2e7e352e6fed5655eb3a93efbaa"}
Jul 06 13:48:34.000876 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:34.000839    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-x29pb" event={"ID":"9fd49e00-3560-41fb-9e9b-528710a4ace6","Type":"ContainerStarted","Data":"b008a248fe38a442884c59b4dee65c1bdb6b4fc5eadd943cb055770e8789ec07"}
Jul 06 13:48:36.014175 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:36.014140    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-88zsj" event={"ID":"029f1e78-7647-4513-931f-4567da2e4558","Type":"ContainerStarted","Data":"a7c71b1323c653a21551dbd846118b709aa59cfada49eac4bcd5acf3f2acdeb6"}
Jul 06 13:48:36.014680 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:36.014198    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-88zsj"
Jul 06 13:48:36.015770 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:36.015748    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-x29pb" event={"ID":"9fd49e00-3560-41fb-9e9b-528710a4ace6","Type":"ContainerStarted","Data":"d41792b931144fe59d72246a425c261eddce75bf2d106496255f4b35ff713879"}
Jul 06 13:48:36.015870 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:36.015817    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-x29pb"
Jul 06 13:48:36.017211 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:36.017189    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6d756dd5d6-w8whm" event={"ID":"cd6d6793-78e9-4cea-b4b2-3783a6feb5c9","Type":"ContainerStarted","Data":"ba1b1cb7e746f1a6acfc1038353d9abaccb6013199361abc4a109fa9ec7f0d33"}
Jul 06 13:48:36.017308 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:36.017246    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6d756dd5d6-w8whm"
Jul 06 13:48:36.062912 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:36.062831    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-88zsj" podStartSLOduration=2.039228586 podStartE2EDuration="4.062805607s" totalImagesPullingTime="2.023577021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:48:36.058166535 +0000 UTC m=+531.369730203" watchObservedRunningTime="2026-07-06 13:48:36.062805607 +0000 UTC m=+531.374369277"
Jul 06 13:48:36.110253 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:36.110150    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6d756dd5d6-w8whm" podStartSLOduration=2.950021903 podStartE2EDuration="5.110130947s" totalImagesPullingTime="2.160109044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:48:36.109442735 +0000 UTC m=+531.421006403" watchObservedRunningTime="2026-07-06 13:48:36.110130947 +0000 UTC m=+531.421694615"
Jul 06 13:48:36.161810 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:36.161742    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-x29pb" podStartSLOduration=2.049509574 podStartE2EDuration="4.1617084s" totalImagesPullingTime="2.112198826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:48:36.161607531 +0000 UTC m=+531.473171200" watchObservedRunningTime="2026-07-06 13:48:36.1617084 +0000 UTC m=+531.473272222"
Jul 06 13:48:41.045635 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:41.045593    2573 generic.go:356] "Generic (PLEG): container finished" podID="30405940-ed0a-4e35-844f-e8aa9ba80f3b" containerID="abb46c1bdc4b554d6c269f309ee7485d7dbb4b857f4ba9e1546cdcab560edd56" exitCode=0
Jul 06 13:48:41.046085 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:41.045670    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z" event={"ID":"30405940-ed0a-4e35-844f-e8aa9ba80f3b","Type":"ContainerDied","Data":"abb46c1bdc4b554d6c269f309ee7485d7dbb4b857f4ba9e1546cdcab560edd56"}
Jul 06 13:48:41.046136 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:41.046101    2573 scope.go:117] "RemoveContainer" containerID="abb46c1bdc4b554d6c269f309ee7485d7dbb4b857f4ba9e1546cdcab560edd56"
Jul 06 13:48:41.047207 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:41.047175    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:48:41.047315 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:41.047259    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:48:41.047315 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:41.047309    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:48:42.027561 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:42.027534    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6d756dd5d6-w8whm"
Jul 06 13:48:42.062085 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:42.062027    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z" event={"ID":"30405940-ed0a-4e35-844f-e8aa9ba80f3b","Type":"ContainerStarted","Data":"8263777da1924555b662a53deff6bd8512a4b294b0bb0b57cdd73f9cd936ae11"}
Jul 06 13:48:42.956119 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:42.956075    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:48:42.956357 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:42.956306    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lw78z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 06 13:48:42.956431 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:42.956355    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z" podUID="30405940-ed0a-4e35-844f-e8aa9ba80f3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 06 13:48:43.954493 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:43.954451    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lw78z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 06 13:48:43.955139 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:43.955105    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z" podUID="30405940-ed0a-4e35-844f-e8aa9ba80f3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 06 13:48:44.954781 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:44.954739    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lw78z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 06 13:48:44.955427 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:44.955391    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z" podUID="30405940-ed0a-4e35-844f-e8aa9ba80f3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 06 13:48:45.954710 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:45.954666    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lw78z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 06 13:48:45.954894 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:45.954738    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z" podUID="30405940-ed0a-4e35-844f-e8aa9ba80f3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 06 13:48:46.533179 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:46.533149    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:48:46.958817 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:46.958784    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:48:47.024485 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:47.024444    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-88zsj"
Jul 06 13:48:47.024655 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:47.024516    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-x29pb"
Jul 06 13:48:47.094989 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:48:47.094963    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lw78z"
Jul 06 13:49:18.910194 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:18.910151    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"]
Jul 06 13:49:18.914402 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:18.914380    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:18.917194 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:18.917172    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 13:49:18.918583 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:18.918543    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 13:49:18.918693 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:18.918555    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xpd76\""
Jul 06 13:49:18.918693 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:18.918570    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 13:49:18.922740 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:18.922585    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"]
Jul 06 13:49:19.015523 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.015455    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfzqf\" (UniqueName: \"kubernetes.io/projected/c732cade-9d1f-4696-8ec6-bc0660915f5d-kube-api-access-lfzqf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.015523 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.015526    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c732cade-9d1f-4696-8ec6-bc0660915f5d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.015750 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.015611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c732cade-9d1f-4696-8ec6-bc0660915f5d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.015750 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.015640    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c732cade-9d1f-4696-8ec6-bc0660915f5d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.015750 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.015673    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c732cade-9d1f-4696-8ec6-bc0660915f5d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.015850 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.015766    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c732cade-9d1f-4696-8ec6-bc0660915f5d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.116941 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.116903    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c732cade-9d1f-4696-8ec6-bc0660915f5d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.116941 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.116953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c732cade-9d1f-4696-8ec6-bc0660915f5d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.117248 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.116977    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c732cade-9d1f-4696-8ec6-bc0660915f5d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.117248 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.117020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c732cade-9d1f-4696-8ec6-bc0660915f5d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.117248 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.117040    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfzqf\" (UniqueName: \"kubernetes.io/projected/c732cade-9d1f-4696-8ec6-bc0660915f5d-kube-api-access-lfzqf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.117248 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.117108    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c732cade-9d1f-4696-8ec6-bc0660915f5d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.117460 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.117366    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c732cade-9d1f-4696-8ec6-bc0660915f5d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.117460 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.117415    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c732cade-9d1f-4696-8ec6-bc0660915f5d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.117460 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.117450    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c732cade-9d1f-4696-8ec6-bc0660915f5d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.119514 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.119490    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c732cade-9d1f-4696-8ec6-bc0660915f5d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.119771 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.119756    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c732cade-9d1f-4696-8ec6-bc0660915f5d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.129597 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.129564    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfzqf\" (UniqueName: \"kubernetes.io/projected/c732cade-9d1f-4696-8ec6-bc0660915f5d-kube-api-access-lfzqf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sm9pc\" (UID: \"c732cade-9d1f-4696-8ec6-bc0660915f5d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.227383 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.227282    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:19.402810 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:19.402785    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"]
Jul 06 13:49:19.404796 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:49:19.404773    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc732cade_9d1f_4696_8ec6_bc0660915f5d.slice/crio-04560031da9dfeb5cb959b23e40ff07f4265d804eba7bb3eba33d382a32c76dd WatchSource:0}: Error finding container 04560031da9dfeb5cb959b23e40ff07f4265d804eba7bb3eba33d382a32c76dd: Status 404 returned error can't find the container with id 04560031da9dfeb5cb959b23e40ff07f4265d804eba7bb3eba33d382a32c76dd
Jul 06 13:49:20.266849 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:20.266813    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc" event={"ID":"c732cade-9d1f-4696-8ec6-bc0660915f5d","Type":"ContainerStarted","Data":"04560031da9dfeb5cb959b23e40ff07f4265d804eba7bb3eba33d382a32c76dd"}
Jul 06 13:49:21.273552 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:21.273515    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc" event={"ID":"c732cade-9d1f-4696-8ec6-bc0660915f5d","Type":"ContainerStarted","Data":"62bf830b417542c800e2e256298d53e36e4fe1e2c88bd8c14c51f27bff10b3b3"}
Jul 06 13:49:21.298768 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:21.298710    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc" podStartSLOduration=2.138531295 podStartE2EDuration="3.298691801s" totalImagesPullingTime="1.160160506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:49:21.297558491 +0000 UTC m=+576.609122160" watchObservedRunningTime="2026-07-06 13:49:21.298691801 +0000 UTC m=+576.610255469"
Jul 06 13:49:29.228285 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:29.228234    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:29.228787 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:29.228322    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:29.241035 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:29.241009    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:29.325266 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:29.325227    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sm9pc"
Jul 06 13:49:45.160272 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:45.160240    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 13:49:45.161512 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:49:45.161486    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 13:50:29.304735 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:29.304695    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67f8bb647c-v9h7z"]
Jul 06 13:50:29.309874 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:29.309832    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67f8bb647c-v9h7z"
Jul 06 13:50:29.320343 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:29.320301    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67f8bb647c-v9h7z"]
Jul 06 13:50:29.365906 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:29.365871    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc5qm\" (UniqueName: \"kubernetes.io/projected/c539b2f2-f3c5-465c-830c-e9a18851b530-kube-api-access-pc5qm\") pod \"authorino-67f8bb647c-v9h7z\" (UID: \"c539b2f2-f3c5-465c-830c-e9a18851b530\") " pod="kuadrant-system/authorino-67f8bb647c-v9h7z"
Jul 06 13:50:29.366117 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:29.365948    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c539b2f2-f3c5-465c-830c-e9a18851b530-tls-cert\") pod \"authorino-67f8bb647c-v9h7z\" (UID: \"c539b2f2-f3c5-465c-830c-e9a18851b530\") " pod="kuadrant-system/authorino-67f8bb647c-v9h7z"
Jul 06 13:50:29.467035 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:29.466993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c539b2f2-f3c5-465c-830c-e9a18851b530-tls-cert\") pod \"authorino-67f8bb647c-v9h7z\" (UID: \"c539b2f2-f3c5-465c-830c-e9a18851b530\") " pod="kuadrant-system/authorino-67f8bb647c-v9h7z"
Jul 06 13:50:29.467232 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:29.467125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc5qm\" (UniqueName: \"kubernetes.io/projected/c539b2f2-f3c5-465c-830c-e9a18851b530-kube-api-access-pc5qm\") pod \"authorino-67f8bb647c-v9h7z\" (UID: \"c539b2f2-f3c5-465c-830c-e9a18851b530\") " pod="kuadrant-system/authorino-67f8bb647c-v9h7z"
Jul 06 13:50:29.469661 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:29.469637    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c539b2f2-f3c5-465c-830c-e9a18851b530-tls-cert\") pod \"authorino-67f8bb647c-v9h7z\" (UID: \"c539b2f2-f3c5-465c-830c-e9a18851b530\") " pod="kuadrant-system/authorino-67f8bb647c-v9h7z"
Jul 06 13:50:29.476516 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:29.476487    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc5qm\" (UniqueName: \"kubernetes.io/projected/c539b2f2-f3c5-465c-830c-e9a18851b530-kube-api-access-pc5qm\") pod \"authorino-67f8bb647c-v9h7z\" (UID: \"c539b2f2-f3c5-465c-830c-e9a18851b530\") " pod="kuadrant-system/authorino-67f8bb647c-v9h7z"
Jul 06 13:50:29.622484 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:29.622439    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67f8bb647c-v9h7z"
Jul 06 13:50:29.784706 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:29.784681    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67f8bb647c-v9h7z"]
Jul 06 13:50:29.786857 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:50:29.786816    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc539b2f2_f3c5_465c_830c_e9a18851b530.slice/crio-76b2596783ad4342532f56e19cfc0fc6808775c6c11e3221a36952786646704e WatchSource:0}: Error finding container 76b2596783ad4342532f56e19cfc0fc6808775c6c11e3221a36952786646704e: Status 404 returned error can't find the container with id 76b2596783ad4342532f56e19cfc0fc6808775c6c11e3221a36952786646704e
Jul 06 13:50:29.788165 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:29.788147    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 13:50:30.636088 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:30.636031    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67f8bb647c-v9h7z" event={"ID":"c539b2f2-f3c5-465c-830c-e9a18851b530","Type":"ContainerStarted","Data":"dd6654ea3913f7164a5c86fbc42b8717586e704e4ffad0bfaa285d35c2a919bc"}
Jul 06 13:50:30.636587 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:30.636109    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67f8bb647c-v9h7z" event={"ID":"c539b2f2-f3c5-465c-830c-e9a18851b530","Type":"ContainerStarted","Data":"76b2596783ad4342532f56e19cfc0fc6808775c6c11e3221a36952786646704e"}
Jul 06 13:50:30.657428 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:30.657369    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67f8bb647c-v9h7z" podStartSLOduration=1.171085506 podStartE2EDuration="1.657350301s" totalImagesPullingTime="486.264795ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:30.655166989 +0000 UTC m=+645.966730681" watchObservedRunningTime="2026-07-06 13:50:30.657350301 +0000 UTC m=+645.968913969"
Jul 06 13:50:30.694183 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:30.693367    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77fb8b98fb-fqslq"]
Jul 06 13:50:30.694183 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:30.693599    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-77fb8b98fb-fqslq" podUID="eb3cb7fd-9a88-4074-80db-efa622a2f30f" containerName="authorino" containerID="cri-o://b970ccc174b47494bdd00430389952590ca515997585c79d71bfca9024866464" gracePeriod=30
Jul 06 13:50:30.979994 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:30.979963    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77fb8b98fb-fqslq"
Jul 06 13:50:31.083361 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.083313    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eb3cb7fd-9a88-4074-80db-efa622a2f30f-tls-cert\") pod \"eb3cb7fd-9a88-4074-80db-efa622a2f30f\" (UID: \"eb3cb7fd-9a88-4074-80db-efa622a2f30f\") "
Jul 06 13:50:31.083545 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.083486    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lh54\" (UniqueName: \"kubernetes.io/projected/eb3cb7fd-9a88-4074-80db-efa622a2f30f-kube-api-access-6lh54\") pod \"eb3cb7fd-9a88-4074-80db-efa622a2f30f\" (UID: \"eb3cb7fd-9a88-4074-80db-efa622a2f30f\") "
Jul 06 13:50:31.085465 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.085423    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb3cb7fd-9a88-4074-80db-efa622a2f30f-kube-api-access-6lh54" (OuterVolumeSpecName: "kube-api-access-6lh54") pod "eb3cb7fd-9a88-4074-80db-efa622a2f30f" (UID: "eb3cb7fd-9a88-4074-80db-efa622a2f30f"). InnerVolumeSpecName "kube-api-access-6lh54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:50:31.095669 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.095627    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb3cb7fd-9a88-4074-80db-efa622a2f30f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "eb3cb7fd-9a88-4074-80db-efa622a2f30f" (UID: "eb3cb7fd-9a88-4074-80db-efa622a2f30f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:50:31.185092 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.185040    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eb3cb7fd-9a88-4074-80db-efa622a2f30f-tls-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:50:31.185092 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.185084    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lh54\" (UniqueName: \"kubernetes.io/projected/eb3cb7fd-9a88-4074-80db-efa622a2f30f-kube-api-access-6lh54\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:50:31.642457 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.642415    2573 generic.go:356] "Generic (PLEG): container finished" podID="eb3cb7fd-9a88-4074-80db-efa622a2f30f" containerID="b970ccc174b47494bdd00430389952590ca515997585c79d71bfca9024866464" exitCode=0
Jul 06 13:50:31.642457 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.642462    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77fb8b98fb-fqslq"
Jul 06 13:50:31.643036 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.642498    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77fb8b98fb-fqslq" event={"ID":"eb3cb7fd-9a88-4074-80db-efa622a2f30f","Type":"ContainerDied","Data":"b970ccc174b47494bdd00430389952590ca515997585c79d71bfca9024866464"}
Jul 06 13:50:31.643036 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.642543    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77fb8b98fb-fqslq" event={"ID":"eb3cb7fd-9a88-4074-80db-efa622a2f30f","Type":"ContainerDied","Data":"fc5fdffca0aa6dd5e09eb99db6a878504a1669313f4d71332b4298d3198beee0"}
Jul 06 13:50:31.643036 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.642559    2573 scope.go:117] "RemoveContainer" containerID="b970ccc174b47494bdd00430389952590ca515997585c79d71bfca9024866464"
Jul 06 13:50:31.654036 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.654015    2573 scope.go:117] "RemoveContainer" containerID="b970ccc174b47494bdd00430389952590ca515997585c79d71bfca9024866464"
Jul 06 13:50:31.654446 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:50:31.654427    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b970ccc174b47494bdd00430389952590ca515997585c79d71bfca9024866464\": container with ID starting with b970ccc174b47494bdd00430389952590ca515997585c79d71bfca9024866464 not found: ID does not exist" containerID="b970ccc174b47494bdd00430389952590ca515997585c79d71bfca9024866464"
Jul 06 13:50:31.654502 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.654455    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b970ccc174b47494bdd00430389952590ca515997585c79d71bfca9024866464"} err="failed to get container status \"b970ccc174b47494bdd00430389952590ca515997585c79d71bfca9024866464\": rpc error: code = NotFound desc = could not find container \"b970ccc174b47494bdd00430389952590ca515997585c79d71bfca9024866464\": container with ID starting with b970ccc174b47494bdd00430389952590ca515997585c79d71bfca9024866464 not found: ID does not exist"
Jul 06 13:50:31.669768 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.669730    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77fb8b98fb-fqslq"]
Jul 06 13:50:31.672214 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:31.672183    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-77fb8b98fb-fqslq"]
Jul 06 13:50:33.314000 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:50:33.313962    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb3cb7fd-9a88-4074-80db-efa622a2f30f" path="/var/lib/kubelet/pods/eb3cb7fd-9a88-4074-80db-efa622a2f30f/volumes"
Jul 06 13:51:43.631670 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:43.631631    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6875d9b67d-zms5c"]
Jul 06 13:51:43.632248 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:43.631852    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6875d9b67d-zms5c" podUID="cc178e4f-6423-439b-90ee-311d688d365c" containerName="manager" containerID="cri-o://3f3f2af0a959de91d8241ae868e68e295d988ee7db44f2155bfd2c79becbc355" gracePeriod=30
Jul 06 13:51:43.890618 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:43.890541    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6875d9b67d-zms5c"
Jul 06 13:51:43.980587 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:43.980554    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc178e4f-6423-439b-90ee-311d688d365c-webhook-cert\") pod \"cc178e4f-6423-439b-90ee-311d688d365c\" (UID: \"cc178e4f-6423-439b-90ee-311d688d365c\") "
Jul 06 13:51:43.980587 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:43.980594    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zbwd\" (UniqueName: \"kubernetes.io/projected/cc178e4f-6423-439b-90ee-311d688d365c-kube-api-access-8zbwd\") pod \"cc178e4f-6423-439b-90ee-311d688d365c\" (UID: \"cc178e4f-6423-439b-90ee-311d688d365c\") "
Jul 06 13:51:43.982691 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:43.982660    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc178e4f-6423-439b-90ee-311d688d365c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cc178e4f-6423-439b-90ee-311d688d365c" (UID: "cc178e4f-6423-439b-90ee-311d688d365c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:51:43.982823 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:43.982698    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc178e4f-6423-439b-90ee-311d688d365c-kube-api-access-8zbwd" (OuterVolumeSpecName: "kube-api-access-8zbwd") pod "cc178e4f-6423-439b-90ee-311d688d365c" (UID: "cc178e4f-6423-439b-90ee-311d688d365c"). InnerVolumeSpecName "kube-api-access-8zbwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:51:44.027325 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.027295    2573 generic.go:356] "Generic (PLEG): container finished" podID="cc178e4f-6423-439b-90ee-311d688d365c" containerID="3f3f2af0a959de91d8241ae868e68e295d988ee7db44f2155bfd2c79becbc355" exitCode=0
Jul 06 13:51:44.027497 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.027343    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6875d9b67d-zms5c"
Jul 06 13:51:44.027497 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.027376    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6875d9b67d-zms5c" event={"ID":"cc178e4f-6423-439b-90ee-311d688d365c","Type":"ContainerDied","Data":"3f3f2af0a959de91d8241ae868e68e295d988ee7db44f2155bfd2c79becbc355"}
Jul 06 13:51:44.027497 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.027438    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6875d9b67d-zms5c" event={"ID":"cc178e4f-6423-439b-90ee-311d688d365c","Type":"ContainerDied","Data":"b5cc56f5ff810a7137fab8cd76037f1c9f49c4866fcd7e2dcaaddb094691b81e"}
Jul 06 13:51:44.027497 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.027468    2573 scope.go:117] "RemoveContainer" containerID="3f3f2af0a959de91d8241ae868e68e295d988ee7db44f2155bfd2c79becbc355"
Jul 06 13:51:44.037311 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.037294    2573 scope.go:117] "RemoveContainer" containerID="3f3f2af0a959de91d8241ae868e68e295d988ee7db44f2155bfd2c79becbc355"
Jul 06 13:51:44.037632 ip-10-0-134-86 kubenswrapper[2573]: E0706 13:51:44.037614    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f3f2af0a959de91d8241ae868e68e295d988ee7db44f2155bfd2c79becbc355\": container with ID starting with 3f3f2af0a959de91d8241ae868e68e295d988ee7db44f2155bfd2c79becbc355 not found: ID does not exist" containerID="3f3f2af0a959de91d8241ae868e68e295d988ee7db44f2155bfd2c79becbc355"
Jul 06 13:51:44.037681 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.037642    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f3f2af0a959de91d8241ae868e68e295d988ee7db44f2155bfd2c79becbc355"} err="failed to get container status \"3f3f2af0a959de91d8241ae868e68e295d988ee7db44f2155bfd2c79becbc355\": rpc error: code = NotFound desc = could not find container \"3f3f2af0a959de91d8241ae868e68e295d988ee7db44f2155bfd2c79becbc355\": container with ID starting with 3f3f2af0a959de91d8241ae868e68e295d988ee7db44f2155bfd2c79becbc355 not found: ID does not exist"
Jul 06 13:51:44.052533 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.052499    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6875d9b67d-zms5c"]
Jul 06 13:51:44.058804 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.058776    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6875d9b67d-zms5c"]
Jul 06 13:51:44.081613 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.081582    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc178e4f-6423-439b-90ee-311d688d365c-webhook-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:51:44.081613 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.081613    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zbwd\" (UniqueName: \"kubernetes.io/projected/cc178e4f-6423-439b-90ee-311d688d365c-kube-api-access-8zbwd\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 13:51:44.889296 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.889260    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6875d9b67d-q5b6p"]
Jul 06 13:51:44.889714 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.889657    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb3cb7fd-9a88-4074-80db-efa622a2f30f" containerName="authorino"
Jul 06 13:51:44.889714 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.889668    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb3cb7fd-9a88-4074-80db-efa622a2f30f" containerName="authorino"
Jul 06 13:51:44.889714 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.889689    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc178e4f-6423-439b-90ee-311d688d365c" containerName="manager"
Jul 06 13:51:44.889714 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.889694    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc178e4f-6423-439b-90ee-311d688d365c" containerName="manager"
Jul 06 13:51:44.889863 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.889754    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc178e4f-6423-439b-90ee-311d688d365c" containerName="manager"
Jul 06 13:51:44.889863 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.889762    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb3cb7fd-9a88-4074-80db-efa622a2f30f" containerName="authorino"
Jul 06 13:51:44.894108 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.894087    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6875d9b67d-q5b6p"
Jul 06 13:51:44.897706 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.897677    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 13:51:44.897706 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.897708    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mcgg7\""
Jul 06 13:51:44.897976 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.897707    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 13:51:44.901659 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.901629    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6875d9b67d-q5b6p"]
Jul 06 13:51:44.990907 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.990868    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wds8z\" (UniqueName: \"kubernetes.io/projected/91212030-f4a6-4ed7-b376-e77bebfa9d08-kube-api-access-wds8z\") pod \"maas-controller-6875d9b67d-q5b6p\" (UID: \"91212030-f4a6-4ed7-b376-e77bebfa9d08\") " pod="opendatahub/maas-controller-6875d9b67d-q5b6p"
Jul 06 13:51:44.990907 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:44.990909    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91212030-f4a6-4ed7-b376-e77bebfa9d08-webhook-cert\") pod \"maas-controller-6875d9b67d-q5b6p\" (UID: \"91212030-f4a6-4ed7-b376-e77bebfa9d08\") " pod="opendatahub/maas-controller-6875d9b67d-q5b6p"
Jul 06 13:51:45.092023 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:45.091975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wds8z\" (UniqueName: \"kubernetes.io/projected/91212030-f4a6-4ed7-b376-e77bebfa9d08-kube-api-access-wds8z\") pod \"maas-controller-6875d9b67d-q5b6p\" (UID: \"91212030-f4a6-4ed7-b376-e77bebfa9d08\") " pod="opendatahub/maas-controller-6875d9b67d-q5b6p"
Jul 06 13:51:45.092023 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:45.092028    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91212030-f4a6-4ed7-b376-e77bebfa9d08-webhook-cert\") pod \"maas-controller-6875d9b67d-q5b6p\" (UID: \"91212030-f4a6-4ed7-b376-e77bebfa9d08\") " pod="opendatahub/maas-controller-6875d9b67d-q5b6p"
Jul 06 13:51:45.094590 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:45.094566    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 13:51:45.100888 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:45.100860    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wds8z\" (UniqueName: \"kubernetes.io/projected/91212030-f4a6-4ed7-b376-e77bebfa9d08-kube-api-access-wds8z\") pod \"maas-controller-6875d9b67d-q5b6p\" (UID: \"91212030-f4a6-4ed7-b376-e77bebfa9d08\") " pod="opendatahub/maas-controller-6875d9b67d-q5b6p"
Jul 06 13:51:45.104601 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:45.104573    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91212030-f4a6-4ed7-b376-e77bebfa9d08-webhook-cert\") pod \"maas-controller-6875d9b67d-q5b6p\" (UID: \"91212030-f4a6-4ed7-b376-e77bebfa9d08\") " pod="opendatahub/maas-controller-6875d9b67d-q5b6p"
Jul 06 13:51:45.209736 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:45.209650    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mcgg7\""
Jul 06 13:51:45.216979 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:45.216950    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6875d9b67d-q5b6p"
Jul 06 13:51:45.316943 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:45.316907    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc178e4f-6423-439b-90ee-311d688d365c" path="/var/lib/kubelet/pods/cc178e4f-6423-439b-90ee-311d688d365c/volumes"
Jul 06 13:51:45.363247 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:45.363219    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6875d9b67d-q5b6p"]
Jul 06 13:51:45.365399 ip-10-0-134-86 kubenswrapper[2573]: W0706 13:51:45.365373    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91212030_f4a6_4ed7_b376_e77bebfa9d08.slice/crio-0683e73427dfacd404149dcf4e1319cee520a37276c1206e41668a09ce0d9c52 WatchSource:0}: Error finding container 0683e73427dfacd404149dcf4e1319cee520a37276c1206e41668a09ce0d9c52: Status 404 returned error can't find the container with id 0683e73427dfacd404149dcf4e1319cee520a37276c1206e41668a09ce0d9c52
Jul 06 13:51:45.865648 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:45.865622    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 13:51:46.042294 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:46.042263    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6875d9b67d-q5b6p" event={"ID":"91212030-f4a6-4ed7-b376-e77bebfa9d08","Type":"ContainerStarted","Data":"7cf0103714a6e9cdfc69d2910adde8bb9b65c44dd931d497e04530fcd1ff20e9"}
Jul 06 13:51:46.042691 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:46.042313    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6875d9b67d-q5b6p" event={"ID":"91212030-f4a6-4ed7-b376-e77bebfa9d08","Type":"ContainerStarted","Data":"0683e73427dfacd404149dcf4e1319cee520a37276c1206e41668a09ce0d9c52"}
Jul 06 13:51:46.042691 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:46.042460    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6875d9b67d-q5b6p"
Jul 06 13:51:46.062497 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:46.062441    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6875d9b67d-q5b6p" podStartSLOduration=1.566223859 podStartE2EDuration="2.062423871s" totalImagesPullingTime="496.200012ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:51:46.060628561 +0000 UTC m=+721.372192252" watchObservedRunningTime="2026-07-06 13:51:46.062423871 +0000 UTC m=+721.373987552"
Jul 06 13:51:57.053988 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:51:57.053956    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6875d9b67d-q5b6p"
Jul 06 13:54:45.195379 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:54:45.195345    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 13:54:45.197767 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:54:45.197743    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 13:59:45.235650 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:59:45.235618    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 13:59:45.239786 ip-10-0-134-86 kubenswrapper[2573]: I0706 13:59:45.239763    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 14:00:00.224172 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:00.224134    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722440-tqf6j"]
Jul 06 14:00:00.227741 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:00.227723    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722440-tqf6j"
Jul 06 14:00:00.270857 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:00.270815    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722440-tqf6j"]
Jul 06 14:00:00.383866 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:00.383825    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkbdk\" (UniqueName: \"kubernetes.io/projected/c1d92a78-c244-4812-86c3-1f24729e65b4-kube-api-access-zkbdk\") pod \"maas-api-key-cleanup-29722440-tqf6j\" (UID: \"c1d92a78-c244-4812-86c3-1f24729e65b4\") " pod="opendatahub/maas-api-key-cleanup-29722440-tqf6j"
Jul 06 14:00:00.485417 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:00.485316    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkbdk\" (UniqueName: \"kubernetes.io/projected/c1d92a78-c244-4812-86c3-1f24729e65b4-kube-api-access-zkbdk\") pod \"maas-api-key-cleanup-29722440-tqf6j\" (UID: \"c1d92a78-c244-4812-86c3-1f24729e65b4\") " pod="opendatahub/maas-api-key-cleanup-29722440-tqf6j"
Jul 06 14:00:00.495920 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:00.495894    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkbdk\" (UniqueName: \"kubernetes.io/projected/c1d92a78-c244-4812-86c3-1f24729e65b4-kube-api-access-zkbdk\") pod \"maas-api-key-cleanup-29722440-tqf6j\" (UID: \"c1d92a78-c244-4812-86c3-1f24729e65b4\") " pod="opendatahub/maas-api-key-cleanup-29722440-tqf6j"
Jul 06 14:00:00.538909 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:00.538869    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722440-tqf6j"
Jul 06 14:00:00.683600 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:00.683563    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722440-tqf6j"]
Jul 06 14:00:00.685108 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:00:00.685079    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d92a78_c244_4812_86c3_1f24729e65b4.slice/crio-cae6e5c50da39d5c7cad2d309f45b74c09f1e67ca19509742a1177617055dea6 WatchSource:0}: Error finding container cae6e5c50da39d5c7cad2d309f45b74c09f1e67ca19509742a1177617055dea6: Status 404 returned error can't find the container with id cae6e5c50da39d5c7cad2d309f45b74c09f1e67ca19509742a1177617055dea6
Jul 06 14:00:00.687336 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:00.687315    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:00:01.667984 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:01.667950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722440-tqf6j" event={"ID":"c1d92a78-c244-4812-86c3-1f24729e65b4","Type":"ContainerStarted","Data":"cae6e5c50da39d5c7cad2d309f45b74c09f1e67ca19509742a1177617055dea6"}
Jul 06 14:00:18.757068 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:18.757022    2573 generic.go:356] "Generic (PLEG): container finished" podID="c1d92a78-c244-4812-86c3-1f24729e65b4" containerID="761eab55d3e613a4c9e0c075bafda87ba3c691e804af0ed92127a8d8dfea58a3" exitCode=0
Jul 06 14:00:18.757478 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:18.757096    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722440-tqf6j" event={"ID":"c1d92a78-c244-4812-86c3-1f24729e65b4","Type":"ContainerDied","Data":"761eab55d3e613a4c9e0c075bafda87ba3c691e804af0ed92127a8d8dfea58a3"}
Jul 06 14:00:19.912067 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:19.912028    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722440-tqf6j"
Jul 06 14:00:19.961069 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:19.961018    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkbdk\" (UniqueName: \"kubernetes.io/projected/c1d92a78-c244-4812-86c3-1f24729e65b4-kube-api-access-zkbdk\") pod \"c1d92a78-c244-4812-86c3-1f24729e65b4\" (UID: \"c1d92a78-c244-4812-86c3-1f24729e65b4\") "
Jul 06 14:00:19.963266 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:19.963232    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1d92a78-c244-4812-86c3-1f24729e65b4-kube-api-access-zkbdk" (OuterVolumeSpecName: "kube-api-access-zkbdk") pod "c1d92a78-c244-4812-86c3-1f24729e65b4" (UID: "c1d92a78-c244-4812-86c3-1f24729e65b4"). InnerVolumeSpecName "kube-api-access-zkbdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:00:20.062540 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:20.062451    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkbdk\" (UniqueName: \"kubernetes.io/projected/c1d92a78-c244-4812-86c3-1f24729e65b4-kube-api-access-zkbdk\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:00:20.767935 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:20.767902    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722440-tqf6j" event={"ID":"c1d92a78-c244-4812-86c3-1f24729e65b4","Type":"ContainerDied","Data":"cae6e5c50da39d5c7cad2d309f45b74c09f1e67ca19509742a1177617055dea6"}
Jul 06 14:00:20.767935 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:20.767923    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722440-tqf6j"
Jul 06 14:00:20.768169 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:00:20.767956    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cae6e5c50da39d5c7cad2d309f45b74c09f1e67ca19509742a1177617055dea6"
Jul 06 14:03:27.857871 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.857837    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"]
Jul 06 14:03:27.858394 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.858379    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1d92a78-c244-4812-86c3-1f24729e65b4" containerName="cleanup"
Jul 06 14:03:27.858442 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.858397    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1d92a78-c244-4812-86c3-1f24729e65b4" containerName="cleanup"
Jul 06 14:03:27.858488 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.858479    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1d92a78-c244-4812-86c3-1f24729e65b4" containerName="cleanup"
Jul 06 14:03:27.861617 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.861598    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:27.864381 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.864357    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-14c4c5d7-openshift-default-dockercfg-tdhsj\""
Jul 06 14:03:27.886019 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.885972    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"]
Jul 06 14:03:27.913351 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.913311    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-workload-socket\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:27.913351 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.913353    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89e7668a-b72b-4f05-8d90-77d41509843f-istio-token\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:27.913586 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.913398    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82d6r\" (UniqueName: \"kubernetes.io/projected/89e7668a-b72b-4f05-8d90-77d41509843f-kube-api-access-82d6r\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:27.913586 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.913426    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-istio-data\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:27.913586 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.913490    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-credential-socket\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:27.913586 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.913541    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89e7668a-b72b-4f05-8d90-77d41509843f-istiod-ca-cert\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:27.913586 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.913576    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-istio-envoy\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:27.913777 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.913598    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89e7668a-b72b-4f05-8d90-77d41509843f-istio-podinfo\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:27.913777 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:27.913627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-workload-certs\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.014610 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.014557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82d6r\" (UniqueName: \"kubernetes.io/projected/89e7668a-b72b-4f05-8d90-77d41509843f-kube-api-access-82d6r\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.014610 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.014616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-istio-data\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.014883 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.014639    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-credential-socket\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.014883 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.014672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89e7668a-b72b-4f05-8d90-77d41509843f-istiod-ca-cert\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.014883 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.014699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-istio-envoy\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.014883 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.014720    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89e7668a-b72b-4f05-8d90-77d41509843f-istio-podinfo\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.015152 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.014883    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-workload-certs\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.015152 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.014996    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-workload-socket\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.015152 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.015024    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89e7668a-b72b-4f05-8d90-77d41509843f-istio-token\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.015311 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.015249    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-istio-data\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.015370 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.015337    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-workload-socket\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.015370 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.015360    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-credential-socket\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.015445 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.015371    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-workload-certs\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.015647 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.015627    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89e7668a-b72b-4f05-8d90-77d41509843f-istiod-ca-cert\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.017275 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.017245    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-istio-envoy\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.017446 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.017425    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89e7668a-b72b-4f05-8d90-77d41509843f-istio-podinfo\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.023683 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.023654    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89e7668a-b72b-4f05-8d90-77d41509843f-istio-token\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.023843 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.023752    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82d6r\" (UniqueName: \"kubernetes.io/projected/89e7668a-b72b-4f05-8d90-77d41509843f-kube-api-access-82d6r\") pod \"e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") " pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.174777 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.174676    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:28.324956 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.324924    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"]
Jul 06 14:03:28.327285 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:03:28.327249    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e7668a_b72b_4f05_8d90_77d41509843f.slice/crio-bb4b9a3070182e4748ebdbb48f8b112f0f22b5686b5fc4a0441659537ccca3dd WatchSource:0}: Error finding container bb4b9a3070182e4748ebdbb48f8b112f0f22b5686b5fc4a0441659537ccca3dd: Status 404 returned error can't find the container with id bb4b9a3070182e4748ebdbb48f8b112f0f22b5686b5fc4a0441659537ccca3dd
Jul 06 14:03:28.329896 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.329860    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:03:28.329977 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.329931    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:03:28.329977 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.329962    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:03:28.797756 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.797713    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq" event={"ID":"89e7668a-b72b-4f05-8d90-77d41509843f","Type":"ContainerStarted","Data":"8747c25bb6dcb652b9a31e9a6822275613b1607c108f68c33e06aff8d84cc317"}
Jul 06 14:03:28.797947 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.797782    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq" event={"ID":"89e7668a-b72b-4f05-8d90-77d41509843f","Type":"ContainerStarted","Data":"bb4b9a3070182e4748ebdbb48f8b112f0f22b5686b5fc4a0441659537ccca3dd"}
Jul 06 14:03:28.821550 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:28.821501    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq" podStartSLOduration=1.8214853039999999 podStartE2EDuration="1.821485304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:03:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:03:28.820519736 +0000 UTC m=+1424.132083432" watchObservedRunningTime="2026-07-06 14:03:28.821485304 +0000 UTC m=+1424.133048971"
Jul 06 14:03:29.175781 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.175742    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:29.180986 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.180957    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:29.209738 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.209687    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"]
Jul 06 14:03:29.213530 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.213502    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:29.217553 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.217531    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-14c4c5d7-serving-cert\""
Jul 06 14:03:29.224024 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.223995    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daab75f1-ba01-4cdc-98d8-16537c4a8886-openshift-service-ca\") pod \"maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f\" (UID: \"daab75f1-ba01-4cdc-98d8-16537c4a8886\") " pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:29.224219 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.224201    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54pwn\" (UniqueName: \"kubernetes.io/projected/daab75f1-ba01-4cdc-98d8-16537c4a8886-kube-api-access-54pwn\") pod \"maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f\" (UID: \"daab75f1-ba01-4cdc-98d8-16537c4a8886\") " pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:29.224302 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.224254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daab75f1-ba01-4cdc-98d8-16537c4a8886-maas-api-tls\") pod \"maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f\" (UID: \"daab75f1-ba01-4cdc-98d8-16537c4a8886\") " pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:29.225755 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.225732    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"]
Jul 06 14:03:29.324987 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.324950    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54pwn\" (UniqueName: \"kubernetes.io/projected/daab75f1-ba01-4cdc-98d8-16537c4a8886-kube-api-access-54pwn\") pod \"maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f\" (UID: \"daab75f1-ba01-4cdc-98d8-16537c4a8886\") " pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:29.325214 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.325036    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daab75f1-ba01-4cdc-98d8-16537c4a8886-maas-api-tls\") pod \"maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f\" (UID: \"daab75f1-ba01-4cdc-98d8-16537c4a8886\") " pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:29.325214 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.325131    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daab75f1-ba01-4cdc-98d8-16537c4a8886-openshift-service-ca\") pod \"maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f\" (UID: \"daab75f1-ba01-4cdc-98d8-16537c4a8886\") " pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:29.325337 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:03:29.325258    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-14c4c5d7-serving-cert: secret "maas-api-e2e-ait-14c4c5d7-serving-cert" not found
Jul 06 14:03:29.325389 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:03:29.325341    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daab75f1-ba01-4cdc-98d8-16537c4a8886-maas-api-tls podName:daab75f1-ba01-4cdc-98d8-16537c4a8886 nodeName:}" failed. No retries permitted until 2026-07-06 14:03:29.825315425 +0000 UTC m=+1425.136879093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/daab75f1-ba01-4cdc-98d8-16537c4a8886-maas-api-tls") pod "maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f" (UID: "daab75f1-ba01-4cdc-98d8-16537c4a8886") : secret "maas-api-e2e-ait-14c4c5d7-serving-cert" not found
Jul 06 14:03:29.325919 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.325892    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daab75f1-ba01-4cdc-98d8-16537c4a8886-openshift-service-ca\") pod \"maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f\" (UID: \"daab75f1-ba01-4cdc-98d8-16537c4a8886\") " pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:29.342145 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.342105    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54pwn\" (UniqueName: \"kubernetes.io/projected/daab75f1-ba01-4cdc-98d8-16537c4a8886-kube-api-access-54pwn\") pod \"maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f\" (UID: \"daab75f1-ba01-4cdc-98d8-16537c4a8886\") " pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:29.803890 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.803859    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:29.805023 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.805002    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:29.830028 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.829995    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daab75f1-ba01-4cdc-98d8-16537c4a8886-maas-api-tls\") pod \"maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f\" (UID: \"daab75f1-ba01-4cdc-98d8-16537c4a8886\") " pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:29.832541 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:29.832515    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daab75f1-ba01-4cdc-98d8-16537c4a8886-maas-api-tls\") pod \"maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f\" (UID: \"daab75f1-ba01-4cdc-98d8-16537c4a8886\") " pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:30.126551 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:30.126508    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:30.276513 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:30.276487    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"]
Jul 06 14:03:30.278999 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:03:30.278967    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaab75f1_ba01_4cdc_98d8_16537c4a8886.slice/crio-4273e5ae72d5577ab60ea776f4f249585d0dfd425ce94ee61f7231a5f779a71c WatchSource:0}: Error finding container 4273e5ae72d5577ab60ea776f4f249585d0dfd425ce94ee61f7231a5f779a71c: Status 404 returned error can't find the container with id 4273e5ae72d5577ab60ea776f4f249585d0dfd425ce94ee61f7231a5f779a71c
Jul 06 14:03:30.811511 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:30.811481    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f" event={"ID":"daab75f1-ba01-4cdc-98d8-16537c4a8886","Type":"ContainerStarted","Data":"4273e5ae72d5577ab60ea776f4f249585d0dfd425ce94ee61f7231a5f779a71c"}
Jul 06 14:03:31.818879 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:31.818841    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f" event={"ID":"daab75f1-ba01-4cdc-98d8-16537c4a8886","Type":"ContainerStarted","Data":"dd4a7675125a9f0020ab738b9abff8603086acec9c6ac28617cd047bab352f11"}
Jul 06 14:03:31.819309 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:31.818911    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:31.839671 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:31.839610    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f" podStartSLOduration=2.379736016 podStartE2EDuration="2.83959106s" totalImagesPullingTime="459.855044ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:03:31.837525449 +0000 UTC m=+1427.149089141" watchObservedRunningTime="2026-07-06 14:03:31.83959106 +0000 UTC m=+1427.151154727"
Jul 06 14:03:34.555686 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:34.555643    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"]
Jul 06 14:03:34.556175 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:34.555864    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq" podUID="89e7668a-b72b-4f05-8d90-77d41509843f" containerName="istio-proxy" containerID="cri-o://8747c25bb6dcb652b9a31e9a6822275613b1607c108f68c33e06aff8d84cc317" gracePeriod=30
Jul 06 14:03:34.732929 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:34.732890    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"]
Jul 06 14:03:34.733258 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:34.733204    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f" podUID="daab75f1-ba01-4cdc-98d8-16537c4a8886" containerName="maas-api" containerID="cri-o://dd4a7675125a9f0020ab738b9abff8603086acec9c6ac28617cd047bab352f11" gracePeriod=30
Jul 06 14:03:35.005459 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.005429    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:35.080750 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.080711    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daab75f1-ba01-4cdc-98d8-16537c4a8886-openshift-service-ca\") pod \"daab75f1-ba01-4cdc-98d8-16537c4a8886\" (UID: \"daab75f1-ba01-4cdc-98d8-16537c4a8886\") "
Jul 06 14:03:35.080945 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.080781    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54pwn\" (UniqueName: \"kubernetes.io/projected/daab75f1-ba01-4cdc-98d8-16537c4a8886-kube-api-access-54pwn\") pod \"daab75f1-ba01-4cdc-98d8-16537c4a8886\" (UID: \"daab75f1-ba01-4cdc-98d8-16537c4a8886\") "
Jul 06 14:03:35.080945 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.080811    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daab75f1-ba01-4cdc-98d8-16537c4a8886-maas-api-tls\") pod \"daab75f1-ba01-4cdc-98d8-16537c4a8886\" (UID: \"daab75f1-ba01-4cdc-98d8-16537c4a8886\") "
Jul 06 14:03:35.081168 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.081141    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daab75f1-ba01-4cdc-98d8-16537c4a8886-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "daab75f1-ba01-4cdc-98d8-16537c4a8886" (UID: "daab75f1-ba01-4cdc-98d8-16537c4a8886"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:03:35.083098 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.083066    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daab75f1-ba01-4cdc-98d8-16537c4a8886-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "daab75f1-ba01-4cdc-98d8-16537c4a8886" (UID: "daab75f1-ba01-4cdc-98d8-16537c4a8886"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:03:35.083098 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.083086    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daab75f1-ba01-4cdc-98d8-16537c4a8886-kube-api-access-54pwn" (OuterVolumeSpecName: "kube-api-access-54pwn") pod "daab75f1-ba01-4cdc-98d8-16537c4a8886" (UID: "daab75f1-ba01-4cdc-98d8-16537c4a8886"). InnerVolumeSpecName "kube-api-access-54pwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:03:35.182238 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.182141    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54pwn\" (UniqueName: \"kubernetes.io/projected/daab75f1-ba01-4cdc-98d8-16537c4a8886-kube-api-access-54pwn\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:35.182238 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.182176    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daab75f1-ba01-4cdc-98d8-16537c4a8886-maas-api-tls\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:35.182238 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.182187    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daab75f1-ba01-4cdc-98d8-16537c4a8886-openshift-service-ca\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:35.844183 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.844144    2573 generic.go:356] "Generic (PLEG): container finished" podID="daab75f1-ba01-4cdc-98d8-16537c4a8886" containerID="dd4a7675125a9f0020ab738b9abff8603086acec9c6ac28617cd047bab352f11" exitCode=0
Jul 06 14:03:35.844608 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.844189    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"
Jul 06 14:03:35.844608 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.844228    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f" event={"ID":"daab75f1-ba01-4cdc-98d8-16537c4a8886","Type":"ContainerDied","Data":"dd4a7675125a9f0020ab738b9abff8603086acec9c6ac28617cd047bab352f11"}
Jul 06 14:03:35.844608 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.844293    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f" event={"ID":"daab75f1-ba01-4cdc-98d8-16537c4a8886","Type":"ContainerDied","Data":"4273e5ae72d5577ab60ea776f4f249585d0dfd425ce94ee61f7231a5f779a71c"}
Jul 06 14:03:35.844608 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.844324    2573 scope.go:117] "RemoveContainer" containerID="dd4a7675125a9f0020ab738b9abff8603086acec9c6ac28617cd047bab352f11"
Jul 06 14:03:35.853862 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.853835    2573 scope.go:117] "RemoveContainer" containerID="dd4a7675125a9f0020ab738b9abff8603086acec9c6ac28617cd047bab352f11"
Jul 06 14:03:35.854230 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:03:35.854208    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd4a7675125a9f0020ab738b9abff8603086acec9c6ac28617cd047bab352f11\": container with ID starting with dd4a7675125a9f0020ab738b9abff8603086acec9c6ac28617cd047bab352f11 not found: ID does not exist" containerID="dd4a7675125a9f0020ab738b9abff8603086acec9c6ac28617cd047bab352f11"
Jul 06 14:03:35.854321 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.854241    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd4a7675125a9f0020ab738b9abff8603086acec9c6ac28617cd047bab352f11"} err="failed to get container status \"dd4a7675125a9f0020ab738b9abff8603086acec9c6ac28617cd047bab352f11\": rpc error: code = NotFound desc = could not find container \"dd4a7675125a9f0020ab738b9abff8603086acec9c6ac28617cd047bab352f11\": container with ID starting with dd4a7675125a9f0020ab738b9abff8603086acec9c6ac28617cd047bab352f11 not found: ID does not exist"
Jul 06 14:03:35.862931 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.862896    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"]
Jul 06 14:03:35.869341 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:35.869307    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-14c4c5d7-755998c7cd-dv54f"]
Jul 06 14:03:37.314636 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:37.314601    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daab75f1-ba01-4cdc-98d8-16537c4a8886" path="/var/lib/kubelet/pods/daab75f1-ba01-4cdc-98d8-16537c4a8886/volumes"
Jul 06 14:03:39.818045 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.818015    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:39.870483 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.870447    2573 generic.go:356] "Generic (PLEG): container finished" podID="89e7668a-b72b-4f05-8d90-77d41509843f" containerID="8747c25bb6dcb652b9a31e9a6822275613b1607c108f68c33e06aff8d84cc317" exitCode=0
Jul 06 14:03:39.870671 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.870501    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq" event={"ID":"89e7668a-b72b-4f05-8d90-77d41509843f","Type":"ContainerDied","Data":"8747c25bb6dcb652b9a31e9a6822275613b1607c108f68c33e06aff8d84cc317"}
Jul 06 14:03:39.870671 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.870509    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"
Jul 06 14:03:39.870671 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.870551    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq" event={"ID":"89e7668a-b72b-4f05-8d90-77d41509843f","Type":"ContainerDied","Data":"bb4b9a3070182e4748ebdbb48f8b112f0f22b5686b5fc4a0441659537ccca3dd"}
Jul 06 14:03:39.870671 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.870574    2573 scope.go:117] "RemoveContainer" containerID="8747c25bb6dcb652b9a31e9a6822275613b1607c108f68c33e06aff8d84cc317"
Jul 06 14:03:39.879936 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.879918    2573 scope.go:117] "RemoveContainer" containerID="8747c25bb6dcb652b9a31e9a6822275613b1607c108f68c33e06aff8d84cc317"
Jul 06 14:03:39.880286 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:03:39.880265    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8747c25bb6dcb652b9a31e9a6822275613b1607c108f68c33e06aff8d84cc317\": container with ID starting with 8747c25bb6dcb652b9a31e9a6822275613b1607c108f68c33e06aff8d84cc317 not found: ID does not exist" containerID="8747c25bb6dcb652b9a31e9a6822275613b1607c108f68c33e06aff8d84cc317"
Jul 06 14:03:39.880369 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.880301    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8747c25bb6dcb652b9a31e9a6822275613b1607c108f68c33e06aff8d84cc317"} err="failed to get container status \"8747c25bb6dcb652b9a31e9a6822275613b1607c108f68c33e06aff8d84cc317\": rpc error: code = NotFound desc = could not find container \"8747c25bb6dcb652b9a31e9a6822275613b1607c108f68c33e06aff8d84cc317\": container with ID starting with 8747c25bb6dcb652b9a31e9a6822275613b1607c108f68c33e06aff8d84cc317 not found: ID does not exist"
Jul 06 14:03:39.928745 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.928706    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-workload-socket\") pod \"89e7668a-b72b-4f05-8d90-77d41509843f\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") "
Jul 06 14:03:39.928914 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.928769    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-workload-certs\") pod \"89e7668a-b72b-4f05-8d90-77d41509843f\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") "
Jul 06 14:03:39.928914 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.928827    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-istio-envoy\") pod \"89e7668a-b72b-4f05-8d90-77d41509843f\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") "
Jul 06 14:03:39.928914 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.928853    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-credential-socket\") pod \"89e7668a-b72b-4f05-8d90-77d41509843f\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") "
Jul 06 14:03:39.928914 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.928879    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89e7668a-b72b-4f05-8d90-77d41509843f-istiod-ca-cert\") pod \"89e7668a-b72b-4f05-8d90-77d41509843f\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") "
Jul 06 14:03:39.929150 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.928956    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-istio-data\") pod \"89e7668a-b72b-4f05-8d90-77d41509843f\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") "
Jul 06 14:03:39.929150 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.928985    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89e7668a-b72b-4f05-8d90-77d41509843f-istio-podinfo\") pod \"89e7668a-b72b-4f05-8d90-77d41509843f\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") "
Jul 06 14:03:39.929150 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.929004    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "89e7668a-b72b-4f05-8d90-77d41509843f" (UID: "89e7668a-b72b-4f05-8d90-77d41509843f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:03:39.929150 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.929083    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "89e7668a-b72b-4f05-8d90-77d41509843f" (UID: "89e7668a-b72b-4f05-8d90-77d41509843f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:03:39.929362 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.929187    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "89e7668a-b72b-4f05-8d90-77d41509843f" (UID: "89e7668a-b72b-4f05-8d90-77d41509843f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:03:39.929362 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.929297    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-istio-data" (OuterVolumeSpecName: "istio-data") pod "89e7668a-b72b-4f05-8d90-77d41509843f" (UID: "89e7668a-b72b-4f05-8d90-77d41509843f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:03:39.929440 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.929360    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89e7668a-b72b-4f05-8d90-77d41509843f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "89e7668a-b72b-4f05-8d90-77d41509843f" (UID: "89e7668a-b72b-4f05-8d90-77d41509843f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:03:39.929440 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.929408    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82d6r\" (UniqueName: \"kubernetes.io/projected/89e7668a-b72b-4f05-8d90-77d41509843f-kube-api-access-82d6r\") pod \"89e7668a-b72b-4f05-8d90-77d41509843f\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") "
Jul 06 14:03:39.929589 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.929441    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89e7668a-b72b-4f05-8d90-77d41509843f-istio-token\") pod \"89e7668a-b72b-4f05-8d90-77d41509843f\" (UID: \"89e7668a-b72b-4f05-8d90-77d41509843f\") "
Jul 06 14:03:39.929735 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.929716    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-workload-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:39.929735 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.929735    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-workload-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:39.929826 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.929748    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-credential-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:39.929826 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.929761    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89e7668a-b72b-4f05-8d90-77d41509843f-istiod-ca-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:39.929826 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.929769    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-istio-data\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:39.931308 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.931282    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89e7668a-b72b-4f05-8d90-77d41509843f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "89e7668a-b72b-4f05-8d90-77d41509843f" (UID: "89e7668a-b72b-4f05-8d90-77d41509843f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:03:39.931431 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.931377    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89e7668a-b72b-4f05-8d90-77d41509843f-istio-token" (OuterVolumeSpecName: "istio-token") pod "89e7668a-b72b-4f05-8d90-77d41509843f" (UID: "89e7668a-b72b-4f05-8d90-77d41509843f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:03:39.931572 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.931558    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "89e7668a-b72b-4f05-8d90-77d41509843f" (UID: "89e7668a-b72b-4f05-8d90-77d41509843f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:03:39.931648 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:39.931632    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89e7668a-b72b-4f05-8d90-77d41509843f-kube-api-access-82d6r" (OuterVolumeSpecName: "kube-api-access-82d6r") pod "89e7668a-b72b-4f05-8d90-77d41509843f" (UID: "89e7668a-b72b-4f05-8d90-77d41509843f"). InnerVolumeSpecName "kube-api-access-82d6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:03:40.030315 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.030271    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89e7668a-b72b-4f05-8d90-77d41509843f-istio-envoy\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:40.030315 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.030306    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89e7668a-b72b-4f05-8d90-77d41509843f-istio-podinfo\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:40.030315 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.030316    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82d6r\" (UniqueName: \"kubernetes.io/projected/89e7668a-b72b-4f05-8d90-77d41509843f-kube-api-access-82d6r\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:40.030315 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.030327    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89e7668a-b72b-4f05-8d90-77d41509843f-istio-token\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:40.192892 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.192850    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"]
Jul 06 14:03:40.199189 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.199143    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-14c4c5d7-openshift-default-574bff67d5-c6twq"]
Jul 06 14:03:40.704710 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.704677    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"]
Jul 06 14:03:40.705333 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.705294    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daab75f1-ba01-4cdc-98d8-16537c4a8886" containerName="maas-api"
Jul 06 14:03:40.705333 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.705323    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="daab75f1-ba01-4cdc-98d8-16537c4a8886" containerName="maas-api"
Jul 06 14:03:40.705541 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.705361    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89e7668a-b72b-4f05-8d90-77d41509843f" containerName="istio-proxy"
Jul 06 14:03:40.705541 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.705369    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="89e7668a-b72b-4f05-8d90-77d41509843f" containerName="istio-proxy"
Jul 06 14:03:40.705541 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.705502    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="89e7668a-b72b-4f05-8d90-77d41509843f" containerName="istio-proxy"
Jul 06 14:03:40.705541 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.705520    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="daab75f1-ba01-4cdc-98d8-16537c4a8886" containerName="maas-api"
Jul 06 14:03:40.710260 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.710233    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.712994 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.712963    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-dacf7764-openshift-default-dockercfg-25ws6\""
Jul 06 14:03:40.726323 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.726292    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"]
Jul 06 14:03:40.737776 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.737739    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-workload-socket\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.737956 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.737809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-podinfo\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.737956 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.737853    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c940cf-1b33-455f-9d13-89048dd99c2f-istiod-ca-cert\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.737956 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.737913    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-credential-socket\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.738079 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.737992    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-data\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.738079 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.738033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-workload-certs\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.738164 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.738125    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-token\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.738164 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.738154    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsmcc\" (UniqueName: \"kubernetes.io/projected/e8c940cf-1b33-455f-9d13-89048dd99c2f-kube-api-access-zsmcc\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.738246 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.738218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-envoy\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.838692 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.838654    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-credential-socket\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.838692 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.838706    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-data\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.839261 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.838729    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-workload-certs\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.839261 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.838766    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-token\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.839261 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.838791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsmcc\" (UniqueName: \"kubernetes.io/projected/e8c940cf-1b33-455f-9d13-89048dd99c2f-kube-api-access-zsmcc\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.839261 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.838833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-envoy\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.839261 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.838862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-workload-socket\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.839261 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.838900    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-podinfo\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.839261 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.838932    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c940cf-1b33-455f-9d13-89048dd99c2f-istiod-ca-cert\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.839261 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.839141    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-data\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.839261 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.839141    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-credential-socket\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.839261 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.839187    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-workload-certs\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.839791 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.839328    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-workload-socket\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.839791 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.839645    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c940cf-1b33-455f-9d13-89048dd99c2f-istiod-ca-cert\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.841601 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.841573    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-envoy\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.841768 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.841628    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-podinfo\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.848539 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.848509    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-token\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:40.848739 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:40.848718    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsmcc\" (UniqueName: \"kubernetes.io/projected/e8c940cf-1b33-455f-9d13-89048dd99c2f-kube-api-access-zsmcc\") pod \"e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") " pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:41.021623 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:41.021520    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:41.177972 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:41.177940    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"]
Jul 06 14:03:41.180150 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:03:41.180113    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c940cf_1b33_455f_9d13_89048dd99c2f.slice/crio-74fece8a4021fd7f89b4bd5c8a2ca125e5a6112432b1a290903f5de339cd7792 WatchSource:0}: Error finding container 74fece8a4021fd7f89b4bd5c8a2ca125e5a6112432b1a290903f5de339cd7792: Status 404 returned error can't find the container with id 74fece8a4021fd7f89b4bd5c8a2ca125e5a6112432b1a290903f5de339cd7792
Jul 06 14:03:41.182555 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:41.182505    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:03:41.182643 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:41.182613    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:03:41.182682 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:41.182661    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:03:41.316907 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:41.316818    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89e7668a-b72b-4f05-8d90-77d41509843f" path="/var/lib/kubelet/pods/89e7668a-b72b-4f05-8d90-77d41509843f/volumes"
Jul 06 14:03:41.885333 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:41.885295    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb" event={"ID":"e8c940cf-1b33-455f-9d13-89048dd99c2f","Type":"ContainerStarted","Data":"307fe3f2d8e710618233ad9c6d7b21f0cdaf20b75ef0ff307092e303490c6631"}
Jul 06 14:03:41.885985 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:41.885350    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb" event={"ID":"e8c940cf-1b33-455f-9d13-89048dd99c2f","Type":"ContainerStarted","Data":"74fece8a4021fd7f89b4bd5c8a2ca125e5a6112432b1a290903f5de339cd7792"}
Jul 06 14:03:41.906342 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:41.906274    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb" podStartSLOduration=1.9062541990000001 podStartE2EDuration="1.906254199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:03:41.904033602 +0000 UTC m=+1437.215597303" watchObservedRunningTime="2026-07-06 14:03:41.906254199 +0000 UTC m=+1437.217817935"
Jul 06 14:03:42.021790 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.021753    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:42.027115 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.027088    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:42.079566 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.079529    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"]
Jul 06 14:03:42.083854 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.083822    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:42.087712 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.087682    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-dacf7764-serving-cert\""
Jul 06 14:03:42.112664 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.112629    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"]
Jul 06 14:03:42.152529 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.152433    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfqcr\" (UniqueName: \"kubernetes.io/projected/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-kube-api-access-lfqcr\") pod \"maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6\" (UID: \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\") " pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:42.152707 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.152552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-maas-api-tls\") pod \"maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6\" (UID: \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\") " pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:42.152707 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.152584    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-openshift-service-ca\") pod \"maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6\" (UID: \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\") " pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:42.253723 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.253679    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfqcr\" (UniqueName: \"kubernetes.io/projected/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-kube-api-access-lfqcr\") pod \"maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6\" (UID: \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\") " pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:42.253911 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.253756    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-maas-api-tls\") pod \"maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6\" (UID: \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\") " pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:42.253911 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.253774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-openshift-service-ca\") pod \"maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6\" (UID: \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\") " pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:42.254033 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:03:42.253915    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-dacf7764-serving-cert: secret "maas-api-e2e-ait-dacf7764-serving-cert" not found
Jul 06 14:03:42.254033 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:03:42.253987    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-maas-api-tls podName:7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8 nodeName:}" failed. No retries permitted until 2026-07-06 14:03:42.753967613 +0000 UTC m=+1438.065531269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-maas-api-tls") pod "maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6" (UID: "7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8") : secret "maas-api-e2e-ait-dacf7764-serving-cert" not found
Jul 06 14:03:42.254568 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.254548    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-openshift-service-ca\") pod \"maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6\" (UID: \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\") " pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:42.271067 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.271029    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfqcr\" (UniqueName: \"kubernetes.io/projected/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-kube-api-access-lfqcr\") pod \"maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6\" (UID: \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\") " pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:42.758023 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.757977    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-maas-api-tls\") pod \"maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6\" (UID: \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\") " pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:42.760505 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.760481    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-maas-api-tls\") pod \"maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6\" (UID: \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\") " pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:42.891105 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.891074    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:42.892147 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.892129    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:42.995488 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:42.995448    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:43.147278 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:43.147248    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"]
Jul 06 14:03:43.149385 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:03:43.149360    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1fb8e0_a425_4c67_ae8b_d2d523cffbe8.slice/crio-11a07444eba5869b7ede0e2c1439736629626915fd887bf8a138948dc872c215 WatchSource:0}: Error finding container 11a07444eba5869b7ede0e2c1439736629626915fd887bf8a138948dc872c215: Status 404 returned error can't find the container with id 11a07444eba5869b7ede0e2c1439736629626915fd887bf8a138948dc872c215
Jul 06 14:03:43.898386 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:43.898344    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6" event={"ID":"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8","Type":"ContainerStarted","Data":"d09a0b27d85b7899673b578cef5db107eb97dd273b345ea5f365d70872c580bf"}
Jul 06 14:03:43.898798 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:43.898423    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6" event={"ID":"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8","Type":"ContainerStarted","Data":"11a07444eba5869b7ede0e2c1439736629626915fd887bf8a138948dc872c215"}
Jul 06 14:03:43.898798 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:43.898579    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:43.915612 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:43.915563    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6" podStartSLOduration=1.580718959 podStartE2EDuration="1.91554636s" totalImagesPullingTime="334.827401ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:03:43.914749788 +0000 UTC m=+1439.226313477" watchObservedRunningTime="2026-07-06 14:03:43.91554636 +0000 UTC m=+1439.227110027"
Jul 06 14:03:47.587462 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.587410    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"]
Jul 06 14:03:47.587943 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.587748    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6" podUID="7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8" containerName="maas-api" containerID="cri-o://d09a0b27d85b7899673b578cef5db107eb97dd273b345ea5f365d70872c580bf" gracePeriod=30
Jul 06 14:03:47.849402 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.849330    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:47.909803 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.909767    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfqcr\" (UniqueName: \"kubernetes.io/projected/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-kube-api-access-lfqcr\") pod \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\" (UID: \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\") "
Jul 06 14:03:47.909986 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.909816    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-maas-api-tls\") pod \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\" (UID: \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\") "
Jul 06 14:03:47.909986 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.909866    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-openshift-service-ca\") pod \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\" (UID: \"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8\") "
Jul 06 14:03:47.910321 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.910290    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8" (UID: "7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:03:47.911995 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.911960    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8" (UID: "7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:03:47.911995 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.911978    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-kube-api-access-lfqcr" (OuterVolumeSpecName: "kube-api-access-lfqcr") pod "7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8" (UID: "7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8"). InnerVolumeSpecName "kube-api-access-lfqcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:03:47.922624 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.922594    2573 generic.go:356] "Generic (PLEG): container finished" podID="7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8" containerID="d09a0b27d85b7899673b578cef5db107eb97dd273b345ea5f365d70872c580bf" exitCode=0
Jul 06 14:03:47.922772 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.922637    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"
Jul 06 14:03:47.922772 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.922679    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6" event={"ID":"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8","Type":"ContainerDied","Data":"d09a0b27d85b7899673b578cef5db107eb97dd273b345ea5f365d70872c580bf"}
Jul 06 14:03:47.922772 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.922742    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6" event={"ID":"7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8","Type":"ContainerDied","Data":"11a07444eba5869b7ede0e2c1439736629626915fd887bf8a138948dc872c215"}
Jul 06 14:03:47.922772 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.922770    2573 scope.go:117] "RemoveContainer" containerID="d09a0b27d85b7899673b578cef5db107eb97dd273b345ea5f365d70872c580bf"
Jul 06 14:03:47.933517 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.933493    2573 scope.go:117] "RemoveContainer" containerID="d09a0b27d85b7899673b578cef5db107eb97dd273b345ea5f365d70872c580bf"
Jul 06 14:03:47.933829 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:03:47.933808    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d09a0b27d85b7899673b578cef5db107eb97dd273b345ea5f365d70872c580bf\": container with ID starting with d09a0b27d85b7899673b578cef5db107eb97dd273b345ea5f365d70872c580bf not found: ID does not exist" containerID="d09a0b27d85b7899673b578cef5db107eb97dd273b345ea5f365d70872c580bf"
Jul 06 14:03:47.933890 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.933840    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d09a0b27d85b7899673b578cef5db107eb97dd273b345ea5f365d70872c580bf"} err="failed to get container status \"d09a0b27d85b7899673b578cef5db107eb97dd273b345ea5f365d70872c580bf\": rpc error: code = NotFound desc = could not find container \"d09a0b27d85b7899673b578cef5db107eb97dd273b345ea5f365d70872c580bf\": container with ID starting with d09a0b27d85b7899673b578cef5db107eb97dd273b345ea5f365d70872c580bf not found: ID does not exist"
Jul 06 14:03:47.944590 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.944552    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"]
Jul 06 14:03:47.947981 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:47.947951    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-dacf7764-595c7dc7b5-b42b6"]
Jul 06 14:03:48.011808 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:48.011766    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-maas-api-tls\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:48.011808 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:48.011811    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-openshift-service-ca\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:48.012074 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:48.011827    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfqcr\" (UniqueName: \"kubernetes.io/projected/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8-kube-api-access-lfqcr\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:49.315709 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:49.315664    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8" path="/var/lib/kubelet/pods/7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8/volumes"
Jul 06 14:03:53.693499 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:53.693457    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"]
Jul 06 14:03:53.693969 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:53.693707    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb" podUID="e8c940cf-1b33-455f-9d13-89048dd99c2f" containerName="istio-proxy" containerID="cri-o://307fe3f2d8e710618233ad9c6d7b21f0cdaf20b75ef0ff307092e303490c6631" gracePeriod=30
Jul 06 14:03:57.893004 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:57.892967    2573 patch_prober.go:28] interesting pod/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 14:03:57.893449 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:57.893039    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb" podUID="e8c940cf-1b33-455f-9d13-89048dd99c2f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 14:03:58.956686 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:58.956618    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:58.985101 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:58.985071    2573 generic.go:356] "Generic (PLEG): container finished" podID="e8c940cf-1b33-455f-9d13-89048dd99c2f" containerID="307fe3f2d8e710618233ad9c6d7b21f0cdaf20b75ef0ff307092e303490c6631" exitCode=0
Jul 06 14:03:58.985342 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:58.985120    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"
Jul 06 14:03:58.985342 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:58.985122    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb" event={"ID":"e8c940cf-1b33-455f-9d13-89048dd99c2f","Type":"ContainerDied","Data":"307fe3f2d8e710618233ad9c6d7b21f0cdaf20b75ef0ff307092e303490c6631"}
Jul 06 14:03:58.985342 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:58.985247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb" event={"ID":"e8c940cf-1b33-455f-9d13-89048dd99c2f","Type":"ContainerDied","Data":"74fece8a4021fd7f89b4bd5c8a2ca125e5a6112432b1a290903f5de339cd7792"}
Jul 06 14:03:58.985342 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:58.985282    2573 scope.go:117] "RemoveContainer" containerID="307fe3f2d8e710618233ad9c6d7b21f0cdaf20b75ef0ff307092e303490c6631"
Jul 06 14:03:58.994670 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:58.994650    2573 scope.go:117] "RemoveContainer" containerID="307fe3f2d8e710618233ad9c6d7b21f0cdaf20b75ef0ff307092e303490c6631"
Jul 06 14:03:58.995011 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:03:58.994987    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"307fe3f2d8e710618233ad9c6d7b21f0cdaf20b75ef0ff307092e303490c6631\": container with ID starting with 307fe3f2d8e710618233ad9c6d7b21f0cdaf20b75ef0ff307092e303490c6631 not found: ID does not exist" containerID="307fe3f2d8e710618233ad9c6d7b21f0cdaf20b75ef0ff307092e303490c6631"
Jul 06 14:03:58.995077 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:58.995022    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"307fe3f2d8e710618233ad9c6d7b21f0cdaf20b75ef0ff307092e303490c6631"} err="failed to get container status \"307fe3f2d8e710618233ad9c6d7b21f0cdaf20b75ef0ff307092e303490c6631\": rpc error: code = NotFound desc = could not find container \"307fe3f2d8e710618233ad9c6d7b21f0cdaf20b75ef0ff307092e303490c6631\": container with ID starting with 307fe3f2d8e710618233ad9c6d7b21f0cdaf20b75ef0ff307092e303490c6631 not found: ID does not exist"
Jul 06 14:03:59.123960 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.123931    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c940cf-1b33-455f-9d13-89048dd99c2f-istiod-ca-cert\") pod \"e8c940cf-1b33-455f-9d13-89048dd99c2f\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") "
Jul 06 14:03:59.124172 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.123968    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-podinfo\") pod \"e8c940cf-1b33-455f-9d13-89048dd99c2f\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") "
Jul 06 14:03:59.124172 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.123999    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-workload-socket\") pod \"e8c940cf-1b33-455f-9d13-89048dd99c2f\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") "
Jul 06 14:03:59.124172 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124022    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-token\") pod \"e8c940cf-1b33-455f-9d13-89048dd99c2f\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") "
Jul 06 14:03:59.124172 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124102    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-data\") pod \"e8c940cf-1b33-455f-9d13-89048dd99c2f\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") "
Jul 06 14:03:59.124406 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124176    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-workload-certs\") pod \"e8c940cf-1b33-455f-9d13-89048dd99c2f\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") "
Jul 06 14:03:59.124406 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124243    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-credential-socket\") pod \"e8c940cf-1b33-455f-9d13-89048dd99c2f\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") "
Jul 06 14:03:59.124406 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124294    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-envoy\") pod \"e8c940cf-1b33-455f-9d13-89048dd99c2f\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") "
Jul 06 14:03:59.124406 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124322    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsmcc\" (UniqueName: \"kubernetes.io/projected/e8c940cf-1b33-455f-9d13-89048dd99c2f-kube-api-access-zsmcc\") pod \"e8c940cf-1b33-455f-9d13-89048dd99c2f\" (UID: \"e8c940cf-1b33-455f-9d13-89048dd99c2f\") "
Jul 06 14:03:59.124406 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124325    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e8c940cf-1b33-455f-9d13-89048dd99c2f" (UID: "e8c940cf-1b33-455f-9d13-89048dd99c2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:03:59.124648 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124484    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e8c940cf-1b33-455f-9d13-89048dd99c2f" (UID: "e8c940cf-1b33-455f-9d13-89048dd99c2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:03:59.124648 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124534    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8c940cf-1b33-455f-9d13-89048dd99c2f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e8c940cf-1b33-455f-9d13-89048dd99c2f" (UID: "e8c940cf-1b33-455f-9d13-89048dd99c2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:03:59.124648 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124620    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e8c940cf-1b33-455f-9d13-89048dd99c2f" (UID: "e8c940cf-1b33-455f-9d13-89048dd99c2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:03:59.124824 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124655    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-data" (OuterVolumeSpecName: "istio-data") pod "e8c940cf-1b33-455f-9d13-89048dd99c2f" (UID: "e8c940cf-1b33-455f-9d13-89048dd99c2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:03:59.124824 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124727    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-workload-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:59.124824 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124744    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-credential-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:59.124824 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124761    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c940cf-1b33-455f-9d13-89048dd99c2f-istiod-ca-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:59.124824 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124773    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-workload-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:59.124824 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.124786    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-data\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:59.126532 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.126498    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e8c940cf-1b33-455f-9d13-89048dd99c2f" (UID: "e8c940cf-1b33-455f-9d13-89048dd99c2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:03:59.126653 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.126565    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c940cf-1b33-455f-9d13-89048dd99c2f-kube-api-access-zsmcc" (OuterVolumeSpecName: "kube-api-access-zsmcc") pod "e8c940cf-1b33-455f-9d13-89048dd99c2f" (UID: "e8c940cf-1b33-455f-9d13-89048dd99c2f"). InnerVolumeSpecName "kube-api-access-zsmcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:03:59.126653 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.126631    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e8c940cf-1b33-455f-9d13-89048dd99c2f" (UID: "e8c940cf-1b33-455f-9d13-89048dd99c2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:03:59.126653 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.126637    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8c940cf-1b33-455f-9d13-89048dd99c2f" (UID: "e8c940cf-1b33-455f-9d13-89048dd99c2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:03:59.225519 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.225425    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-envoy\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:59.225519 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.225460    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsmcc\" (UniqueName: \"kubernetes.io/projected/e8c940cf-1b33-455f-9d13-89048dd99c2f-kube-api-access-zsmcc\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:59.225519 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.225470    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-podinfo\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:59.225519 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.225479    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c940cf-1b33-455f-9d13-89048dd99c2f-istio-token\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:03:59.319787 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.319750    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"]
Jul 06 14:03:59.329467 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:03:59.329437    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-dacf7764-openshift-default-85fb9dbcbc-hnwgb"]
Jul 06 14:04:00.582319 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.582282    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"]
Jul 06 14:04:00.582904 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.582884    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8c940cf-1b33-455f-9d13-89048dd99c2f" containerName="istio-proxy"
Jul 06 14:04:00.582986 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.582908    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8c940cf-1b33-455f-9d13-89048dd99c2f" containerName="istio-proxy"
Jul 06 14:04:00.582986 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.582942    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8" containerName="maas-api"
Jul 06 14:04:00.582986 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.582952    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8" containerName="maas-api"
Jul 06 14:04:00.583169 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.583091    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8c940cf-1b33-455f-9d13-89048dd99c2f" containerName="istio-proxy"
Jul 06 14:04:00.583169 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.583109    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f1fb8e0-a425-4c67-ae8b-d2d523cffbe8" containerName="maas-api"
Jul 06 14:04:00.586774 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.586750    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.591264 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.591238    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-3563d1f9-openshift-default-dockercfg-2tpnk\""
Jul 06 14:04:00.604461 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.604424    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"]
Jul 06 14:04:00.739993 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.739957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-envoy\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.740237 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.740004    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istiod-ca-cert\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.740237 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.740047    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-podinfo\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.740237 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.740128    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-data\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.740237 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.740173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-workload-socket\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.740439 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.740262    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-workload-certs\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.740439 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.740291    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-credential-socket\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.740439 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.740330    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncnh2\" (UniqueName: \"kubernetes.io/projected/12bba538-77f4-441b-a8a9-1b715e1f1a6d-kube-api-access-ncnh2\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.740439 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.740420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-token\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.841455 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.841359    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-token\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.841455 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.841441    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-envoy\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.841691 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.841469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istiod-ca-cert\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.841691 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.841504    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-podinfo\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.841691 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.841534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-data\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.841691 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.841565    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-workload-socket\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.841691 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.841614    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-workload-certs\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.841944 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.841747    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-credential-socket\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.841944 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.841806    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncnh2\" (UniqueName: \"kubernetes.io/projected/12bba538-77f4-441b-a8a9-1b715e1f1a6d-kube-api-access-ncnh2\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.842069 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.841968    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-workload-certs\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.842069 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.842011    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-workload-socket\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.842069 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.842022    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-data\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.842257 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.842101    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-credential-socket\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.842622 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.842599    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istiod-ca-cert\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.843859 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.843837    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-envoy\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.844294 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.844274    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-podinfo\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.850712 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.850682    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-token\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.851445 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.851422    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncnh2\" (UniqueName: \"kubernetes.io/projected/12bba538-77f4-441b-a8a9-1b715e1f1a6d-kube-api-access-ncnh2\") pod \"e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") " pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:00.898301 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:00.898256    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:01.080903 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:01.080874    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"]
Jul 06 14:04:01.086008 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:04:01.085968    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12bba538_77f4_441b_a8a9_1b715e1f1a6d.slice/crio-bfc4e48023e0e39d52542695eede068a4725a48a155a17cc38bf641298223258 WatchSource:0}: Error finding container bfc4e48023e0e39d52542695eede068a4725a48a155a17cc38bf641298223258: Status 404 returned error can't find the container with id bfc4e48023e0e39d52542695eede068a4725a48a155a17cc38bf641298223258
Jul 06 14:04:01.088444 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:01.088400    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:04:01.088538 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:01.088497    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:04:01.088574 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:01.088539    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:04:01.316979 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:01.316933    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8c940cf-1b33-455f-9d13-89048dd99c2f" path="/var/lib/kubelet/pods/e8c940cf-1b33-455f-9d13-89048dd99c2f/volumes"
Jul 06 14:04:01.872440 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:01.872400    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"]
Jul 06 14:04:01.877184 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:01.877149    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:01.879651 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:01.879625    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-3563d1f9-serving-cert\""
Jul 06 14:04:01.885264 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:01.885185    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"]
Jul 06 14:04:02.011706 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.011669    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf" event={"ID":"12bba538-77f4-441b-a8a9-1b715e1f1a6d","Type":"ContainerStarted","Data":"dbf224aa4fdac5013fd69592baa1918043f2a3e9f9e60d13b8b6471ccd2be004"}
Jul 06 14:04:02.011921 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.011719    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf" event={"ID":"12bba538-77f4-441b-a8a9-1b715e1f1a6d","Type":"ContainerStarted","Data":"bfc4e48023e0e39d52542695eede068a4725a48a155a17cc38bf641298223258"}
Jul 06 14:04:02.034600 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.034529    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf" podStartSLOduration=2.034506529 podStartE2EDuration="2.034506529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:04:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:04:02.031084481 +0000 UTC m=+1457.342648167" watchObservedRunningTime="2026-07-06 14:04:02.034506529 +0000 UTC m=+1457.346070198"
Jul 06 14:04:02.053181 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.053134    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98vpx\" (UniqueName: \"kubernetes.io/projected/70ddc311-db2c-4b38-8f37-42d3be97847f-kube-api-access-98vpx\") pod \"maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk\" (UID: \"70ddc311-db2c-4b38-8f37-42d3be97847f\") " pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:02.053369 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.053242    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70ddc311-db2c-4b38-8f37-42d3be97847f-maas-api-tls\") pod \"maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk\" (UID: \"70ddc311-db2c-4b38-8f37-42d3be97847f\") " pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:02.053369 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.053291    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70ddc311-db2c-4b38-8f37-42d3be97847f-openshift-service-ca\") pod \"maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk\" (UID: \"70ddc311-db2c-4b38-8f37-42d3be97847f\") " pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:02.154568 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.154459    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98vpx\" (UniqueName: \"kubernetes.io/projected/70ddc311-db2c-4b38-8f37-42d3be97847f-kube-api-access-98vpx\") pod \"maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk\" (UID: \"70ddc311-db2c-4b38-8f37-42d3be97847f\") " pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:02.154736 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.154583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70ddc311-db2c-4b38-8f37-42d3be97847f-maas-api-tls\") pod \"maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk\" (UID: \"70ddc311-db2c-4b38-8f37-42d3be97847f\") " pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:02.154736 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.154619    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70ddc311-db2c-4b38-8f37-42d3be97847f-openshift-service-ca\") pod \"maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk\" (UID: \"70ddc311-db2c-4b38-8f37-42d3be97847f\") " pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:02.155070 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:04:02.155013    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-3563d1f9-serving-cert: secret "maas-api-e2e-derive-3563d1f9-serving-cert" not found
Jul 06 14:04:02.155197 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:04:02.155158    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70ddc311-db2c-4b38-8f37-42d3be97847f-maas-api-tls podName:70ddc311-db2c-4b38-8f37-42d3be97847f nodeName:}" failed. No retries permitted until 2026-07-06 14:04:02.655136398 +0000 UTC m=+1457.966700072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/70ddc311-db2c-4b38-8f37-42d3be97847f-maas-api-tls") pod "maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk" (UID: "70ddc311-db2c-4b38-8f37-42d3be97847f") : secret "maas-api-e2e-derive-3563d1f9-serving-cert" not found
Jul 06 14:04:02.155661 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.155634    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70ddc311-db2c-4b38-8f37-42d3be97847f-openshift-service-ca\") pod \"maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk\" (UID: \"70ddc311-db2c-4b38-8f37-42d3be97847f\") " pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:02.163943 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.163904    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98vpx\" (UniqueName: \"kubernetes.io/projected/70ddc311-db2c-4b38-8f37-42d3be97847f-kube-api-access-98vpx\") pod \"maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk\" (UID: \"70ddc311-db2c-4b38-8f37-42d3be97847f\") " pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:02.660129 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.660041    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70ddc311-db2c-4b38-8f37-42d3be97847f-maas-api-tls\") pod \"maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk\" (UID: \"70ddc311-db2c-4b38-8f37-42d3be97847f\") " pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:02.662709 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.662686    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70ddc311-db2c-4b38-8f37-42d3be97847f-maas-api-tls\") pod \"maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk\" (UID: \"70ddc311-db2c-4b38-8f37-42d3be97847f\") " pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:02.794287 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.794249    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:02.899446 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.899411    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:02.905682 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.905649    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:02.950198 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:02.950169    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"]
Jul 06 14:04:02.951999 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:04:02.951976    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ddc311_db2c_4b38_8f37_42d3be97847f.slice/crio-f9974b1df981c312aea3696a35bf601d25d45e7f4062ff0e4c64856878e7fed2 WatchSource:0}: Error finding container f9974b1df981c312aea3696a35bf601d25d45e7f4062ff0e4c64856878e7fed2: Status 404 returned error can't find the container with id f9974b1df981c312aea3696a35bf601d25d45e7f4062ff0e4c64856878e7fed2
Jul 06 14:04:03.018284 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:03.018246    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk" event={"ID":"70ddc311-db2c-4b38-8f37-42d3be97847f","Type":"ContainerStarted","Data":"f9974b1df981c312aea3696a35bf601d25d45e7f4062ff0e4c64856878e7fed2"}
Jul 06 14:04:03.018493 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:03.018463    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:03.019475 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:03.019457    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:04.025462 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:04.025424    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk" event={"ID":"70ddc311-db2c-4b38-8f37-42d3be97847f","Type":"ContainerStarted","Data":"11e041201ecd4b4b6afc8c809c4bf2d675eb444e515cac4f270590bfe888ae6a"}
Jul 06 14:04:04.025892 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:04.025723    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:04.047930 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:04.047871    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk" podStartSLOduration=2.662748275 podStartE2EDuration="3.047824313s" totalImagesPullingTime="385.076038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:04:04.047160449 +0000 UTC m=+1459.358724118" watchObservedRunningTime="2026-07-06 14:04:04.047824313 +0000 UTC m=+1459.359388058"
Jul 06 14:04:06.528897 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:06.528852    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"]
Jul 06 14:04:06.529411 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:06.529102    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf" podUID="12bba538-77f4-441b-a8a9-1b715e1f1a6d" containerName="istio-proxy" containerID="cri-o://dbf224aa4fdac5013fd69592baa1918043f2a3e9f9e60d13b8b6471ccd2be004" gracePeriod=30
Jul 06 14:04:06.821786 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:06.821703    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"]
Jul 06 14:04:06.821944 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:06.821904    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk" podUID="70ddc311-db2c-4b38-8f37-42d3be97847f" containerName="maas-api" containerID="cri-o://11e041201ecd4b4b6afc8c809c4bf2d675eb444e515cac4f270590bfe888ae6a" gracePeriod=30
Jul 06 14:04:07.045276 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:07.045238    2573 generic.go:356] "Generic (PLEG): container finished" podID="70ddc311-db2c-4b38-8f37-42d3be97847f" containerID="11e041201ecd4b4b6afc8c809c4bf2d675eb444e515cac4f270590bfe888ae6a" exitCode=0
Jul 06 14:04:07.045464 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:07.045312    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk" event={"ID":"70ddc311-db2c-4b38-8f37-42d3be97847f","Type":"ContainerDied","Data":"11e041201ecd4b4b6afc8c809c4bf2d675eb444e515cac4f270590bfe888ae6a"}
Jul 06 14:04:07.080137 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:07.080029    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:07.108354 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:07.108326    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70ddc311-db2c-4b38-8f37-42d3be97847f-maas-api-tls\") pod \"70ddc311-db2c-4b38-8f37-42d3be97847f\" (UID: \"70ddc311-db2c-4b38-8f37-42d3be97847f\") "
Jul 06 14:04:07.108514 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:07.108406    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98vpx\" (UniqueName: \"kubernetes.io/projected/70ddc311-db2c-4b38-8f37-42d3be97847f-kube-api-access-98vpx\") pod \"70ddc311-db2c-4b38-8f37-42d3be97847f\" (UID: \"70ddc311-db2c-4b38-8f37-42d3be97847f\") "
Jul 06 14:04:07.108514 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:07.108475    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70ddc311-db2c-4b38-8f37-42d3be97847f-openshift-service-ca\") pod \"70ddc311-db2c-4b38-8f37-42d3be97847f\" (UID: \"70ddc311-db2c-4b38-8f37-42d3be97847f\") "
Jul 06 14:04:07.108858 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:07.108832    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70ddc311-db2c-4b38-8f37-42d3be97847f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "70ddc311-db2c-4b38-8f37-42d3be97847f" (UID: "70ddc311-db2c-4b38-8f37-42d3be97847f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:04:07.110516 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:07.110489    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70ddc311-db2c-4b38-8f37-42d3be97847f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "70ddc311-db2c-4b38-8f37-42d3be97847f" (UID: "70ddc311-db2c-4b38-8f37-42d3be97847f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:04:07.110608 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:07.110551    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70ddc311-db2c-4b38-8f37-42d3be97847f-kube-api-access-98vpx" (OuterVolumeSpecName: "kube-api-access-98vpx") pod "70ddc311-db2c-4b38-8f37-42d3be97847f" (UID: "70ddc311-db2c-4b38-8f37-42d3be97847f"). InnerVolumeSpecName "kube-api-access-98vpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:04:07.209802 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:07.209765    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98vpx\" (UniqueName: \"kubernetes.io/projected/70ddc311-db2c-4b38-8f37-42d3be97847f-kube-api-access-98vpx\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:04:07.209802 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:07.209795    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70ddc311-db2c-4b38-8f37-42d3be97847f-openshift-service-ca\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:04:07.209802 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:07.209805    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70ddc311-db2c-4b38-8f37-42d3be97847f-maas-api-tls\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:04:08.051605 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:08.051581    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"
Jul 06 14:04:08.052037 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:08.051627    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk" event={"ID":"70ddc311-db2c-4b38-8f37-42d3be97847f","Type":"ContainerDied","Data":"f9974b1df981c312aea3696a35bf601d25d45e7f4062ff0e4c64856878e7fed2"}
Jul 06 14:04:08.052037 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:08.051682    2573 scope.go:117] "RemoveContainer" containerID="11e041201ecd4b4b6afc8c809c4bf2d675eb444e515cac4f270590bfe888ae6a"
Jul 06 14:04:08.069683 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:08.069654    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"]
Jul 06 14:04:08.073248 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:08.073223    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-3563d1f9-6d554b7bdf-4l2lk"]
Jul 06 14:04:09.315232 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:09.315192    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70ddc311-db2c-4b38-8f37-42d3be97847f" path="/var/lib/kubelet/pods/70ddc311-db2c-4b38-8f37-42d3be97847f/volumes"
Jul 06 14:04:11.801951 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.801868    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:11.858373 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.858321    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istiod-ca-cert\") pod \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") "
Jul 06 14:04:11.858588 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.858412    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-data\") pod \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") "
Jul 06 14:04:11.858588 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.858452    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-credential-socket\") pod \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") "
Jul 06 14:04:11.858588 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.858480    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncnh2\" (UniqueName: \"kubernetes.io/projected/12bba538-77f4-441b-a8a9-1b715e1f1a6d-kube-api-access-ncnh2\") pod \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") "
Jul 06 14:04:11.858588 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.858535    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-envoy\") pod \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") "
Jul 06 14:04:11.858588 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.858576    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-workload-certs\") pod \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") "
Jul 06 14:04:11.858845 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.858618    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-token\") pod \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") "
Jul 06 14:04:11.858845 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.858655    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-podinfo\") pod \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") "
Jul 06 14:04:11.858845 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.858706    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-workload-socket\") pod \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\" (UID: \"12bba538-77f4-441b-a8a9-1b715e1f1a6d\") "
Jul 06 14:04:11.858845 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.858769    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12bba538-77f4-441b-a8a9-1b715e1f1a6d" (UID: "12bba538-77f4-441b-a8a9-1b715e1f1a6d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:04:11.858845 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.858803    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12bba538-77f4-441b-a8a9-1b715e1f1a6d" (UID: "12bba538-77f4-441b-a8a9-1b715e1f1a6d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:04:11.859141 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.858875    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12bba538-77f4-441b-a8a9-1b715e1f1a6d" (UID: "12bba538-77f4-441b-a8a9-1b715e1f1a6d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:04:11.859141 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.858969    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-data" (OuterVolumeSpecName: "istio-data") pod "12bba538-77f4-441b-a8a9-1b715e1f1a6d" (UID: "12bba538-77f4-441b-a8a9-1b715e1f1a6d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:04:11.859141 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.859022    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12bba538-77f4-441b-a8a9-1b715e1f1a6d" (UID: "12bba538-77f4-441b-a8a9-1b715e1f1a6d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:04:11.859282 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.859179    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-workload-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:04:11.859282 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.859197    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istiod-ca-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:04:11.859282 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.859211    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-data\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:04:11.859282 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.859225    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-credential-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:04:11.859282 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.859237    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-workload-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:04:11.860873 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.860846    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-token" (OuterVolumeSpecName: "istio-token") pod "12bba538-77f4-441b-a8a9-1b715e1f1a6d" (UID: "12bba538-77f4-441b-a8a9-1b715e1f1a6d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:04:11.860873 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.860861    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12bba538-77f4-441b-a8a9-1b715e1f1a6d-kube-api-access-ncnh2" (OuterVolumeSpecName: "kube-api-access-ncnh2") pod "12bba538-77f4-441b-a8a9-1b715e1f1a6d" (UID: "12bba538-77f4-441b-a8a9-1b715e1f1a6d"). InnerVolumeSpecName "kube-api-access-ncnh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:04:11.861100 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.861081    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12bba538-77f4-441b-a8a9-1b715e1f1a6d" (UID: "12bba538-77f4-441b-a8a9-1b715e1f1a6d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:04:11.861166 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.861077    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12bba538-77f4-441b-a8a9-1b715e1f1a6d" (UID: "12bba538-77f4-441b-a8a9-1b715e1f1a6d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:04:11.960297 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.960254    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncnh2\" (UniqueName: \"kubernetes.io/projected/12bba538-77f4-441b-a8a9-1b715e1f1a6d-kube-api-access-ncnh2\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:04:11.960297 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.960289    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-envoy\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:04:11.960297 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.960300    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-token\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:04:11.960297 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:11.960309    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12bba538-77f4-441b-a8a9-1b715e1f1a6d-istio-podinfo\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:04:12.077568 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:12.077468    2573 generic.go:356] "Generic (PLEG): container finished" podID="12bba538-77f4-441b-a8a9-1b715e1f1a6d" containerID="dbf224aa4fdac5013fd69592baa1918043f2a3e9f9e60d13b8b6471ccd2be004" exitCode=0
Jul 06 14:04:12.077568 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:12.077519    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"
Jul 06 14:04:12.077568 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:12.077542    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf" event={"ID":"12bba538-77f4-441b-a8a9-1b715e1f1a6d","Type":"ContainerDied","Data":"dbf224aa4fdac5013fd69592baa1918043f2a3e9f9e60d13b8b6471ccd2be004"}
Jul 06 14:04:12.077825 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:12.077596    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf" event={"ID":"12bba538-77f4-441b-a8a9-1b715e1f1a6d","Type":"ContainerDied","Data":"bfc4e48023e0e39d52542695eede068a4725a48a155a17cc38bf641298223258"}
Jul 06 14:04:12.077825 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:12.077628    2573 scope.go:117] "RemoveContainer" containerID="dbf224aa4fdac5013fd69592baa1918043f2a3e9f9e60d13b8b6471ccd2be004"
Jul 06 14:04:12.087335 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:12.087311    2573 scope.go:117] "RemoveContainer" containerID="dbf224aa4fdac5013fd69592baa1918043f2a3e9f9e60d13b8b6471ccd2be004"
Jul 06 14:04:12.087663 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:04:12.087642    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbf224aa4fdac5013fd69592baa1918043f2a3e9f9e60d13b8b6471ccd2be004\": container with ID starting with dbf224aa4fdac5013fd69592baa1918043f2a3e9f9e60d13b8b6471ccd2be004 not found: ID does not exist" containerID="dbf224aa4fdac5013fd69592baa1918043f2a3e9f9e60d13b8b6471ccd2be004"
Jul 06 14:04:12.087721 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:12.087676    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbf224aa4fdac5013fd69592baa1918043f2a3e9f9e60d13b8b6471ccd2be004"} err="failed to get container status \"dbf224aa4fdac5013fd69592baa1918043f2a3e9f9e60d13b8b6471ccd2be004\": rpc error: code = NotFound desc = could not find container \"dbf224aa4fdac5013fd69592baa1918043f2a3e9f9e60d13b8b6471ccd2be004\": container with ID starting with dbf224aa4fdac5013fd69592baa1918043f2a3e9f9e60d13b8b6471ccd2be004 not found: ID does not exist"
Jul 06 14:04:12.099316 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:12.099282    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"]
Jul 06 14:04:12.102993 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:12.102963    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-3563d1f9-openshift-default-75894fdc4c-szrwf"]
Jul 06 14:04:13.314161 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:13.314125    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12bba538-77f4-441b-a8a9-1b715e1f1a6d" path="/var/lib/kubelet/pods/12bba538-77f4-441b-a8a9-1b715e1f1a6d/volumes"
Jul 06 14:04:45.268646 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:45.268544    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 14:04:45.273548 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:04:45.273526    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 14:05:52.046203 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.046169    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"]
Jul 06 14:05:52.046643 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.046584    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70ddc311-db2c-4b38-8f37-42d3be97847f" containerName="maas-api"
Jul 06 14:05:52.046643 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.046595    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="70ddc311-db2c-4b38-8f37-42d3be97847f" containerName="maas-api"
Jul 06 14:05:52.046643 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.046607    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12bba538-77f4-441b-a8a9-1b715e1f1a6d" containerName="istio-proxy"
Jul 06 14:05:52.046643 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.046613    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="12bba538-77f4-441b-a8a9-1b715e1f1a6d" containerName="istio-proxy"
Jul 06 14:05:52.046822 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.046686    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="70ddc311-db2c-4b38-8f37-42d3be97847f" containerName="maas-api"
Jul 06 14:05:52.046822 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.046694    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="12bba538-77f4-441b-a8a9-1b715e1f1a6d" containerName="istio-proxy"
Jul 06 14:05:52.050003 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.049982    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.053269 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.053243    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0c6edcca-openshift-default-dockercfg-jb54f\""
Jul 06 14:05:52.076663 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.076627    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"]
Jul 06 14:05:52.109791 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.109750    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-token\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.110008 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.109807    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lwvh\" (UniqueName: \"kubernetes.io/projected/ddc41e0a-ef18-4728-936e-cb186ef422bd-kube-api-access-8lwvh\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.110008 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.109894    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-workload-certs\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.110008 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.109981    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-credential-socket\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.110191 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.110014    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-workload-socket\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.110191 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.110041    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-envoy\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.110191 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.110135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-data\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.110191 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.110180    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-podinfo\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.110318 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.110206    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc41e0a-ef18-4728-936e-cb186ef422bd-istiod-ca-cert\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.211297 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.211251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-credential-socket\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.211498 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.211310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-workload-socket\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.211498 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.211338    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-envoy\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.211498 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.211371    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-data\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.211498 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.211398    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-podinfo\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.211498 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.211432    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc41e0a-ef18-4728-936e-cb186ef422bd-istiod-ca-cert\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.211777 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.211605    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-token\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.211777 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.211669    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lwvh\" (UniqueName: \"kubernetes.io/projected/ddc41e0a-ef18-4728-936e-cb186ef422bd-kube-api-access-8lwvh\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.211777 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.211737    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-workload-certs\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.211777 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.211747    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-workload-socket\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.211777 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.211770    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-credential-socket\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.212112 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.212088    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-data\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.212194 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.212134    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-workload-certs\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.212194 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.212141    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc41e0a-ef18-4728-936e-cb186ef422bd-istiod-ca-cert\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.213725 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.213701    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-envoy\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.214082 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.214032    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-podinfo\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.220820 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.220793    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-token\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.220972 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.220929    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lwvh\" (UniqueName: \"kubernetes.io/projected/ddc41e0a-ef18-4728-936e-cb186ef422bd-kube-api-access-8lwvh\") pod \"e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") " pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.360928 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.360885    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:52.520873 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.520847    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"]
Jul 06 14:05:52.524582 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:05:52.524541    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc41e0a_ef18_4728_936e_cb186ef422bd.slice/crio-544c3ababdd9ffd199512e7264038a724974d555e40434aa30d6180b9509ccc7 WatchSource:0}: Error finding container 544c3ababdd9ffd199512e7264038a724974d555e40434aa30d6180b9509ccc7: Status 404 returned error can't find the container with id 544c3ababdd9ffd199512e7264038a724974d555e40434aa30d6180b9509ccc7
Jul 06 14:05:52.527195 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.527161    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:05:52.527300 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.527228    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:05:52.527300 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.527262    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:05:52.622160 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.622039    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq" event={"ID":"ddc41e0a-ef18-4728-936e-cb186ef422bd","Type":"ContainerStarted","Data":"f7201d5fb52dacf02fc1c6a399ff3f779d374b48643f13c189eebc6fde4d9d1b"}
Jul 06 14:05:52.622160 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.622127    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq" event={"ID":"ddc41e0a-ef18-4728-936e-cb186ef422bd","Type":"ContainerStarted","Data":"544c3ababdd9ffd199512e7264038a724974d555e40434aa30d6180b9509ccc7"}
Jul 06 14:05:52.644338 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:52.644272    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq" podStartSLOduration=0.644246278 podStartE2EDuration="644.246278ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:05:52.642384847 +0000 UTC m=+1567.953948539" watchObservedRunningTime="2026-07-06 14:05:52.644246278 +0000 UTC m=+1567.955809926"
Jul 06 14:05:53.361693 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:53.361655    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:53.366965 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:53.366936    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:53.627570 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:53.627483    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:53.628704 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:53.628680    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:05:55.287089 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:55.287033    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"]
Jul 06 14:05:55.291607 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:55.291573    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:05:55.294469 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:55.294442    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-0c6edcca-serving-cert\""
Jul 06 14:05:55.306547 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:55.306516    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"]
Jul 06 14:05:55.348513 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:55.348480    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88e07ee8-b0b4-4470-af69-0999386db909-openshift-service-ca\") pod \"maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k\" (UID: \"88e07ee8-b0b4-4470-af69-0999386db909\") " pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:05:55.348687 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:55.348569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88e07ee8-b0b4-4470-af69-0999386db909-maas-api-tls\") pod \"maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k\" (UID: \"88e07ee8-b0b4-4470-af69-0999386db909\") " pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:05:55.348687 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:55.348613    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lszsn\" (UniqueName: \"kubernetes.io/projected/88e07ee8-b0b4-4470-af69-0999386db909-kube-api-access-lszsn\") pod \"maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k\" (UID: \"88e07ee8-b0b4-4470-af69-0999386db909\") " pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:05:55.449949 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:55.449903    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88e07ee8-b0b4-4470-af69-0999386db909-maas-api-tls\") pod \"maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k\" (UID: \"88e07ee8-b0b4-4470-af69-0999386db909\") " pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:05:55.450187 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:55.449965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lszsn\" (UniqueName: \"kubernetes.io/projected/88e07ee8-b0b4-4470-af69-0999386db909-kube-api-access-lszsn\") pod \"maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k\" (UID: \"88e07ee8-b0b4-4470-af69-0999386db909\") " pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:05:55.450187 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:55.450007    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88e07ee8-b0b4-4470-af69-0999386db909-openshift-service-ca\") pod \"maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k\" (UID: \"88e07ee8-b0b4-4470-af69-0999386db909\") " pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:05:55.450187 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:05:55.450089    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-0c6edcca-serving-cert: secret "maas-api-e2e-mt-0c6edcca-serving-cert" not found
Jul 06 14:05:55.450187 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:05:55.450174    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e07ee8-b0b4-4470-af69-0999386db909-maas-api-tls podName:88e07ee8-b0b4-4470-af69-0999386db909 nodeName:}" failed. No retries permitted until 2026-07-06 14:05:55.950158244 +0000 UTC m=+1571.261721890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/88e07ee8-b0b4-4470-af69-0999386db909-maas-api-tls") pod "maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k" (UID: "88e07ee8-b0b4-4470-af69-0999386db909") : secret "maas-api-e2e-mt-0c6edcca-serving-cert" not found
Jul 06 14:05:55.450626 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:55.450607    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88e07ee8-b0b4-4470-af69-0999386db909-openshift-service-ca\") pod \"maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k\" (UID: \"88e07ee8-b0b4-4470-af69-0999386db909\") " pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:05:55.458931 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:55.458904    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lszsn\" (UniqueName: \"kubernetes.io/projected/88e07ee8-b0b4-4470-af69-0999386db909-kube-api-access-lszsn\") pod \"maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k\" (UID: \"88e07ee8-b0b4-4470-af69-0999386db909\") " pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:05:55.954230 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:55.954192    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88e07ee8-b0b4-4470-af69-0999386db909-maas-api-tls\") pod \"maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k\" (UID: \"88e07ee8-b0b4-4470-af69-0999386db909\") " pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:05:55.956701 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:55.956669    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88e07ee8-b0b4-4470-af69-0999386db909-maas-api-tls\") pod \"maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k\" (UID: \"88e07ee8-b0b4-4470-af69-0999386db909\") " pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:05:56.204616 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:56.204525    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:05:56.360711 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:56.360688    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"]
Jul 06 14:05:56.362971 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:05:56.362945    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e07ee8_b0b4_4470_af69_0999386db909.slice/crio-9b7e98570dafac9a665d48a95a42c4346b849e63609f6b815e83051f4df6018e WatchSource:0}: Error finding container 9b7e98570dafac9a665d48a95a42c4346b849e63609f6b815e83051f4df6018e: Status 404 returned error can't find the container with id 9b7e98570dafac9a665d48a95a42c4346b849e63609f6b815e83051f4df6018e
Jul 06 14:05:56.364793 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:56.364766    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:05:56.646018 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:56.645983    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k" event={"ID":"88e07ee8-b0b4-4470-af69-0999386db909","Type":"ContainerStarted","Data":"9b7e98570dafac9a665d48a95a42c4346b849e63609f6b815e83051f4df6018e"}
Jul 06 14:05:57.652960 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:57.652926    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k" event={"ID":"88e07ee8-b0b4-4470-af69-0999386db909","Type":"ContainerStarted","Data":"f5b08e5fac3c058d1407800f69d834a8ea46f10a4f3fae5b1d7252b8bd567d26"}
Jul 06 14:05:57.653414 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:57.653025    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:05:57.670654 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:05:57.670602    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k" podStartSLOduration=2.165698593 podStartE2EDuration="2.670583285s" totalImagesPullingTime="504.884692ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:05:57.670393505 +0000 UTC m=+1572.981957174" watchObservedRunningTime="2026-07-06 14:05:57.670583285 +0000 UTC m=+1572.982146954"
Jul 06 14:06:03.667700 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:03.667663    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:06:07.521919 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:07.521869    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"]
Jul 06 14:06:07.522422 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:07.522177    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k" podUID="88e07ee8-b0b4-4470-af69-0999386db909" containerName="maas-api" containerID="cri-o://f5b08e5fac3c058d1407800f69d834a8ea46f10a4f3fae5b1d7252b8bd567d26" gracePeriod=30
Jul 06 14:06:07.710717 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:07.710680    2573 generic.go:356] "Generic (PLEG): container finished" podID="88e07ee8-b0b4-4470-af69-0999386db909" containerID="f5b08e5fac3c058d1407800f69d834a8ea46f10a4f3fae5b1d7252b8bd567d26" exitCode=0
Jul 06 14:06:07.710873 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:07.710727    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k" event={"ID":"88e07ee8-b0b4-4470-af69-0999386db909","Type":"ContainerDied","Data":"f5b08e5fac3c058d1407800f69d834a8ea46f10a4f3fae5b1d7252b8bd567d26"}
Jul 06 14:06:07.790489 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:07.790369    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:06:07.876985 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:07.876953    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88e07ee8-b0b4-4470-af69-0999386db909-maas-api-tls\") pod \"88e07ee8-b0b4-4470-af69-0999386db909\" (UID: \"88e07ee8-b0b4-4470-af69-0999386db909\") "
Jul 06 14:06:07.878470 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:07.877088    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lszsn\" (UniqueName: \"kubernetes.io/projected/88e07ee8-b0b4-4470-af69-0999386db909-kube-api-access-lszsn\") pod \"88e07ee8-b0b4-4470-af69-0999386db909\" (UID: \"88e07ee8-b0b4-4470-af69-0999386db909\") "
Jul 06 14:06:07.878470 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:07.877145    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88e07ee8-b0b4-4470-af69-0999386db909-openshift-service-ca\") pod \"88e07ee8-b0b4-4470-af69-0999386db909\" (UID: \"88e07ee8-b0b4-4470-af69-0999386db909\") "
Jul 06 14:06:07.878470 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:07.877535    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88e07ee8-b0b4-4470-af69-0999386db909-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "88e07ee8-b0b4-4470-af69-0999386db909" (UID: "88e07ee8-b0b4-4470-af69-0999386db909"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:06:07.879711 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:07.879688    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88e07ee8-b0b4-4470-af69-0999386db909-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "88e07ee8-b0b4-4470-af69-0999386db909" (UID: "88e07ee8-b0b4-4470-af69-0999386db909"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:06:07.880114 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:07.880094    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88e07ee8-b0b4-4470-af69-0999386db909-kube-api-access-lszsn" (OuterVolumeSpecName: "kube-api-access-lszsn") pod "88e07ee8-b0b4-4470-af69-0999386db909" (UID: "88e07ee8-b0b4-4470-af69-0999386db909"). InnerVolumeSpecName "kube-api-access-lszsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:06:07.978963 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:07.978924    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lszsn\" (UniqueName: \"kubernetes.io/projected/88e07ee8-b0b4-4470-af69-0999386db909-kube-api-access-lszsn\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:06:07.978963 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:07.978959    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88e07ee8-b0b4-4470-af69-0999386db909-openshift-service-ca\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:06:07.978963 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:07.978971    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88e07ee8-b0b4-4470-af69-0999386db909-maas-api-tls\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:06:08.629880 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:08.629841    2573 patch_prober.go:28] interesting pod/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 06 14:06:08.630298 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:08.629897    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq" podUID="ddc41e0a-ef18-4728-936e-cb186ef422bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 06 14:06:08.718225 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:08.718199    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"
Jul 06 14:06:08.718225 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:08.718217    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k" event={"ID":"88e07ee8-b0b4-4470-af69-0999386db909","Type":"ContainerDied","Data":"9b7e98570dafac9a665d48a95a42c4346b849e63609f6b815e83051f4df6018e"}
Jul 06 14:06:08.718482 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:08.718272    2573 scope.go:117] "RemoveContainer" containerID="f5b08e5fac3c058d1407800f69d834a8ea46f10a4f3fae5b1d7252b8bd567d26"
Jul 06 14:06:08.720009 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:08.719985    2573 generic.go:356] "Generic (PLEG): container finished" podID="ddc41e0a-ef18-4728-936e-cb186ef422bd" containerID="f7201d5fb52dacf02fc1c6a399ff3f779d374b48643f13c189eebc6fde4d9d1b" exitCode=0
Jul 06 14:06:08.720134 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:08.720030    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq" event={"ID":"ddc41e0a-ef18-4728-936e-cb186ef422bd","Type":"ContainerDied","Data":"f7201d5fb52dacf02fc1c6a399ff3f779d374b48643f13c189eebc6fde4d9d1b"}
Jul 06 14:06:08.720493 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:08.720476    2573 scope.go:117] "RemoveContainer" containerID="f7201d5fb52dacf02fc1c6a399ff3f779d374b48643f13c189eebc6fde4d9d1b"
Jul 06 14:06:08.721562 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:08.721534    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:06:08.721668 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:08.721608    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:06:08.721668 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:08.721650    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:06:08.758937 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:08.758902    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"]
Jul 06 14:06:08.763725 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:08.763690    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-0c6edcca-6cfc64fc5f-d658k"]
Jul 06 14:06:09.322542 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:09.322502    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88e07ee8-b0b4-4470-af69-0999386db909" path="/var/lib/kubelet/pods/88e07ee8-b0b4-4470-af69-0999386db909/volumes"
Jul 06 14:06:09.733833 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:09.733801    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq" event={"ID":"ddc41e0a-ef18-4728-936e-cb186ef422bd","Type":"ContainerStarted","Data":"ba19c802845f7a1ca58fe5393719afa48baf21b48cb307936b64bb28c2f855e2"}
Jul 06 14:06:10.361742 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:10.361704    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:06:10.362154 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:10.362128    2573 patch_prober.go:28] interesting pod/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 06 14:06:10.362366 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:10.362338    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq" podUID="ddc41e0a-ef18-4728-936e-cb186ef422bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 06 14:06:11.361626 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:11.361580    2573 patch_prober.go:28] interesting pod/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 06 14:06:11.362307 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:11.362267    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq" podUID="ddc41e0a-ef18-4728-936e-cb186ef422bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 06 14:06:12.361736 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:12.361695    2573 patch_prober.go:28] interesting pod/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 06 14:06:12.362402 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:12.362368    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq" podUID="ddc41e0a-ef18-4728-936e-cb186ef422bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 06 14:06:13.361563 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:13.361516    2573 patch_prober.go:28] interesting pod/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 06 14:06:13.361795 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:13.361591    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq" podUID="ddc41e0a-ef18-4728-936e-cb186ef422bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 06 14:06:14.365675 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:14.365645    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:06:14.366116 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:14.365905    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:06:14.366773 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:14.366759    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:06:14.424234 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:14.424197    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"]
Jul 06 14:06:14.769098 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:14.768988    2573 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq" secret="" err="secret \"e2e-mt-0c6edcca-openshift-default-dockercfg-jb54f\" not found"
Jul 06 14:06:15.773827 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:15.773787    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq" podUID="ddc41e0a-ef18-4728-936e-cb186ef422bd" containerName="istio-proxy" containerID="cri-o://ba19c802845f7a1ca58fe5393719afa48baf21b48cb307936b64bb28c2f855e2" gracePeriod=30
Jul 06 14:06:21.038019 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.037946    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:06:21.107400 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.107363    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-data\") pod \"ddc41e0a-ef18-4728-936e-cb186ef422bd\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") "
Jul 06 14:06:21.107610 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.107413    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-token\") pod \"ddc41e0a-ef18-4728-936e-cb186ef422bd\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") "
Jul 06 14:06:21.107610 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.107462    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-envoy\") pod \"ddc41e0a-ef18-4728-936e-cb186ef422bd\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") "
Jul 06 14:06:21.107610 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.107499    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-credential-socket\") pod \"ddc41e0a-ef18-4728-936e-cb186ef422bd\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") "
Jul 06 14:06:21.107610 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.107527    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-workload-socket\") pod \"ddc41e0a-ef18-4728-936e-cb186ef422bd\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") "
Jul 06 14:06:21.107610 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.107564    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-workload-certs\") pod \"ddc41e0a-ef18-4728-936e-cb186ef422bd\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") "
Jul 06 14:06:21.107610 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.107602    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc41e0a-ef18-4728-936e-cb186ef422bd-istiod-ca-cert\") pod \"ddc41e0a-ef18-4728-936e-cb186ef422bd\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") "
Jul 06 14:06:21.108202 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.107668    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-podinfo\") pod \"ddc41e0a-ef18-4728-936e-cb186ef422bd\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") "
Jul 06 14:06:21.108202 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.107700    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lwvh\" (UniqueName: \"kubernetes.io/projected/ddc41e0a-ef18-4728-936e-cb186ef422bd-kube-api-access-8lwvh\") pod \"ddc41e0a-ef18-4728-936e-cb186ef422bd\" (UID: \"ddc41e0a-ef18-4728-936e-cb186ef422bd\") "
Jul 06 14:06:21.108202 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.107875    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ddc41e0a-ef18-4728-936e-cb186ef422bd" (UID: "ddc41e0a-ef18-4728-936e-cb186ef422bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:06:21.108202 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.107994    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc41e0a-ef18-4728-936e-cb186ef422bd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ddc41e0a-ef18-4728-936e-cb186ef422bd" (UID: "ddc41e0a-ef18-4728-936e-cb186ef422bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:06:21.108202 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.108003    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ddc41e0a-ef18-4728-936e-cb186ef422bd" (UID: "ddc41e0a-ef18-4728-936e-cb186ef422bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:06:21.108202 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.108091    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ddc41e0a-ef18-4728-936e-cb186ef422bd" (UID: "ddc41e0a-ef18-4728-936e-cb186ef422bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:06:21.108202 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.108120    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-workload-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:06:21.108202 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.108141    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-workload-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:06:21.108202 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.108155    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc41e0a-ef18-4728-936e-cb186ef422bd-istiod-ca-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:06:21.108577 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.108306    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-data" (OuterVolumeSpecName: "istio-data") pod "ddc41e0a-ef18-4728-936e-cb186ef422bd" (UID: "ddc41e0a-ef18-4728-936e-cb186ef422bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:06:21.109720 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.109695    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-token" (OuterVolumeSpecName: "istio-token") pod "ddc41e0a-ef18-4728-936e-cb186ef422bd" (UID: "ddc41e0a-ef18-4728-936e-cb186ef422bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:06:21.109833 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.109767    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc41e0a-ef18-4728-936e-cb186ef422bd-kube-api-access-8lwvh" (OuterVolumeSpecName: "kube-api-access-8lwvh") pod "ddc41e0a-ef18-4728-936e-cb186ef422bd" (UID: "ddc41e0a-ef18-4728-936e-cb186ef422bd"). InnerVolumeSpecName "kube-api-access-8lwvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:06:21.110100 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.110083    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ddc41e0a-ef18-4728-936e-cb186ef422bd" (UID: "ddc41e0a-ef18-4728-936e-cb186ef422bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:06:21.110275 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.110256    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ddc41e0a-ef18-4728-936e-cb186ef422bd" (UID: "ddc41e0a-ef18-4728-936e-cb186ef422bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:06:21.208971 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.208928    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-envoy\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:06:21.208971 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.208965    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-credential-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:06:21.208971 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.208975    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-podinfo\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:06:21.208971 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.208983    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lwvh\" (UniqueName: \"kubernetes.io/projected/ddc41e0a-ef18-4728-936e-cb186ef422bd-kube-api-access-8lwvh\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:06:21.209270 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.208992    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-data\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:06:21.209270 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.209001    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc41e0a-ef18-4728-936e-cb186ef422bd-istio-token\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:06:21.806383 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.806344    2573 generic.go:356] "Generic (PLEG): container finished" podID="ddc41e0a-ef18-4728-936e-cb186ef422bd" containerID="ba19c802845f7a1ca58fe5393719afa48baf21b48cb307936b64bb28c2f855e2" exitCode=0
Jul 06 14:06:21.806594 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.806408    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"
Jul 06 14:06:21.806594 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.806428    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq" event={"ID":"ddc41e0a-ef18-4728-936e-cb186ef422bd","Type":"ContainerDied","Data":"ba19c802845f7a1ca58fe5393719afa48baf21b48cb307936b64bb28c2f855e2"}
Jul 06 14:06:21.806594 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.806523    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq" event={"ID":"ddc41e0a-ef18-4728-936e-cb186ef422bd","Type":"ContainerDied","Data":"544c3ababdd9ffd199512e7264038a724974d555e40434aa30d6180b9509ccc7"}
Jul 06 14:06:21.806594 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.806557    2573 scope.go:117] "RemoveContainer" containerID="ba19c802845f7a1ca58fe5393719afa48baf21b48cb307936b64bb28c2f855e2"
Jul 06 14:06:21.815951 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.815932    2573 scope.go:117] "RemoveContainer" containerID="f7201d5fb52dacf02fc1c6a399ff3f779d374b48643f13c189eebc6fde4d9d1b"
Jul 06 14:06:21.824870 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.824833    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"]
Jul 06 14:06:21.824940 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.824900    2573 scope.go:117] "RemoveContainer" containerID="ba19c802845f7a1ca58fe5393719afa48baf21b48cb307936b64bb28c2f855e2"
Jul 06 14:06:21.825395 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:06:21.825369    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba19c802845f7a1ca58fe5393719afa48baf21b48cb307936b64bb28c2f855e2\": container with ID starting with ba19c802845f7a1ca58fe5393719afa48baf21b48cb307936b64bb28c2f855e2 not found: ID does not exist" containerID="ba19c802845f7a1ca58fe5393719afa48baf21b48cb307936b64bb28c2f855e2"
Jul 06 14:06:21.825568 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.825541    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba19c802845f7a1ca58fe5393719afa48baf21b48cb307936b64bb28c2f855e2"} err="failed to get container status \"ba19c802845f7a1ca58fe5393719afa48baf21b48cb307936b64bb28c2f855e2\": rpc error: code = NotFound desc = could not find container \"ba19c802845f7a1ca58fe5393719afa48baf21b48cb307936b64bb28c2f855e2\": container with ID starting with ba19c802845f7a1ca58fe5393719afa48baf21b48cb307936b64bb28c2f855e2 not found: ID does not exist"
Jul 06 14:06:21.825689 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.825657    2573 scope.go:117] "RemoveContainer" containerID="f7201d5fb52dacf02fc1c6a399ff3f779d374b48643f13c189eebc6fde4d9d1b"
Jul 06 14:06:21.826039 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:06:21.826014    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7201d5fb52dacf02fc1c6a399ff3f779d374b48643f13c189eebc6fde4d9d1b\": container with ID starting with f7201d5fb52dacf02fc1c6a399ff3f779d374b48643f13c189eebc6fde4d9d1b not found: ID does not exist" containerID="f7201d5fb52dacf02fc1c6a399ff3f779d374b48643f13c189eebc6fde4d9d1b"
Jul 06 14:06:21.826150 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.826043    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7201d5fb52dacf02fc1c6a399ff3f779d374b48643f13c189eebc6fde4d9d1b"} err="failed to get container status \"f7201d5fb52dacf02fc1c6a399ff3f779d374b48643f13c189eebc6fde4d9d1b\": rpc error: code = NotFound desc = could not find container \"f7201d5fb52dacf02fc1c6a399ff3f779d374b48643f13c189eebc6fde4d9d1b\": container with ID starting with f7201d5fb52dacf02fc1c6a399ff3f779d374b48643f13c189eebc6fde4d9d1b not found: ID does not exist"
Jul 06 14:06:21.828082 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:21.828044    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0c6edcca-openshift-default-6b59bb6c67-264xq"]
Jul 06 14:06:23.314392 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:23.314357    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddc41e0a-ef18-4728-936e-cb186ef422bd" path="/var/lib/kubelet/pods/ddc41e0a-ef18-4728-936e-cb186ef422bd/volumes"
Jul 06 14:06:37.497822 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.497738    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"]
Jul 06 14:06:37.498561 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.498535    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e07ee8-b0b4-4470-af69-0999386db909" containerName="maas-api"
Jul 06 14:06:37.498561 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.498561    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e07ee8-b0b4-4470-af69-0999386db909" containerName="maas-api"
Jul 06 14:06:37.498693 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.498587    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc41e0a-ef18-4728-936e-cb186ef422bd" containerName="istio-proxy"
Jul 06 14:06:37.498693 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.498593    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc41e0a-ef18-4728-936e-cb186ef422bd" containerName="istio-proxy"
Jul 06 14:06:37.498693 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.498605    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc41e0a-ef18-4728-936e-cb186ef422bd" containerName="istio-proxy"
Jul 06 14:06:37.498693 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.498612    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc41e0a-ef18-4728-936e-cb186ef422bd" containerName="istio-proxy"
Jul 06 14:06:37.498693 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.498690    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc41e0a-ef18-4728-936e-cb186ef422bd" containerName="istio-proxy"
Jul 06 14:06:37.498858 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.498700    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc41e0a-ef18-4728-936e-cb186ef422bd" containerName="istio-proxy"
Jul 06 14:06:37.498858 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.498707    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="88e07ee8-b0b4-4470-af69-0999386db909" containerName="maas-api"
Jul 06 14:06:37.501781 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.501759    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.504345 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.504322    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b7b9827b-openshift-default-dockercfg-67rtc\""
Jul 06 14:06:37.512399 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.512373    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"]
Jul 06 14:06:37.563843 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.563807    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-workload-socket\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.564045 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.563860    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-data\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.564045 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.563917    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-envoy\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.564045 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.563961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s688m\" (UniqueName: \"kubernetes.io/projected/48e410f5-fca7-4881-b4e6-2f0111245bd3-kube-api-access-s688m\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.564045 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.563980    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48e410f5-fca7-4881-b4e6-2f0111245bd3-istiod-ca-cert\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.564045 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.563995    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-credential-socket\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.564045 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.564022    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-podinfo\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.564319 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.564120    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-token\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.564319 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.564139    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-workload-certs\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.665230 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.665190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-data\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.665457 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.665258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-envoy\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.665457 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.665303    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s688m\" (UniqueName: \"kubernetes.io/projected/48e410f5-fca7-4881-b4e6-2f0111245bd3-kube-api-access-s688m\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.665457 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.665327    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48e410f5-fca7-4881-b4e6-2f0111245bd3-istiod-ca-cert\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.665457 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.665351    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-credential-socket\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.665457 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.665378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-podinfo\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.665457 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.665438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-token\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.665771 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.665463    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-workload-certs\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.665771 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.665505    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-workload-socket\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.665771 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.665687    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-data\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.665934 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.665893    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-workload-socket\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.665974 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.665936    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-credential-socket\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.666010 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.665988    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-workload-certs\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.666084 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.666042    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48e410f5-fca7-4881-b4e6-2f0111245bd3-istiod-ca-cert\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.667619 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.667594    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-envoy\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.668303 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.668282    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-podinfo\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.673838 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.673812    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-token\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.674032 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.674008    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s688m\" (UniqueName: \"kubernetes.io/projected/48e410f5-fca7-4881-b4e6-2f0111245bd3-kube-api-access-s688m\") pod \"e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") " pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.813649 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.813542    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:37.971364 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.971335    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"]
Jul 06 14:06:37.973457 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:06:37.973425    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e410f5_fca7_4881_b4e6_2f0111245bd3.slice/crio-c894e3906471f6f11ddf87bdfe04103427fafe232eb51ce624ec7addc33fe705 WatchSource:0}: Error finding container c894e3906471f6f11ddf87bdfe04103427fafe232eb51ce624ec7addc33fe705: Status 404 returned error can't find the container with id c894e3906471f6f11ddf87bdfe04103427fafe232eb51ce624ec7addc33fe705
Jul 06 14:06:37.976258 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.976212    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:06:37.976360 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.976304    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:06:37.976360 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:37.976333    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:06:38.900301 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:38.900265    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb" event={"ID":"48e410f5-fca7-4881-b4e6-2f0111245bd3","Type":"ContainerStarted","Data":"77ed1696cbd9faaa7cf863abbdecf8346ab8bf8cf08c3cb53a5afa41fc3e2101"}
Jul 06 14:06:38.900716 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:38.900327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb" event={"ID":"48e410f5-fca7-4881-b4e6-2f0111245bd3","Type":"ContainerStarted","Data":"c894e3906471f6f11ddf87bdfe04103427fafe232eb51ce624ec7addc33fe705"}
Jul 06 14:06:38.920490 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:38.920435    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb" podStartSLOduration=1.9204174379999999 podStartE2EDuration="1.920417438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:06:38.919697057 +0000 UTC m=+1614.231260726" watchObservedRunningTime="2026-07-06 14:06:38.920417438 +0000 UTC m=+1614.231981106"
Jul 06 14:06:39.814677 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:39.814638    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:39.819848 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:39.819821    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:39.906010 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:39.905980    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:39.907101 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:39.907079    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:41.012446 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.012408    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"]
Jul 06 14:06:41.015540 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.015516    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:06:41.018500 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.018472    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-b7b9827b-serving-cert\""
Jul 06 14:06:41.025773 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.025747    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"]
Jul 06 14:06:41.098840 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.098808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7678f23d-995d-4db5-ad0a-a644cd41d9b8-maas-api-tls\") pod \"maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg\" (UID: \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\") " pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:06:41.099078 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.098867    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7678f23d-995d-4db5-ad0a-a644cd41d9b8-openshift-service-ca\") pod \"maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg\" (UID: \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\") " pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:06:41.099078 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.098939    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9hns\" (UniqueName: \"kubernetes.io/projected/7678f23d-995d-4db5-ad0a-a644cd41d9b8-kube-api-access-d9hns\") pod \"maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg\" (UID: \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\") " pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:06:41.200356 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.200307    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9hns\" (UniqueName: \"kubernetes.io/projected/7678f23d-995d-4db5-ad0a-a644cd41d9b8-kube-api-access-d9hns\") pod \"maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg\" (UID: \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\") " pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:06:41.200576 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.200417    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7678f23d-995d-4db5-ad0a-a644cd41d9b8-maas-api-tls\") pod \"maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg\" (UID: \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\") " pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:06:41.200576 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.200480    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7678f23d-995d-4db5-ad0a-a644cd41d9b8-openshift-service-ca\") pod \"maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg\" (UID: \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\") " pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:06:41.200693 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:06:41.200584    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-b7b9827b-serving-cert: secret "maas-api-e2e-mt-b7b9827b-serving-cert" not found
Jul 06 14:06:41.200693 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:06:41.200658    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7678f23d-995d-4db5-ad0a-a644cd41d9b8-maas-api-tls podName:7678f23d-995d-4db5-ad0a-a644cd41d9b8 nodeName:}" failed. No retries permitted until 2026-07-06 14:06:41.700639126 +0000 UTC m=+1617.012202775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7678f23d-995d-4db5-ad0a-a644cd41d9b8-maas-api-tls") pod "maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg" (UID: "7678f23d-995d-4db5-ad0a-a644cd41d9b8") : secret "maas-api-e2e-mt-b7b9827b-serving-cert" not found
Jul 06 14:06:41.201164 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.201142    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7678f23d-995d-4db5-ad0a-a644cd41d9b8-openshift-service-ca\") pod \"maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg\" (UID: \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\") " pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:06:41.218962 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.218929    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9hns\" (UniqueName: \"kubernetes.io/projected/7678f23d-995d-4db5-ad0a-a644cd41d9b8-kube-api-access-d9hns\") pod \"maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg\" (UID: \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\") " pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:06:41.706014 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.705971    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7678f23d-995d-4db5-ad0a-a644cd41d9b8-maas-api-tls\") pod \"maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg\" (UID: \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\") " pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:06:41.708566 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.708536    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7678f23d-995d-4db5-ad0a-a644cd41d9b8-maas-api-tls\") pod \"maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg\" (UID: \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\") " pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:06:41.930997 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:41.930946    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:06:42.087388 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:42.087356    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"]
Jul 06 14:06:42.088999 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:06:42.088972    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7678f23d_995d_4db5_ad0a_a644cd41d9b8.slice/crio-764c45414def58d4f15ac22de5e01f535cf463f51e36d46de68d23519f15b900 WatchSource:0}: Error finding container 764c45414def58d4f15ac22de5e01f535cf463f51e36d46de68d23519f15b900: Status 404 returned error can't find the container with id 764c45414def58d4f15ac22de5e01f535cf463f51e36d46de68d23519f15b900
Jul 06 14:06:42.931163 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:42.931124    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg" event={"ID":"7678f23d-995d-4db5-ad0a-a644cd41d9b8","Type":"ContainerStarted","Data":"40749ade9693c17a6e250b07cbae195c08efaef2d89a10b6d618d13f6394f577"}
Jul 06 14:06:42.931364 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:42.931185    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg" event={"ID":"7678f23d-995d-4db5-ad0a-a644cd41d9b8","Type":"ContainerStarted","Data":"764c45414def58d4f15ac22de5e01f535cf463f51e36d46de68d23519f15b900"}
Jul 06 14:06:42.931364 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:42.931284    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:06:42.952330 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:42.952260    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg" podStartSLOduration=2.692372628 podStartE2EDuration="2.952223539s" totalImagesPullingTime="259.850911ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:06:42.951827134 +0000 UTC m=+1618.263390803" watchObservedRunningTime="2026-07-06 14:06:42.952223539 +0000 UTC m=+1618.263787208"
Jul 06 14:06:48.951425 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:48.951383    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:06:50.701630 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.701587    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"]
Jul 06 14:06:50.705654 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.705623    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.709573 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.709545    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b7b9827b\"/\"kube-root-ca.crt\""
Jul 06 14:06:50.709996 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.709545    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b7b9827b\"/\"default-dockercfg-hgsp7\""
Jul 06 14:06:50.710158 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.709545    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b7b9827b\"/\"e2e-lifecycle-model-b7b9827b-kserve-self-signed-certs\""
Jul 06 14:06:50.710158 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.710132    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b7b9827b\"/\"openshift-service-ca.crt\""
Jul 06 14:06:50.710655 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.710631    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e42c0907-4b31-439c-aea7-da4e5f72ed2f-tls-certs\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.711095 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.710671    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-dshm\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.711095 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.710701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-model-cache\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.711095 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.710898    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-home\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.711095 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.710976    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdpt5\" (UniqueName: \"kubernetes.io/projected/e42c0907-4b31-439c-aea7-da4e5f72ed2f-kube-api-access-wdpt5\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.711271 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.711105    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-tmp-dir\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.720229 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.720195    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"]
Jul 06 14:06:50.811611 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.811564    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdpt5\" (UniqueName: \"kubernetes.io/projected/e42c0907-4b31-439c-aea7-da4e5f72ed2f-kube-api-access-wdpt5\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.811818 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.811638    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-tmp-dir\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.811818 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.811668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e42c0907-4b31-439c-aea7-da4e5f72ed2f-tls-certs\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.811818 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.811684    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-dshm\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.811818 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.811700    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-model-cache\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.811818 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.811741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-home\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.812280 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.812254    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-home\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.812384 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.812295    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-model-cache\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.812450 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.812413    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-tmp-dir\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.814289 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.814255    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-dshm\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.814498 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.814477    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e42c0907-4b31-439c-aea7-da4e5f72ed2f-tls-certs\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:50.822129 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:50.822089    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdpt5\" (UniqueName: \"kubernetes.io/projected/e42c0907-4b31-439c-aea7-da4e5f72ed2f-kube-api-access-wdpt5\") pod \"e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") " pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:51.020319 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:51.020211    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:06:51.178515 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:51.178486    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"]
Jul 06 14:06:51.180660 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:06:51.180633    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode42c0907_4b31_439c_aea7_da4e5f72ed2f.slice/crio-acc355bd126c727695f05bffb0067ef1e53a89ee3bb3c77219f14eccc6aa05f3 WatchSource:0}: Error finding container acc355bd126c727695f05bffb0067ef1e53a89ee3bb3c77219f14eccc6aa05f3: Status 404 returned error can't find the container with id acc355bd126c727695f05bffb0067ef1e53a89ee3bb3c77219f14eccc6aa05f3
Jul 06 14:06:52.005137 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:52.005089    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx" event={"ID":"e42c0907-4b31-439c-aea7-da4e5f72ed2f","Type":"ContainerStarted","Data":"fde4f7e6172e0c2c7d2f2eb982de91a153e494f23227e4fff11e727624862157"}
Jul 06 14:06:52.005537 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:52.005149    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx" event={"ID":"e42c0907-4b31-439c-aea7-da4e5f72ed2f","Type":"ContainerStarted","Data":"acc355bd126c727695f05bffb0067ef1e53a89ee3bb3c77219f14eccc6aa05f3"}
Jul 06 14:06:52.026271 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:52.026209    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx" podStartSLOduration=2.026186827 podStartE2EDuration="2.026186827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:06:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:06:52.023618663 +0000 UTC m=+1627.335182328" watchObservedRunningTime="2026-07-06 14:06:52.026186827 +0000 UTC m=+1627.337750496"
Jul 06 14:06:53.012854 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:53.012819    2573 generic.go:356] "Generic (PLEG): container finished" podID="48e410f5-fca7-4881-b4e6-2f0111245bd3" containerID="77ed1696cbd9faaa7cf863abbdecf8346ab8bf8cf08c3cb53a5afa41fc3e2101" exitCode=0
Jul 06 14:06:53.013323 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:53.012893    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb" event={"ID":"48e410f5-fca7-4881-b4e6-2f0111245bd3","Type":"ContainerDied","Data":"77ed1696cbd9faaa7cf863abbdecf8346ab8bf8cf08c3cb53a5afa41fc3e2101"}
Jul 06 14:06:53.013401 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:53.013383    2573 scope.go:117] "RemoveContainer" containerID="77ed1696cbd9faaa7cf863abbdecf8346ab8bf8cf08c3cb53a5afa41fc3e2101"
Jul 06 14:06:53.014397 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:53.014364    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:06:53.014519 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:53.014438    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:06:53.014519 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:53.014471    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:06:54.020865 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:54.020829    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb" event={"ID":"48e410f5-fca7-4881-b4e6-2f0111245bd3","Type":"ContainerStarted","Data":"98f91d62227b67b3740dd5c079507dc96341ba98e44f12f862d821ebd8a3c70b"}
Jul 06 14:06:54.814179 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:54.814138    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:54.815353 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:54.815331    2573 patch_prober.go:28] interesting pod/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 06 14:06:54.815416 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:54.815394    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb" podUID="48e410f5-fca7-4881-b4e6-2f0111245bd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 06 14:06:54.906885 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:54.906840    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:55.814672 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:55.814627    2573 patch_prober.go:28] interesting pod/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 06 14:06:55.815137 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:55.814692    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb" podUID="48e410f5-fca7-4881-b4e6-2f0111245bd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 06 14:06:56.814260 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:56.814218    2573 patch_prober.go:28] interesting pod/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 06 14:06:56.814461 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:56.814283    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb" podUID="48e410f5-fca7-4881-b4e6-2f0111245bd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 06 14:06:57.887323 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:57.887293    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:06:57.888567 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:06:57.888543    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:07:01.020606 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:01.020560    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:07:01.021025 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:01.020623    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:07:01.033209 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:01.033180    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:07:01.068572 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:01.068537    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:07:14.069466 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:14.069427    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"]
Jul 06 14:07:14.070016 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:14.069733    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg" podUID="7678f23d-995d-4db5-ad0a-a644cd41d9b8" containerName="maas-api" containerID="cri-o://40749ade9693c17a6e250b07cbae195c08efaef2d89a10b6d618d13f6394f577" gracePeriod=30
Jul 06 14:07:14.331708 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:14.331686    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:07:14.455605 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:14.455559    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7678f23d-995d-4db5-ad0a-a644cd41d9b8-openshift-service-ca\") pod \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\" (UID: \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\") "
Jul 06 14:07:14.455796 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:14.455623    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9hns\" (UniqueName: \"kubernetes.io/projected/7678f23d-995d-4db5-ad0a-a644cd41d9b8-kube-api-access-d9hns\") pod \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\" (UID: \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\") "
Jul 06 14:07:14.455796 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:14.455675    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7678f23d-995d-4db5-ad0a-a644cd41d9b8-maas-api-tls\") pod \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\" (UID: \"7678f23d-995d-4db5-ad0a-a644cd41d9b8\") "
Jul 06 14:07:14.456028 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:14.456003    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7678f23d-995d-4db5-ad0a-a644cd41d9b8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7678f23d-995d-4db5-ad0a-a644cd41d9b8" (UID: "7678f23d-995d-4db5-ad0a-a644cd41d9b8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:07:14.456347 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:14.456320    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7678f23d-995d-4db5-ad0a-a644cd41d9b8-openshift-service-ca\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:07:14.457909 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:14.457886    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7678f23d-995d-4db5-ad0a-a644cd41d9b8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7678f23d-995d-4db5-ad0a-a644cd41d9b8" (UID: "7678f23d-995d-4db5-ad0a-a644cd41d9b8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:07:14.458001 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:14.457892    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7678f23d-995d-4db5-ad0a-a644cd41d9b8-kube-api-access-d9hns" (OuterVolumeSpecName: "kube-api-access-d9hns") pod "7678f23d-995d-4db5-ad0a-a644cd41d9b8" (UID: "7678f23d-995d-4db5-ad0a-a644cd41d9b8"). InnerVolumeSpecName "kube-api-access-d9hns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:07:14.557480 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:14.557435    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9hns\" (UniqueName: \"kubernetes.io/projected/7678f23d-995d-4db5-ad0a-a644cd41d9b8-kube-api-access-d9hns\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:07:14.557480 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:14.557471    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7678f23d-995d-4db5-ad0a-a644cd41d9b8-maas-api-tls\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:07:15.135430 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:15.135390    2573 generic.go:356] "Generic (PLEG): container finished" podID="7678f23d-995d-4db5-ad0a-a644cd41d9b8" containerID="40749ade9693c17a6e250b07cbae195c08efaef2d89a10b6d618d13f6394f577" exitCode=0
Jul 06 14:07:15.135430 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:15.135433    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"
Jul 06 14:07:15.135964 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:15.135477    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg" event={"ID":"7678f23d-995d-4db5-ad0a-a644cd41d9b8","Type":"ContainerDied","Data":"40749ade9693c17a6e250b07cbae195c08efaef2d89a10b6d618d13f6394f577"}
Jul 06 14:07:15.135964 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:15.135532    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg" event={"ID":"7678f23d-995d-4db5-ad0a-a644cd41d9b8","Type":"ContainerDied","Data":"764c45414def58d4f15ac22de5e01f535cf463f51e36d46de68d23519f15b900"}
Jul 06 14:07:15.135964 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:15.135556    2573 scope.go:117] "RemoveContainer" containerID="40749ade9693c17a6e250b07cbae195c08efaef2d89a10b6d618d13f6394f577"
Jul 06 14:07:15.145889 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:15.145865    2573 scope.go:117] "RemoveContainer" containerID="40749ade9693c17a6e250b07cbae195c08efaef2d89a10b6d618d13f6394f577"
Jul 06 14:07:15.146235 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:07:15.146216    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40749ade9693c17a6e250b07cbae195c08efaef2d89a10b6d618d13f6394f577\": container with ID starting with 40749ade9693c17a6e250b07cbae195c08efaef2d89a10b6d618d13f6394f577 not found: ID does not exist" containerID="40749ade9693c17a6e250b07cbae195c08efaef2d89a10b6d618d13f6394f577"
Jul 06 14:07:15.146317 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:15.146250    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40749ade9693c17a6e250b07cbae195c08efaef2d89a10b6d618d13f6394f577"} err="failed to get container status \"40749ade9693c17a6e250b07cbae195c08efaef2d89a10b6d618d13f6394f577\": rpc error: code = NotFound desc = could not find container \"40749ade9693c17a6e250b07cbae195c08efaef2d89a10b6d618d13f6394f577\": container with ID starting with 40749ade9693c17a6e250b07cbae195c08efaef2d89a10b6d618d13f6394f577 not found: ID does not exist"
Jul 06 14:07:15.158487 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:15.158451    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"]
Jul 06 14:07:15.160527 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:15.160506    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-b7b9827b-6bd47dd575-xhqxg"]
Jul 06 14:07:15.320726 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:15.320691    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7678f23d-995d-4db5-ad0a-a644cd41d9b8" path="/var/lib/kubelet/pods/7678f23d-995d-4db5-ad0a-a644cd41d9b8/volumes"
Jul 06 14:07:24.333716 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:24.333676    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"]
Jul 06 14:07:39.355631 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.355583    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx" podUID="e42c0907-4b31-439c-aea7-da4e5f72ed2f" containerName="main" containerID="cri-o://fde4f7e6172e0c2c7d2f2eb982de91a153e494f23227e4fff11e727624862157" gracePeriod=45
Jul 06 14:07:39.616351 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.616278    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:07:39.711394 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.711353    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e42c0907-4b31-439c-aea7-da4e5f72ed2f-tls-certs\") pod \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") "
Jul 06 14:07:39.711589 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.711424    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-dshm\") pod \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") "
Jul 06 14:07:39.711589 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.711464    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdpt5\" (UniqueName: \"kubernetes.io/projected/e42c0907-4b31-439c-aea7-da4e5f72ed2f-kube-api-access-wdpt5\") pod \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") "
Jul 06 14:07:39.711589 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.711496    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-home\") pod \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") "
Jul 06 14:07:39.711589 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.711535    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-model-cache\") pod \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") "
Jul 06 14:07:39.711589 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.711560    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-tmp-dir\") pod \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\" (UID: \"e42c0907-4b31-439c-aea7-da4e5f72ed2f\") "
Jul 06 14:07:39.711875 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.711833    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-home" (OuterVolumeSpecName: "home") pod "e42c0907-4b31-439c-aea7-da4e5f72ed2f" (UID: "e42c0907-4b31-439c-aea7-da4e5f72ed2f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:07:39.712017 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.711959    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e42c0907-4b31-439c-aea7-da4e5f72ed2f" (UID: "e42c0907-4b31-439c-aea7-da4e5f72ed2f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:07:39.712134 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.712014    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-model-cache" (OuterVolumeSpecName: "model-cache") pod "e42c0907-4b31-439c-aea7-da4e5f72ed2f" (UID: "e42c0907-4b31-439c-aea7-da4e5f72ed2f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:07:39.712134 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.712092    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-home\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:07:39.712134 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.712109    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-tmp-dir\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:07:39.713715 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.713686    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-dshm" (OuterVolumeSpecName: "dshm") pod "e42c0907-4b31-439c-aea7-da4e5f72ed2f" (UID: "e42c0907-4b31-439c-aea7-da4e5f72ed2f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:07:39.714017 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.713995    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e42c0907-4b31-439c-aea7-da4e5f72ed2f-kube-api-access-wdpt5" (OuterVolumeSpecName: "kube-api-access-wdpt5") pod "e42c0907-4b31-439c-aea7-da4e5f72ed2f" (UID: "e42c0907-4b31-439c-aea7-da4e5f72ed2f"). InnerVolumeSpecName "kube-api-access-wdpt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:07:39.714017 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.714006    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e42c0907-4b31-439c-aea7-da4e5f72ed2f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e42c0907-4b31-439c-aea7-da4e5f72ed2f" (UID: "e42c0907-4b31-439c-aea7-da4e5f72ed2f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:07:39.813588 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.813543    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e42c0907-4b31-439c-aea7-da4e5f72ed2f-tls-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:07:39.813588 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.813578    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-dshm\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:07:39.813588 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.813588    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdpt5\" (UniqueName: \"kubernetes.io/projected/e42c0907-4b31-439c-aea7-da4e5f72ed2f-kube-api-access-wdpt5\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:07:39.813588 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:39.813599    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e42c0907-4b31-439c-aea7-da4e5f72ed2f-model-cache\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:07:40.270187 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:40.270157    2573 generic.go:356] "Generic (PLEG): container finished" podID="e42c0907-4b31-439c-aea7-da4e5f72ed2f" containerID="fde4f7e6172e0c2c7d2f2eb982de91a153e494f23227e4fff11e727624862157" exitCode=0
Jul 06 14:07:40.270390 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:40.270201    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"
Jul 06 14:07:40.270390 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:40.270248    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx" event={"ID":"e42c0907-4b31-439c-aea7-da4e5f72ed2f","Type":"ContainerDied","Data":"fde4f7e6172e0c2c7d2f2eb982de91a153e494f23227e4fff11e727624862157"}
Jul 06 14:07:40.270390 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:40.270290    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx" event={"ID":"e42c0907-4b31-439c-aea7-da4e5f72ed2f","Type":"ContainerDied","Data":"acc355bd126c727695f05bffb0067ef1e53a89ee3bb3c77219f14eccc6aa05f3"}
Jul 06 14:07:40.270390 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:40.270309    2573 scope.go:117] "RemoveContainer" containerID="fde4f7e6172e0c2c7d2f2eb982de91a153e494f23227e4fff11e727624862157"
Jul 06 14:07:40.280211 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:40.280187    2573 scope.go:117] "RemoveContainer" containerID="fde4f7e6172e0c2c7d2f2eb982de91a153e494f23227e4fff11e727624862157"
Jul 06 14:07:40.280552 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:07:40.280533    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fde4f7e6172e0c2c7d2f2eb982de91a153e494f23227e4fff11e727624862157\": container with ID starting with fde4f7e6172e0c2c7d2f2eb982de91a153e494f23227e4fff11e727624862157 not found: ID does not exist" containerID="fde4f7e6172e0c2c7d2f2eb982de91a153e494f23227e4fff11e727624862157"
Jul 06 14:07:40.280609 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:40.280563    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fde4f7e6172e0c2c7d2f2eb982de91a153e494f23227e4fff11e727624862157"} err="failed to get container status \"fde4f7e6172e0c2c7d2f2eb982de91a153e494f23227e4fff11e727624862157\": rpc error: code = NotFound desc = could not find container \"fde4f7e6172e0c2c7d2f2eb982de91a153e494f23227e4fff11e727624862157\": container with ID starting with fde4f7e6172e0c2c7d2f2eb982de91a153e494f23227e4fff11e727624862157 not found: ID does not exist"
Jul 06 14:07:40.295164 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:40.295132    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"]
Jul 06 14:07:40.297208 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:40.297175    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b7b9827b/e2e-lifecycle-model-b7b9827b-kserve-84579d8b99-5b8dx"]
Jul 06 14:07:41.314334 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:07:41.314295    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e42c0907-4b31-439c-aea7-da4e5f72ed2f" path="/var/lib/kubelet/pods/e42c0907-4b31-439c-aea7-da4e5f72ed2f/volumes"
Jul 06 14:08:08.662276 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:08.662195    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"]
Jul 06 14:08:08.663323 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:08.662456    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb" podUID="48e410f5-fca7-4881-b4e6-2f0111245bd3" containerName="istio-proxy" containerID="cri-o://98f91d62227b67b3740dd5c079507dc96341ba98e44f12f862d821ebd8a3c70b" gracePeriod=30
Jul 06 14:08:12.889721 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:12.889678    2573 patch_prober.go:28] interesting pod/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 14:08:12.890156 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:12.889748    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb" podUID="48e410f5-fca7-4881-b4e6-2f0111245bd3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 14:08:13.954437 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:13.954404    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:08:14.026685 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.026645    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-credential-socket\") pod \"48e410f5-fca7-4881-b4e6-2f0111245bd3\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") "
Jul 06 14:08:14.026685 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.026690    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-workload-socket\") pod \"48e410f5-fca7-4881-b4e6-2f0111245bd3\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") "
Jul 06 14:08:14.026923 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.026718    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-data\") pod \"48e410f5-fca7-4881-b4e6-2f0111245bd3\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") "
Jul 06 14:08:14.026923 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.026756    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-envoy\") pod \"48e410f5-fca7-4881-b4e6-2f0111245bd3\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") "
Jul 06 14:08:14.026923 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.026791    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48e410f5-fca7-4881-b4e6-2f0111245bd3-istiod-ca-cert\") pod \"48e410f5-fca7-4881-b4e6-2f0111245bd3\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") "
Jul 06 14:08:14.026923 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.026812    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-podinfo\") pod \"48e410f5-fca7-4881-b4e6-2f0111245bd3\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") "
Jul 06 14:08:14.026923 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.026836    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-workload-certs\") pod \"48e410f5-fca7-4881-b4e6-2f0111245bd3\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") "
Jul 06 14:08:14.026923 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.026878    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s688m\" (UniqueName: \"kubernetes.io/projected/48e410f5-fca7-4881-b4e6-2f0111245bd3-kube-api-access-s688m\") pod \"48e410f5-fca7-4881-b4e6-2f0111245bd3\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") "
Jul 06 14:08:14.027284 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.026937    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-token\") pod \"48e410f5-fca7-4881-b4e6-2f0111245bd3\" (UID: \"48e410f5-fca7-4881-b4e6-2f0111245bd3\") "
Jul 06 14:08:14.027284 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.026949    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "48e410f5-fca7-4881-b4e6-2f0111245bd3" (UID: "48e410f5-fca7-4881-b4e6-2f0111245bd3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:08:14.027284 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.027002    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "48e410f5-fca7-4881-b4e6-2f0111245bd3" (UID: "48e410f5-fca7-4881-b4e6-2f0111245bd3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:08:14.027284 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.027131    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "48e410f5-fca7-4881-b4e6-2f0111245bd3" (UID: "48e410f5-fca7-4881-b4e6-2f0111245bd3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:08:14.027284 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.027201    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48e410f5-fca7-4881-b4e6-2f0111245bd3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "48e410f5-fca7-4881-b4e6-2f0111245bd3" (UID: "48e410f5-fca7-4881-b4e6-2f0111245bd3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:08:14.027555 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.027451    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-workload-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:08:14.027555 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.027472    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48e410f5-fca7-4881-b4e6-2f0111245bd3-istiod-ca-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:08:14.027555 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.027486    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-workload-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:08:14.027555 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.027501    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-credential-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:08:14.027741 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.027599    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-data" (OuterVolumeSpecName: "istio-data") pod "48e410f5-fca7-4881-b4e6-2f0111245bd3" (UID: "48e410f5-fca7-4881-b4e6-2f0111245bd3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:08:14.030589 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.030536    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "48e410f5-fca7-4881-b4e6-2f0111245bd3" (UID: "48e410f5-fca7-4881-b4e6-2f0111245bd3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:08:14.030871 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.030843    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "48e410f5-fca7-4881-b4e6-2f0111245bd3" (UID: "48e410f5-fca7-4881-b4e6-2f0111245bd3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:08:14.030871 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.030858    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48e410f5-fca7-4881-b4e6-2f0111245bd3-kube-api-access-s688m" (OuterVolumeSpecName: "kube-api-access-s688m") pod "48e410f5-fca7-4881-b4e6-2f0111245bd3" (UID: "48e410f5-fca7-4881-b4e6-2f0111245bd3"). InnerVolumeSpecName "kube-api-access-s688m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:08:14.031013 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.030884    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-token" (OuterVolumeSpecName: "istio-token") pod "48e410f5-fca7-4881-b4e6-2f0111245bd3" (UID: "48e410f5-fca7-4881-b4e6-2f0111245bd3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:08:14.128121 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.128076    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-data\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:08:14.128121 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.128119    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-envoy\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:08:14.128343 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.128132    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-podinfo\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:08:14.128343 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.128145    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s688m\" (UniqueName: \"kubernetes.io/projected/48e410f5-fca7-4881-b4e6-2f0111245bd3-kube-api-access-s688m\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:08:14.128343 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.128157    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48e410f5-fca7-4881-b4e6-2f0111245bd3-istio-token\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:08:14.464785 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.464744    2573 generic.go:356] "Generic (PLEG): container finished" podID="48e410f5-fca7-4881-b4e6-2f0111245bd3" containerID="98f91d62227b67b3740dd5c079507dc96341ba98e44f12f862d821ebd8a3c70b" exitCode=0
Jul 06 14:08:14.464966 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.464803    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"
Jul 06 14:08:14.464966 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.464822    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb" event={"ID":"48e410f5-fca7-4881-b4e6-2f0111245bd3","Type":"ContainerDied","Data":"98f91d62227b67b3740dd5c079507dc96341ba98e44f12f862d821ebd8a3c70b"}
Jul 06 14:08:14.464966 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.464875    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb" event={"ID":"48e410f5-fca7-4881-b4e6-2f0111245bd3","Type":"ContainerDied","Data":"c894e3906471f6f11ddf87bdfe04103427fafe232eb51ce624ec7addc33fe705"}
Jul 06 14:08:14.464966 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.464900    2573 scope.go:117] "RemoveContainer" containerID="98f91d62227b67b3740dd5c079507dc96341ba98e44f12f862d821ebd8a3c70b"
Jul 06 14:08:14.475291 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.475268    2573 scope.go:117] "RemoveContainer" containerID="77ed1696cbd9faaa7cf863abbdecf8346ab8bf8cf08c3cb53a5afa41fc3e2101"
Jul 06 14:08:14.484552 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.484527    2573 scope.go:117] "RemoveContainer" containerID="98f91d62227b67b3740dd5c079507dc96341ba98e44f12f862d821ebd8a3c70b"
Jul 06 14:08:14.484888 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:08:14.484869    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f91d62227b67b3740dd5c079507dc96341ba98e44f12f862d821ebd8a3c70b\": container with ID starting with 98f91d62227b67b3740dd5c079507dc96341ba98e44f12f862d821ebd8a3c70b not found: ID does not exist" containerID="98f91d62227b67b3740dd5c079507dc96341ba98e44f12f862d821ebd8a3c70b"
Jul 06 14:08:14.484971 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.484897    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f91d62227b67b3740dd5c079507dc96341ba98e44f12f862d821ebd8a3c70b"} err="failed to get container status \"98f91d62227b67b3740dd5c079507dc96341ba98e44f12f862d821ebd8a3c70b\": rpc error: code = NotFound desc = could not find container \"98f91d62227b67b3740dd5c079507dc96341ba98e44f12f862d821ebd8a3c70b\": container with ID starting with 98f91d62227b67b3740dd5c079507dc96341ba98e44f12f862d821ebd8a3c70b not found: ID does not exist"
Jul 06 14:08:14.484971 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.484916    2573 scope.go:117] "RemoveContainer" containerID="77ed1696cbd9faaa7cf863abbdecf8346ab8bf8cf08c3cb53a5afa41fc3e2101"
Jul 06 14:08:14.485238 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:08:14.485217    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77ed1696cbd9faaa7cf863abbdecf8346ab8bf8cf08c3cb53a5afa41fc3e2101\": container with ID starting with 77ed1696cbd9faaa7cf863abbdecf8346ab8bf8cf08c3cb53a5afa41fc3e2101 not found: ID does not exist" containerID="77ed1696cbd9faaa7cf863abbdecf8346ab8bf8cf08c3cb53a5afa41fc3e2101"
Jul 06 14:08:14.485295 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.485250    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77ed1696cbd9faaa7cf863abbdecf8346ab8bf8cf08c3cb53a5afa41fc3e2101"} err="failed to get container status \"77ed1696cbd9faaa7cf863abbdecf8346ab8bf8cf08c3cb53a5afa41fc3e2101\": rpc error: code = NotFound desc = could not find container \"77ed1696cbd9faaa7cf863abbdecf8346ab8bf8cf08c3cb53a5afa41fc3e2101\": container with ID starting with 77ed1696cbd9faaa7cf863abbdecf8346ab8bf8cf08c3cb53a5afa41fc3e2101 not found: ID does not exist"
Jul 06 14:08:14.494341 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.494305    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"]
Jul 06 14:08:14.501138 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:14.501108    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b7b9827b-openshift-default-6f4f54f999-68mbb"]
Jul 06 14:08:15.314955 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:08:15.314916    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48e410f5-fca7-4881-b4e6-2f0111245bd3" path="/var/lib/kubelet/pods/48e410f5-fca7-4881-b4e6-2f0111245bd3/volumes"
Jul 06 14:09:05.154458 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.154421    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"]
Jul 06 14:09:05.155030 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.155010    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7678f23d-995d-4db5-ad0a-a644cd41d9b8" containerName="maas-api"
Jul 06 14:09:05.155104 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.155035    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7678f23d-995d-4db5-ad0a-a644cd41d9b8" containerName="maas-api"
Jul 06 14:09:05.155104 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.155070    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48e410f5-fca7-4881-b4e6-2f0111245bd3" containerName="istio-proxy"
Jul 06 14:09:05.155104 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.155079    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e410f5-fca7-4881-b4e6-2f0111245bd3" containerName="istio-proxy"
Jul 06 14:09:05.155200 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.155104    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e42c0907-4b31-439c-aea7-da4e5f72ed2f" containerName="main"
Jul 06 14:09:05.155200 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.155114    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e42c0907-4b31-439c-aea7-da4e5f72ed2f" containerName="main"
Jul 06 14:09:05.155273 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.155263    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7678f23d-995d-4db5-ad0a-a644cd41d9b8" containerName="maas-api"
Jul 06 14:09:05.155311 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.155274    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="48e410f5-fca7-4881-b4e6-2f0111245bd3" containerName="istio-proxy"
Jul 06 14:09:05.155311 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.155284    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e42c0907-4b31-439c-aea7-da4e5f72ed2f" containerName="main"
Jul 06 14:09:05.158828 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.158808    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.162002 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.161974    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-23d6fa-openshift-default-dockercfg-dz5tn\""
Jul 06 14:09:05.170287 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.170255    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"]
Jul 06 14:09:05.218688 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.218648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istiod-ca-cert\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.218688 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.218692    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc7bd\" (UniqueName: \"kubernetes.io/projected/6f9c4374-4f01-43dd-a711-c9bca63fd94a-kube-api-access-zc7bd\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.218914 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.218715    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-envoy\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.218914 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.218779    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-token\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.218914 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.218801    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-workload-socket\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.218914 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.218823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-credential-socket\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.219108 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.218910    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-workload-certs\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.219108 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.218947    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-data\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.219108 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.218974    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-podinfo\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.320282 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.320232    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-data\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.320501 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.320292    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-podinfo\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.320501 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.320319    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istiod-ca-cert\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.320501 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.320353    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7bd\" (UniqueName: \"kubernetes.io/projected/6f9c4374-4f01-43dd-a711-c9bca63fd94a-kube-api-access-zc7bd\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.320662 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.320564    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-envoy\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.320719 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.320664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-token\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.320719 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.320697    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-workload-socket\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.320824 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.320719    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-data\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.320824 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.320734    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-credential-socket\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.320937 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.320858    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-workload-certs\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.321032 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.321010    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-credential-socket\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.321123 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.321104    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istiod-ca-cert\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.321233 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.321210    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-workload-socket\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.321294 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.321266    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-workload-certs\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.322774 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.322743    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-envoy\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.323047 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.323029    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-podinfo\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.329803 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.329766    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-token\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.329978 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.329934    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc7bd\" (UniqueName: \"kubernetes.io/projected/6f9c4374-4f01-43dd-a711-c9bca63fd94a-kube-api-access-zc7bd\") pod \"e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") " pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.471676 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.471571    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:05.642757 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.642721    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"]
Jul 06 14:09:05.644728 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:09:05.644693    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9c4374_4f01_43dd_a711_c9bca63fd94a.slice/crio-c454d82a01abf029926263c7b34551779578150f79ac1a5bd18ccf3efd27dedf WatchSource:0}: Error finding container c454d82a01abf029926263c7b34551779578150f79ac1a5bd18ccf3efd27dedf: Status 404 returned error can't find the container with id c454d82a01abf029926263c7b34551779578150f79ac1a5bd18ccf3efd27dedf
Jul 06 14:09:05.647406 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.647370    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:09:05.647503 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.647445    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:09:05.647503 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.647483    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:09:05.740460 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.740358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t" event={"ID":"6f9c4374-4f01-43dd-a711-c9bca63fd94a","Type":"ContainerStarted","Data":"984cf6d346ff1b25183810821de4a4f8cdb87be3f72a6aaf45e8530597efd0bb"}
Jul 06 14:09:05.740460 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.740427    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t" event={"ID":"6f9c4374-4f01-43dd-a711-c9bca63fd94a","Type":"ContainerStarted","Data":"c454d82a01abf029926263c7b34551779578150f79ac1a5bd18ccf3efd27dedf"}
Jul 06 14:09:05.762771 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:05.762716    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t" podStartSLOduration=0.762696514 podStartE2EDuration="762.696514ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:09:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:09:05.7614328 +0000 UTC m=+1761.072996467" watchObservedRunningTime="2026-07-06 14:09:05.762696514 +0000 UTC m=+1761.074260221"
Jul 06 14:09:06.472585 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:06.472545    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:06.478008 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:06.477977    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:06.746183 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:06.746093    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:06.747489 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:06.747464    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:08.038334 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.038297    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"]
Jul 06 14:09:08.038960 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.038938    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48e410f5-fca7-4881-b4e6-2f0111245bd3" containerName="istio-proxy"
Jul 06 14:09:08.039109 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.038963    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e410f5-fca7-4881-b4e6-2f0111245bd3" containerName="istio-proxy"
Jul 06 14:09:08.039186 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.039112    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="48e410f5-fca7-4881-b4e6-2f0111245bd3" containerName="istio-proxy"
Jul 06 14:09:08.042404 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.042380    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:09:08.045783 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.045749    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-23d6fa-serving-cert\""
Jul 06 14:09:08.057683 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.057652    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"]
Jul 06 14:09:08.148457 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.148403    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c56z9\" (UniqueName: \"kubernetes.io/projected/b4fe2845-8b19-4455-8eb2-d39dd19886ab-kube-api-access-c56z9\") pod \"maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l\" (UID: \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\") " pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:09:08.148676 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.148610    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4fe2845-8b19-4455-8eb2-d39dd19886ab-maas-api-tls\") pod \"maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l\" (UID: \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\") " pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:09:08.148676 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.148668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fe2845-8b19-4455-8eb2-d39dd19886ab-openshift-service-ca\") pod \"maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l\" (UID: \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\") " pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:09:08.249840 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.249796    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4fe2845-8b19-4455-8eb2-d39dd19886ab-maas-api-tls\") pod \"maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l\" (UID: \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\") " pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:09:08.249840 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.249847    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fe2845-8b19-4455-8eb2-d39dd19886ab-openshift-service-ca\") pod \"maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l\" (UID: \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\") " pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:09:08.250100 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.249888    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c56z9\" (UniqueName: \"kubernetes.io/projected/b4fe2845-8b19-4455-8eb2-d39dd19886ab-kube-api-access-c56z9\") pod \"maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l\" (UID: \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\") " pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:09:08.250100 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:09:08.249957    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-23d6fa-serving-cert: secret "maas-api-e2e-inf-a-23d6fa-serving-cert" not found
Jul 06 14:09:08.250100 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:09:08.250033    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4fe2845-8b19-4455-8eb2-d39dd19886ab-maas-api-tls podName:b4fe2845-8b19-4455-8eb2-d39dd19886ab nodeName:}" failed. No retries permitted until 2026-07-06 14:09:08.750013724 +0000 UTC m=+1764.061577370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b4fe2845-8b19-4455-8eb2-d39dd19886ab-maas-api-tls") pod "maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l" (UID: "b4fe2845-8b19-4455-8eb2-d39dd19886ab") : secret "maas-api-e2e-inf-a-23d6fa-serving-cert" not found
Jul 06 14:09:08.250654 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.250634    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fe2845-8b19-4455-8eb2-d39dd19886ab-openshift-service-ca\") pod \"maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l\" (UID: \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\") " pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:09:08.259859 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.259824    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c56z9\" (UniqueName: \"kubernetes.io/projected/b4fe2845-8b19-4455-8eb2-d39dd19886ab-kube-api-access-c56z9\") pod \"maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l\" (UID: \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\") " pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:09:08.754844 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.754807    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4fe2845-8b19-4455-8eb2-d39dd19886ab-maas-api-tls\") pod \"maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l\" (UID: \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\") " pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:09:08.757353 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.757329    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4fe2845-8b19-4455-8eb2-d39dd19886ab-maas-api-tls\") pod \"maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l\" (UID: \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\") " pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:09:08.956024 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:08.955985    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:09:09.317431 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:09.317409    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"]
Jul 06 14:09:09.319724 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:09:09.319700    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4fe2845_8b19_4455_8eb2_d39dd19886ab.slice/crio-0d589618f65bb341aacaa0e5fb8d7471bd92dc75bebb28b874feb60dbfdc3858 WatchSource:0}: Error finding container 0d589618f65bb341aacaa0e5fb8d7471bd92dc75bebb28b874feb60dbfdc3858: Status 404 returned error can't find the container with id 0d589618f65bb341aacaa0e5fb8d7471bd92dc75bebb28b874feb60dbfdc3858
Jul 06 14:09:09.764973 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:09.764941    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l" event={"ID":"b4fe2845-8b19-4455-8eb2-d39dd19886ab","Type":"ContainerStarted","Data":"0d589618f65bb341aacaa0e5fb8d7471bd92dc75bebb28b874feb60dbfdc3858"}
Jul 06 14:09:10.772127 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:10.772077    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l" event={"ID":"b4fe2845-8b19-4455-8eb2-d39dd19886ab","Type":"ContainerStarted","Data":"94986ce4abeac6f451599fdc13b54edc274c1280a614ef16bf0dfdae2ae1738c"}
Jul 06 14:09:10.772686 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:10.772184    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:09:10.825736 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:10.825677    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l" podStartSLOduration=2.290792673 podStartE2EDuration="2.825660914s" totalImagesPullingTime="534.868241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:09:10.82187459 +0000 UTC m=+1766.133438257" watchObservedRunningTime="2026-07-06 14:09:10.825660914 +0000 UTC m=+1766.137224582"
Jul 06 14:09:13.134739 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.134695    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"]
Jul 06 14:09:13.139320 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.139298    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.143026 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.142998    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-7e06f0-openshift-default-dockercfg-bvqfr\""
Jul 06 14:09:13.161470 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.161431    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"]
Jul 06 14:09:13.198480 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.198442    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-credential-socket\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.198679 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.198487    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-workload-certs\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.198679 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.198527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-workload-socket\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.198679 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.198553    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe9306-e5e8-4e8b-b559-764b85596e91-istiod-ca-cert\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.198679 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.198611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-podinfo\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.198679 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.198649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-envoy\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.198890 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.198701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjl7r\" (UniqueName: \"kubernetes.io/projected/6cfe9306-e5e8-4e8b-b559-764b85596e91-kube-api-access-kjl7r\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.198890 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.198743    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-data\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.198890 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.198816    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-token\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.299992 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.299939    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-data\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.300237 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.300006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-token\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.300237 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.300046    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-credential-socket\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.300237 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.300103    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-workload-certs\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.300237 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.300140    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-workload-socket\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.300237 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.300159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe9306-e5e8-4e8b-b559-764b85596e91-istiod-ca-cert\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.300237 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.300192    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-podinfo\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.300237 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.300233    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-envoy\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.300623 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.300270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjl7r\" (UniqueName: \"kubernetes.io/projected/6cfe9306-e5e8-4e8b-b559-764b85596e91-kube-api-access-kjl7r\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.300623 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.300481    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-data\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.300725 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.300649    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-credential-socket\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.300725 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.300682    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-workload-socket\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.300872 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.300844    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-workload-certs\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.301016 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.300943    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe9306-e5e8-4e8b-b559-764b85596e91-istiod-ca-cert\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.302938 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.302912    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-envoy\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.303075 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.303019    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-podinfo\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.310793 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.310757    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-token\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.311108 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.311085    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjl7r\" (UniqueName: \"kubernetes.io/projected/6cfe9306-e5e8-4e8b-b559-764b85596e91-kube-api-access-kjl7r\") pod \"e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") " pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.451448 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.451344    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:13.654218 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.654184    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"]
Jul 06 14:09:13.654666 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:09:13.654638    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfe9306_e5e8_4e8b_b559_764b85596e91.slice/crio-1d1b3309388b8c971e378c7d9ee76c6e602c46df70aae39a3e7d3143aaa83399 WatchSource:0}: Error finding container 1d1b3309388b8c971e378c7d9ee76c6e602c46df70aae39a3e7d3143aaa83399: Status 404 returned error can't find the container with id 1d1b3309388b8c971e378c7d9ee76c6e602c46df70aae39a3e7d3143aaa83399
Jul 06 14:09:13.657686 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.657642    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:09:13.657778 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.657739    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:09:13.657822 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.657785    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:09:13.792878 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.792835    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2" event={"ID":"6cfe9306-e5e8-4e8b-b559-764b85596e91","Type":"ContainerStarted","Data":"9f4e2955d58bb4c0dea1133bcd1fd1d62b5584f8e1dd1ed2e24b041217531e75"}
Jul 06 14:09:13.793096 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.792905    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2" event={"ID":"6cfe9306-e5e8-4e8b-b559-764b85596e91","Type":"ContainerStarted","Data":"1d1b3309388b8c971e378c7d9ee76c6e602c46df70aae39a3e7d3143aaa83399"}
Jul 06 14:09:13.831780 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:13.831718    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2" podStartSLOduration=0.831693538 podStartE2EDuration="831.693538ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:09:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:09:13.829917036 +0000 UTC m=+1769.141480705" watchObservedRunningTime="2026-07-06 14:09:13.831693538 +0000 UTC m=+1769.143257234"
Jul 06 14:09:14.453985 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:14.453945    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:14.465699 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:14.465664    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:14.798120 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:14.798017    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:14.798983 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:14.798964    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:16.785822 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:16.785794    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:09:21.748280 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:21.748242    2573 patch_prober.go:28] interesting pod/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 06 14:09:21.748733 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:21.748312    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t" podUID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 06 14:09:21.836942 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:21.836907    2573 generic.go:356] "Generic (PLEG): container finished" podID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" containerID="984cf6d346ff1b25183810821de4a4f8cdb87be3f72a6aaf45e8530597efd0bb" exitCode=0
Jul 06 14:09:21.837419 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:21.836985    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t" event={"ID":"6f9c4374-4f01-43dd-a711-c9bca63fd94a","Type":"ContainerDied","Data":"984cf6d346ff1b25183810821de4a4f8cdb87be3f72a6aaf45e8530597efd0bb"}
Jul 06 14:09:21.837497 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:21.837443    2573 scope.go:117] "RemoveContainer" containerID="984cf6d346ff1b25183810821de4a4f8cdb87be3f72a6aaf45e8530597efd0bb"
Jul 06 14:09:21.838836 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:21.838799    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:09:21.838931 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:21.838904    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:09:21.838988 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:21.838953    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:09:22.847770 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:22.847722    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t" event={"ID":"6f9c4374-4f01-43dd-a711-c9bca63fd94a","Type":"ContainerStarted","Data":"4872f5e940fe90674e45da4e915ccaedbf78d39fdf9424621c0629ac8660de13"}
Jul 06 14:09:23.472009 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:23.471959    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:23.472431 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:23.472380    2573 patch_prober.go:28] interesting pod/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 06 14:09:23.472560 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:23.472460    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t" podUID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 06 14:09:24.473080 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:24.473022    2573 patch_prober.go:28] interesting pod/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 06 14:09:24.473700 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:24.473666    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t" podUID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 06 14:09:25.472655 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:25.472601    2573 patch_prober.go:28] interesting pod/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 06 14:09:25.472887 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:25.472696    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t" podUID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 06 14:09:26.476535 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:26.476494    2573 patch_prober.go:28] interesting pod/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 06 14:09:26.477160 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:26.477128    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t" podUID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 06 14:09:27.477063 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:27.477015    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:27.477528 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:27.477506    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:27.478465 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:27.478444    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:09:29.837360 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:29.836370    2573 patch_prober.go:28] interesting pod/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": read tcp 10.133.0.2:51054->10.133.0.66:15021: read: connection reset by peer" start-of-body=
Jul 06 14:09:29.837360 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:29.836455    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2" podUID="6cfe9306-e5e8-4e8b-b559-764b85596e91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": read tcp 10.133.0.2:51054->10.133.0.66:15021: read: connection reset by peer"
Jul 06 14:09:29.900976 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:29.900945    2573 generic.go:356] "Generic (PLEG): container finished" podID="6cfe9306-e5e8-4e8b-b559-764b85596e91" containerID="9f4e2955d58bb4c0dea1133bcd1fd1d62b5584f8e1dd1ed2e24b041217531e75" exitCode=0
Jul 06 14:09:29.901161 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:29.901010    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2" event={"ID":"6cfe9306-e5e8-4e8b-b559-764b85596e91","Type":"ContainerDied","Data":"9f4e2955d58bb4c0dea1133bcd1fd1d62b5584f8e1dd1ed2e24b041217531e75"}
Jul 06 14:09:29.901446 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:29.901432    2573 scope.go:117] "RemoveContainer" containerID="9f4e2955d58bb4c0dea1133bcd1fd1d62b5584f8e1dd1ed2e24b041217531e75"
Jul 06 14:09:29.902451 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:29.902422    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:09:29.902551 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:29.902490    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:09:29.902551 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:29.902522    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:09:30.909199 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:30.909167    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2" event={"ID":"6cfe9306-e5e8-4e8b-b559-764b85596e91","Type":"ContainerStarted","Data":"49bace417d87d69a25a1befb7e2e7eed705f8468961b2a1525bdc9ff15447652"}
Jul 06 14:09:31.459077 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:31.454533    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:31.459077 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:31.454669    2573 patch_prober.go:28] interesting pod/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 06 14:09:31.459077 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:31.454728    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2" podUID="6cfe9306-e5e8-4e8b-b559-764b85596e91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 06 14:09:32.452207 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:32.452161    2573 patch_prober.go:28] interesting pod/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 06 14:09:32.452750 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:32.452232    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2" podUID="6cfe9306-e5e8-4e8b-b559-764b85596e91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 06 14:09:33.452450 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:33.452393    2573 patch_prober.go:28] interesting pod/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 06 14:09:33.453112 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:33.453078    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2" podUID="6cfe9306-e5e8-4e8b-b559-764b85596e91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 06 14:09:34.452037 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:34.451991    2573 patch_prober.go:28] interesting pod/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 06 14:09:34.452306 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:34.452085    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2" podUID="6cfe9306-e5e8-4e8b-b559-764b85596e91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 06 14:09:35.456465 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:35.456430    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:35.456949 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:35.456874    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:35.457637 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:35.457618    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:09:45.302549 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:45.302519    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 14:09:45.308029 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:09:45.308000    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 14:10:06.996980 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:06.996946    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"]
Jul 06 14:10:07.000799 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.000775    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.004726 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.004698    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-7e06f0\"/\"test-model-7e06f0-kserve-self-signed-certs\""
Jul 06 14:10:07.004884 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.004698    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-7e06f0\"/\"default-dockercfg-6hzmp\""
Jul 06 14:10:07.004884 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.004741    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-7e06f0\"/\"openshift-service-ca.crt\""
Jul 06 14:10:07.004884 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.004708    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-7e06f0\"/\"kube-root-ca.crt\""
Jul 06 14:10:07.009243 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.009219    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"]
Jul 06 14:10:07.168450 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.168410    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-dshm\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.168450 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.168458    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqv8s\" (UniqueName: \"kubernetes.io/projected/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-kube-api-access-jqv8s\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.168730 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.168545    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-home\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.168730 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.168687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-model-cache\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.168801 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.168738    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-tls-certs\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.168801 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.168758    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-tmp-dir\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.270122 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.269994    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-model-cache\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.270122 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.270100    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-tls-certs\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.270367 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.270129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-tmp-dir\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.270367 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.270159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-dshm\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.270481 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.270398    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqv8s\" (UniqueName: \"kubernetes.io/projected/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-kube-api-access-jqv8s\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.270481 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.270438    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-model-cache\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.270481 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.270472    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-home\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.270640 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.270541    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-tmp-dir\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.270831 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.270809    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-home\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.272462 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.272442    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-dshm\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.272745 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.272729    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-tls-certs\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.279954 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.279930    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqv8s\" (UniqueName: \"kubernetes.io/projected/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-kube-api-access-jqv8s\") pod \"test-model-7e06f0-kserve-d57f444b5-4v9sl\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") " pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.312304 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.312200    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:07.461344 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:07.461318    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"]
Jul 06 14:10:07.463375 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:10:07.463345    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51e9de67_8ad7_4421_90eb_467ab7c8fdc7.slice/crio-6ce65fc9fd78bab1d530b0f9a06c1f6af66c22bfa6f16af223469fa6dd2afa56 WatchSource:0}: Error finding container 6ce65fc9fd78bab1d530b0f9a06c1f6af66c22bfa6f16af223469fa6dd2afa56: Status 404 returned error can't find the container with id 6ce65fc9fd78bab1d530b0f9a06c1f6af66c22bfa6f16af223469fa6dd2afa56
Jul 06 14:10:08.121671 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:08.121635    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl" event={"ID":"51e9de67-8ad7-4421-90eb-467ab7c8fdc7","Type":"ContainerStarted","Data":"4b5709c7017c92d152fcea3339b02981ab2cb9547826b34a1cd2043d2cd87745"}
Jul 06 14:10:08.122100 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:08.121682    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl" event={"ID":"51e9de67-8ad7-4421-90eb-467ab7c8fdc7","Type":"ContainerStarted","Data":"6ce65fc9fd78bab1d530b0f9a06c1f6af66c22bfa6f16af223469fa6dd2afa56"}
Jul 06 14:10:08.141600 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:08.141548    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl" podStartSLOduration=2.141528631 podStartE2EDuration="2.141528631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:10:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:10:08.140128281 +0000 UTC m=+1823.451691949" watchObservedRunningTime="2026-07-06 14:10:08.141528631 +0000 UTC m=+1823.453092338"
Jul 06 14:10:17.314234 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:17.314203    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:17.314866 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:17.314249    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:17.325913 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:17.325885    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:18.187067 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:18.187019    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:25.009305 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:25.009269    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"]
Jul 06 14:10:25.900073 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:25.900012    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"]
Jul 06 14:10:25.900327 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:25.900301    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l" podUID="b4fe2845-8b19-4455-8eb2-d39dd19886ab" containerName="maas-api" containerID="cri-o://94986ce4abeac6f451599fdc13b54edc274c1280a614ef16bf0dfdae2ae1738c" gracePeriod=30
Jul 06 14:10:26.170501 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.170474    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:10:26.220659 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.220621    2573 generic.go:356] "Generic (PLEG): container finished" podID="b4fe2845-8b19-4455-8eb2-d39dd19886ab" containerID="94986ce4abeac6f451599fdc13b54edc274c1280a614ef16bf0dfdae2ae1738c" exitCode=0
Jul 06 14:10:26.220861 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.220679    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"
Jul 06 14:10:26.220861 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.220706    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l" event={"ID":"b4fe2845-8b19-4455-8eb2-d39dd19886ab","Type":"ContainerDied","Data":"94986ce4abeac6f451599fdc13b54edc274c1280a614ef16bf0dfdae2ae1738c"}
Jul 06 14:10:26.220861 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.220771    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l" event={"ID":"b4fe2845-8b19-4455-8eb2-d39dd19886ab","Type":"ContainerDied","Data":"0d589618f65bb341aacaa0e5fb8d7471bd92dc75bebb28b874feb60dbfdc3858"}
Jul 06 14:10:26.220861 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.220802    2573 scope.go:117] "RemoveContainer" containerID="94986ce4abeac6f451599fdc13b54edc274c1280a614ef16bf0dfdae2ae1738c"
Jul 06 14:10:26.232370 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.232239    2573 scope.go:117] "RemoveContainer" containerID="94986ce4abeac6f451599fdc13b54edc274c1280a614ef16bf0dfdae2ae1738c"
Jul 06 14:10:26.233298 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:10:26.233256    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94986ce4abeac6f451599fdc13b54edc274c1280a614ef16bf0dfdae2ae1738c\": container with ID starting with 94986ce4abeac6f451599fdc13b54edc274c1280a614ef16bf0dfdae2ae1738c not found: ID does not exist" containerID="94986ce4abeac6f451599fdc13b54edc274c1280a614ef16bf0dfdae2ae1738c"
Jul 06 14:10:26.233405 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.233302    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94986ce4abeac6f451599fdc13b54edc274c1280a614ef16bf0dfdae2ae1738c"} err="failed to get container status \"94986ce4abeac6f451599fdc13b54edc274c1280a614ef16bf0dfdae2ae1738c\": rpc error: code = NotFound desc = could not find container \"94986ce4abeac6f451599fdc13b54edc274c1280a614ef16bf0dfdae2ae1738c\": container with ID starting with 94986ce4abeac6f451599fdc13b54edc274c1280a614ef16bf0dfdae2ae1738c not found: ID does not exist"
Jul 06 14:10:26.266946 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.266912    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fe2845-8b19-4455-8eb2-d39dd19886ab-openshift-service-ca\") pod \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\" (UID: \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\") "
Jul 06 14:10:26.266946 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.266962    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c56z9\" (UniqueName: \"kubernetes.io/projected/b4fe2845-8b19-4455-8eb2-d39dd19886ab-kube-api-access-c56z9\") pod \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\" (UID: \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\") "
Jul 06 14:10:26.267216 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.267006    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4fe2845-8b19-4455-8eb2-d39dd19886ab-maas-api-tls\") pod \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\" (UID: \"b4fe2845-8b19-4455-8eb2-d39dd19886ab\") "
Jul 06 14:10:26.267380 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.267333    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4fe2845-8b19-4455-8eb2-d39dd19886ab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b4fe2845-8b19-4455-8eb2-d39dd19886ab" (UID: "b4fe2845-8b19-4455-8eb2-d39dd19886ab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:10:26.267515 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.267437    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4fe2845-8b19-4455-8eb2-d39dd19886ab-openshift-service-ca\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:10:26.269313 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.269285    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4fe2845-8b19-4455-8eb2-d39dd19886ab-kube-api-access-c56z9" (OuterVolumeSpecName: "kube-api-access-c56z9") pod "b4fe2845-8b19-4455-8eb2-d39dd19886ab" (UID: "b4fe2845-8b19-4455-8eb2-d39dd19886ab"). InnerVolumeSpecName "kube-api-access-c56z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:10:26.269438 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.269352    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4fe2845-8b19-4455-8eb2-d39dd19886ab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b4fe2845-8b19-4455-8eb2-d39dd19886ab" (UID: "b4fe2845-8b19-4455-8eb2-d39dd19886ab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:10:26.368397 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.368360    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4fe2845-8b19-4455-8eb2-d39dd19886ab-maas-api-tls\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:10:26.368397 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.368391    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c56z9\" (UniqueName: \"kubernetes.io/projected/b4fe2845-8b19-4455-8eb2-d39dd19886ab-kube-api-access-c56z9\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:10:26.544942 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.544906    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"]
Jul 06 14:10:26.553890 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:26.553848    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-23d6fa-84b5b7766d-m8z8l"]
Jul 06 14:10:27.314489 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:27.314456    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4fe2845-8b19-4455-8eb2-d39dd19886ab" path="/var/lib/kubelet/pods/b4fe2845-8b19-4455-8eb2-d39dd19886ab/volumes"
Jul 06 14:10:40.030903 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.030856    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl" podUID="51e9de67-8ad7-4421-90eb-467ab7c8fdc7" containerName="main" containerID="cri-o://4b5709c7017c92d152fcea3339b02981ab2cb9547826b34a1cd2043d2cd87745" gracePeriod=45
Jul 06 14:10:40.296855 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.296784    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:40.298298 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.298272    2573 generic.go:356] "Generic (PLEG): container finished" podID="51e9de67-8ad7-4421-90eb-467ab7c8fdc7" containerID="4b5709c7017c92d152fcea3339b02981ab2cb9547826b34a1cd2043d2cd87745" exitCode=0
Jul 06 14:10:40.298423 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.298307    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"
Jul 06 14:10:40.298423 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.298326    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl" event={"ID":"51e9de67-8ad7-4421-90eb-467ab7c8fdc7","Type":"ContainerDied","Data":"4b5709c7017c92d152fcea3339b02981ab2cb9547826b34a1cd2043d2cd87745"}
Jul 06 14:10:40.298423 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.298363    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl" event={"ID":"51e9de67-8ad7-4421-90eb-467ab7c8fdc7","Type":"ContainerDied","Data":"6ce65fc9fd78bab1d530b0f9a06c1f6af66c22bfa6f16af223469fa6dd2afa56"}
Jul 06 14:10:40.298423 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.298385    2573 scope.go:117] "RemoveContainer" containerID="4b5709c7017c92d152fcea3339b02981ab2cb9547826b34a1cd2043d2cd87745"
Jul 06 14:10:40.307686 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.307661    2573 scope.go:117] "RemoveContainer" containerID="4b5709c7017c92d152fcea3339b02981ab2cb9547826b34a1cd2043d2cd87745"
Jul 06 14:10:40.308036 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:10:40.308003    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b5709c7017c92d152fcea3339b02981ab2cb9547826b34a1cd2043d2cd87745\": container with ID starting with 4b5709c7017c92d152fcea3339b02981ab2cb9547826b34a1cd2043d2cd87745 not found: ID does not exist" containerID="4b5709c7017c92d152fcea3339b02981ab2cb9547826b34a1cd2043d2cd87745"
Jul 06 14:10:40.308145 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.308044    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b5709c7017c92d152fcea3339b02981ab2cb9547826b34a1cd2043d2cd87745"} err="failed to get container status \"4b5709c7017c92d152fcea3339b02981ab2cb9547826b34a1cd2043d2cd87745\": rpc error: code = NotFound desc = could not find container \"4b5709c7017c92d152fcea3339b02981ab2cb9547826b34a1cd2043d2cd87745\": container with ID starting with 4b5709c7017c92d152fcea3339b02981ab2cb9547826b34a1cd2043d2cd87745 not found: ID does not exist"
Jul 06 14:10:40.413158 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.413118    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqv8s\" (UniqueName: \"kubernetes.io/projected/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-kube-api-access-jqv8s\") pod \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") "
Jul 06 14:10:40.413370 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.413177    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-tmp-dir\") pod \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") "
Jul 06 14:10:40.413370 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.413214    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-dshm\") pod \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") "
Jul 06 14:10:40.413370 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.413292    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-model-cache\") pod \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") "
Jul 06 14:10:40.413370 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.413333    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-home\") pod \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") "
Jul 06 14:10:40.413596 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.413424    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-tls-certs\") pod \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\" (UID: \"51e9de67-8ad7-4421-90eb-467ab7c8fdc7\") "
Jul 06 14:10:40.413596 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.413517    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "51e9de67-8ad7-4421-90eb-467ab7c8fdc7" (UID: "51e9de67-8ad7-4421-90eb-467ab7c8fdc7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:10:40.413704 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.413588    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-model-cache" (OuterVolumeSpecName: "model-cache") pod "51e9de67-8ad7-4421-90eb-467ab7c8fdc7" (UID: "51e9de67-8ad7-4421-90eb-467ab7c8fdc7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:10:40.413704 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.413603    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-home" (OuterVolumeSpecName: "home") pod "51e9de67-8ad7-4421-90eb-467ab7c8fdc7" (UID: "51e9de67-8ad7-4421-90eb-467ab7c8fdc7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:10:40.413839 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.413814    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-tmp-dir\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:10:40.413903 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.413842    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-model-cache\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:10:40.413903 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.413857    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-home\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:10:40.415605 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.415571    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-kube-api-access-jqv8s" (OuterVolumeSpecName: "kube-api-access-jqv8s") pod "51e9de67-8ad7-4421-90eb-467ab7c8fdc7" (UID: "51e9de67-8ad7-4421-90eb-467ab7c8fdc7"). InnerVolumeSpecName "kube-api-access-jqv8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:10:40.415730 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.415616    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-dshm" (OuterVolumeSpecName: "dshm") pod "51e9de67-8ad7-4421-90eb-467ab7c8fdc7" (UID: "51e9de67-8ad7-4421-90eb-467ab7c8fdc7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:10:40.415730 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.415627    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "51e9de67-8ad7-4421-90eb-467ab7c8fdc7" (UID: "51e9de67-8ad7-4421-90eb-467ab7c8fdc7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:10:40.515480 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.515436    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-tls-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:10:40.515480 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.515473    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqv8s\" (UniqueName: \"kubernetes.io/projected/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-kube-api-access-jqv8s\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:10:40.515480 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.515481    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51e9de67-8ad7-4421-90eb-467ab7c8fdc7-dshm\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:10:40.621738 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.621697    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"]
Jul 06 14:10:40.625471 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:40.625440    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-7e06f0/test-model-7e06f0-kserve-d57f444b5-4v9sl"]
Jul 06 14:10:41.314203 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:10:41.314163    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51e9de67-8ad7-4421-90eb-467ab7c8fdc7" path="/var/lib/kubelet/pods/51e9de67-8ad7-4421-90eb-467ab7c8fdc7/volumes"
Jul 06 14:11:01.174761 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:01.174717    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"]
Jul 06 14:11:01.175378 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:01.175030    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t" podUID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" containerName="istio-proxy" containerID="cri-o://4872f5e940fe90674e45da4e915ccaedbf78d39fdf9424621c0629ac8660de13" gracePeriod=30
Jul 06 14:11:06.440858 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.440777    2573 generic.go:356] "Generic (PLEG): container finished" podID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" containerID="4872f5e940fe90674e45da4e915ccaedbf78d39fdf9424621c0629ac8660de13" exitCode=0
Jul 06 14:11:06.441292 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.440858    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t" event={"ID":"6f9c4374-4f01-43dd-a711-c9bca63fd94a","Type":"ContainerDied","Data":"4872f5e940fe90674e45da4e915ccaedbf78d39fdf9424621c0629ac8660de13"}
Jul 06 14:11:06.441292 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.440920    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t" event={"ID":"6f9c4374-4f01-43dd-a711-c9bca63fd94a","Type":"ContainerDied","Data":"c454d82a01abf029926263c7b34551779578150f79ac1a5bd18ccf3efd27dedf"}
Jul 06 14:11:06.441292 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.440935    2573 scope.go:117] "RemoveContainer" containerID="984cf6d346ff1b25183810821de4a4f8cdb87be3f72a6aaf45e8530597efd0bb"
Jul 06 14:11:06.441292 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.440944    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c454d82a01abf029926263c7b34551779578150f79ac1a5bd18ccf3efd27dedf"
Jul 06 14:11:06.444923 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.444902    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:11:06.569037 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.568998    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc7bd\" (UniqueName: \"kubernetes.io/projected/6f9c4374-4f01-43dd-a711-c9bca63fd94a-kube-api-access-zc7bd\") pod \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") "
Jul 06 14:11:06.569266 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.569106    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-workload-certs\") pod \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") "
Jul 06 14:11:06.569266 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.569126    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-envoy\") pod \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") "
Jul 06 14:11:06.569266 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.569220    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-podinfo\") pod \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") "
Jul 06 14:11:06.569447 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.569315    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-token\") pod \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") "
Jul 06 14:11:06.569447 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.569347    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-data\") pod \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") "
Jul 06 14:11:06.569447 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.569391    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f9c4374-4f01-43dd-a711-c9bca63fd94a" (UID: "6f9c4374-4f01-43dd-a711-c9bca63fd94a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:06.569447 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.569411    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istiod-ca-cert\") pod \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") "
Jul 06 14:11:06.570153 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.569451    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-workload-socket\") pod \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") "
Jul 06 14:11:06.570153 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.570081    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f9c4374-4f01-43dd-a711-c9bca63fd94a" (UID: "6f9c4374-4f01-43dd-a711-c9bca63fd94a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:06.570153 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.570150    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-credential-socket\") pod \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\" (UID: \"6f9c4374-4f01-43dd-a711-c9bca63fd94a\") "
Jul 06 14:11:06.570415 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.570157    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f9c4374-4f01-43dd-a711-c9bca63fd94a" (UID: "6f9c4374-4f01-43dd-a711-c9bca63fd94a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:11:06.570567 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.570531    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f9c4374-4f01-43dd-a711-c9bca63fd94a" (UID: "6f9c4374-4f01-43dd-a711-c9bca63fd94a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:06.571266 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.571084    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istiod-ca-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:06.571266 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.571112    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-workload-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:06.571266 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.571126    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-credential-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:06.571266 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.571143    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-workload-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:06.571730 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.571704    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f9c4374-4f01-43dd-a711-c9bca63fd94a" (UID: "6f9c4374-4f01-43dd-a711-c9bca63fd94a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:06.572492 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.572267    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f9c4374-4f01-43dd-a711-c9bca63fd94a" (UID: "6f9c4374-4f01-43dd-a711-c9bca63fd94a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:11:06.572492 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.572290    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f9c4374-4f01-43dd-a711-c9bca63fd94a" (UID: "6f9c4374-4f01-43dd-a711-c9bca63fd94a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:06.574114 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.572994    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f9c4374-4f01-43dd-a711-c9bca63fd94a" (UID: "6f9c4374-4f01-43dd-a711-c9bca63fd94a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:11:06.579161 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.578857    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f9c4374-4f01-43dd-a711-c9bca63fd94a-kube-api-access-zc7bd" (OuterVolumeSpecName: "kube-api-access-zc7bd") pod "6f9c4374-4f01-43dd-a711-c9bca63fd94a" (UID: "6f9c4374-4f01-43dd-a711-c9bca63fd94a"). InnerVolumeSpecName "kube-api-access-zc7bd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:11:06.672382 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.672335    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-podinfo\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:06.672382 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.672372    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-token\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:06.672382 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.672388    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-data\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:06.672636 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.672398    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc7bd\" (UniqueName: \"kubernetes.io/projected/6f9c4374-4f01-43dd-a711-c9bca63fd94a-kube-api-access-zc7bd\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:06.672636 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:06.672409    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f9c4374-4f01-43dd-a711-c9bca63fd94a-istio-envoy\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:07.447085 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:07.447042    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"
Jul 06 14:11:07.483402 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:07.483363    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"]
Jul 06 14:11:07.488967 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:07.488937    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-23d6fa-openshift-default-76bbffb769-mzb4t"]
Jul 06 14:11:08.826817 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:08.826777    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"]
Jul 06 14:11:08.827358 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:08.827075    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2" podUID="6cfe9306-e5e8-4e8b-b559-764b85596e91" containerName="istio-proxy" containerID="cri-o://49bace417d87d69a25a1befb7e2e7eed705f8468961b2a1525bdc9ff15447652" gracePeriod=30
Jul 06 14:11:09.314801 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.314758    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" path="/var/lib/kubelet/pods/6f9c4374-4f01-43dd-a711-c9bca63fd94a/volumes"
Jul 06 14:11:09.695606 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.695574    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"]
Jul 06 14:11:09.696252 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.696226    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" containerName="istio-proxy"
Jul 06 14:11:09.696252 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.696251    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" containerName="istio-proxy"
Jul 06 14:11:09.696438 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.696271    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51e9de67-8ad7-4421-90eb-467ab7c8fdc7" containerName="main"
Jul 06 14:11:09.696438 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.696278    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="51e9de67-8ad7-4421-90eb-467ab7c8fdc7" containerName="main"
Jul 06 14:11:09.696438 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.696300    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4fe2845-8b19-4455-8eb2-d39dd19886ab" containerName="maas-api"
Jul 06 14:11:09.696438 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.696307    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4fe2845-8b19-4455-8eb2-d39dd19886ab" containerName="maas-api"
Jul 06 14:11:09.696438 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.696393    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" containerName="istio-proxy"
Jul 06 14:11:09.696438 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.696400    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" containerName="istio-proxy"
Jul 06 14:11:09.696438 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.696407    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="51e9de67-8ad7-4421-90eb-467ab7c8fdc7" containerName="main"
Jul 06 14:11:09.696438 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.696416    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4fe2845-8b19-4455-8eb2-d39dd19886ab" containerName="maas-api"
Jul 06 14:11:09.700845 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.700824    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.703442 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.703419    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c711a5-openshift-default-dockercfg-46752\""
Jul 06 14:11:09.710972 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.710940    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"]
Jul 06 14:11:09.802362 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.802323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-workload-socket\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.802588 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.802432    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-workload-certs\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.802588 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.802487    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-data\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.802588 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.802553    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istiod-ca-cert\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.802758 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.802595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-envoy\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.802758 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.802624    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-credential-socket\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.802758 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.802655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgcf9\" (UniqueName: \"kubernetes.io/projected/d6a5c1db-0778-4f65-ad73-0b8d2383e498-kube-api-access-fgcf9\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.802861 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.802805    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-token\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.802902 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.802862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-podinfo\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.903611 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.903568    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-envoy\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.903611 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.903614    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-credential-socket\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.904257 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.903632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgcf9\" (UniqueName: \"kubernetes.io/projected/d6a5c1db-0778-4f65-ad73-0b8d2383e498-kube-api-access-fgcf9\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.904257 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.903692    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-token\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.904257 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.903722    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-podinfo\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.904257 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.903750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-workload-socket\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.904257 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.903790    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-workload-certs\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.904257 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.903827    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-data\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.904257 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.903882    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istiod-ca-cert\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.904257 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.904130    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-credential-socket\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.904257 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.904218    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-workload-socket\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.904620 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.904345    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-data\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.904620 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.904387    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-workload-certs\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.904698 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.904665    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istiod-ca-cert\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.906141 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.906116    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-envoy\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.906304 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.906287    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-podinfo\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.917576 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.917540    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgcf9\" (UniqueName: \"kubernetes.io/projected/d6a5c1db-0778-4f65-ad73-0b8d2383e498-kube-api-access-fgcf9\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:09.917739 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:09.917722    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-token\") pod \"e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") " pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:10.013234 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:10.013134    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:10.163689 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:10.163661    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"]
Jul 06 14:11:10.165903 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:11:10.165880    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a5c1db_0778_4f65_ad73_0b8d2383e498.slice/crio-ac30694b03b516611dbae8e13f30b404bcab0391b5d82d7c2802171a7c3ec332 WatchSource:0}: Error finding container ac30694b03b516611dbae8e13f30b404bcab0391b5d82d7c2802171a7c3ec332: Status 404 returned error can't find the container with id ac30694b03b516611dbae8e13f30b404bcab0391b5d82d7c2802171a7c3ec332
Jul 06 14:11:10.168164 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:10.168129    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:10.168242 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:10.168201    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:10.168242 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:10.168230    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:10.466449 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:10.466409    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj" event={"ID":"d6a5c1db-0778-4f65-ad73-0b8d2383e498","Type":"ContainerStarted","Data":"f93f87fc39818bc027ea86e61b203ec51ec8e9ae4def2b14b4070b6865409fe7"}
Jul 06 14:11:10.466676 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:10.466479    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj" event={"ID":"d6a5c1db-0778-4f65-ad73-0b8d2383e498","Type":"ContainerStarted","Data":"ac30694b03b516611dbae8e13f30b404bcab0391b5d82d7c2802171a7c3ec332"}
Jul 06 14:11:10.486527 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:10.486471    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj" podStartSLOduration=1.486452678 podStartE2EDuration="1.486452678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:11:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:11:10.485527036 +0000 UTC m=+1885.797090705" watchObservedRunningTime="2026-07-06 14:11:10.486452678 +0000 UTC m=+1885.798016397"
Jul 06 14:11:11.014260 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:11.014216    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:11.019614 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:11.019585    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:11.472835 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:11.472795    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:11.473846 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:11.473825    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:14.103955 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.103875    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:11:14.247114 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247039    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-envoy\") pod \"6cfe9306-e5e8-4e8b-b559-764b85596e91\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") "
Jul 06 14:11:14.247387 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247129    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe9306-e5e8-4e8b-b559-764b85596e91-istiod-ca-cert\") pod \"6cfe9306-e5e8-4e8b-b559-764b85596e91\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") "
Jul 06 14:11:14.247387 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247176    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-token\") pod \"6cfe9306-e5e8-4e8b-b559-764b85596e91\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") "
Jul 06 14:11:14.247387 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247203    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjl7r\" (UniqueName: \"kubernetes.io/projected/6cfe9306-e5e8-4e8b-b559-764b85596e91-kube-api-access-kjl7r\") pod \"6cfe9306-e5e8-4e8b-b559-764b85596e91\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") "
Jul 06 14:11:14.247387 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247245    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-data\") pod \"6cfe9306-e5e8-4e8b-b559-764b85596e91\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") "
Jul 06 14:11:14.247387 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247283    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-workload-certs\") pod \"6cfe9306-e5e8-4e8b-b559-764b85596e91\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") "
Jul 06 14:11:14.247387 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247344    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-podinfo\") pod \"6cfe9306-e5e8-4e8b-b559-764b85596e91\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") "
Jul 06 14:11:14.247715 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247414    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-credential-socket\") pod \"6cfe9306-e5e8-4e8b-b559-764b85596e91\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") "
Jul 06 14:11:14.247715 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247464    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-workload-socket\") pod \"6cfe9306-e5e8-4e8b-b559-764b85596e91\" (UID: \"6cfe9306-e5e8-4e8b-b559-764b85596e91\") "
Jul 06 14:11:14.247715 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247566    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cfe9306-e5e8-4e8b-b559-764b85596e91-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6cfe9306-e5e8-4e8b-b559-764b85596e91" (UID: "6cfe9306-e5e8-4e8b-b559-764b85596e91"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:11:14.247871 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247779    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6cfe9306-e5e8-4e8b-b559-764b85596e91" (UID: "6cfe9306-e5e8-4e8b-b559-764b85596e91"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:14.247954 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247899    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6cfe9306-e5e8-4e8b-b559-764b85596e91" (UID: "6cfe9306-e5e8-4e8b-b559-764b85596e91"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:14.247954 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247928    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-workload-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:14.247954 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247947    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe9306-e5e8-4e8b-b559-764b85596e91-istiod-ca-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:14.248116 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.247993    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6cfe9306-e5e8-4e8b-b559-764b85596e91" (UID: "6cfe9306-e5e8-4e8b-b559-764b85596e91"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:14.248116 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.248086    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-data" (OuterVolumeSpecName: "istio-data") pod "6cfe9306-e5e8-4e8b-b559-764b85596e91" (UID: "6cfe9306-e5e8-4e8b-b559-764b85596e91"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:14.249802 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.249780    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6cfe9306-e5e8-4e8b-b559-764b85596e91" (UID: "6cfe9306-e5e8-4e8b-b559-764b85596e91"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:14.249911 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.249889    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-token" (OuterVolumeSpecName: "istio-token") pod "6cfe9306-e5e8-4e8b-b559-764b85596e91" (UID: "6cfe9306-e5e8-4e8b-b559-764b85596e91"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:11:14.249979 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.249932    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cfe9306-e5e8-4e8b-b559-764b85596e91-kube-api-access-kjl7r" (OuterVolumeSpecName: "kube-api-access-kjl7r") pod "6cfe9306-e5e8-4e8b-b559-764b85596e91" (UID: "6cfe9306-e5e8-4e8b-b559-764b85596e91"). InnerVolumeSpecName "kube-api-access-kjl7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:11:14.250036 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.250000    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6cfe9306-e5e8-4e8b-b559-764b85596e91" (UID: "6cfe9306-e5e8-4e8b-b559-764b85596e91"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:11:14.348749 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.348704    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-data\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:14.348749 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.348740    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-workload-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:14.348749 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.348753    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-podinfo\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:14.349013 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.348764    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-credential-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:14.349013 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.348776    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-envoy\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:14.349013 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.348787    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe9306-e5e8-4e8b-b559-764b85596e91-istio-token\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:14.349013 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.348798    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjl7r\" (UniqueName: \"kubernetes.io/projected/6cfe9306-e5e8-4e8b-b559-764b85596e91-kube-api-access-kjl7r\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:14.490444 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.490347    2573 generic.go:356] "Generic (PLEG): container finished" podID="6cfe9306-e5e8-4e8b-b559-764b85596e91" containerID="49bace417d87d69a25a1befb7e2e7eed705f8468961b2a1525bdc9ff15447652" exitCode=0
Jul 06 14:11:14.490444 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.490398    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2" event={"ID":"6cfe9306-e5e8-4e8b-b559-764b85596e91","Type":"ContainerDied","Data":"49bace417d87d69a25a1befb7e2e7eed705f8468961b2a1525bdc9ff15447652"}
Jul 06 14:11:14.490444 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.490408    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"
Jul 06 14:11:14.490444 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.490443    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2" event={"ID":"6cfe9306-e5e8-4e8b-b559-764b85596e91","Type":"ContainerDied","Data":"1d1b3309388b8c971e378c7d9ee76c6e602c46df70aae39a3e7d3143aaa83399"}
Jul 06 14:11:14.490755 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.490464    2573 scope.go:117] "RemoveContainer" containerID="49bace417d87d69a25a1befb7e2e7eed705f8468961b2a1525bdc9ff15447652"
Jul 06 14:11:14.500192 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.500173    2573 scope.go:117] "RemoveContainer" containerID="9f4e2955d58bb4c0dea1133bcd1fd1d62b5584f8e1dd1ed2e24b041217531e75"
Jul 06 14:11:14.508800 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.508779    2573 scope.go:117] "RemoveContainer" containerID="49bace417d87d69a25a1befb7e2e7eed705f8468961b2a1525bdc9ff15447652"
Jul 06 14:11:14.509113 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:11:14.509093    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49bace417d87d69a25a1befb7e2e7eed705f8468961b2a1525bdc9ff15447652\": container with ID starting with 49bace417d87d69a25a1befb7e2e7eed705f8468961b2a1525bdc9ff15447652 not found: ID does not exist" containerID="49bace417d87d69a25a1befb7e2e7eed705f8468961b2a1525bdc9ff15447652"
Jul 06 14:11:14.509167 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.509126    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49bace417d87d69a25a1befb7e2e7eed705f8468961b2a1525bdc9ff15447652"} err="failed to get container status \"49bace417d87d69a25a1befb7e2e7eed705f8468961b2a1525bdc9ff15447652\": rpc error: code = NotFound desc = could not find container \"49bace417d87d69a25a1befb7e2e7eed705f8468961b2a1525bdc9ff15447652\": container with ID starting with 49bace417d87d69a25a1befb7e2e7eed705f8468961b2a1525bdc9ff15447652 not found: ID does not exist"
Jul 06 14:11:14.509167 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.509144    2573 scope.go:117] "RemoveContainer" containerID="9f4e2955d58bb4c0dea1133bcd1fd1d62b5584f8e1dd1ed2e24b041217531e75"
Jul 06 14:11:14.509396 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:11:14.509375    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f4e2955d58bb4c0dea1133bcd1fd1d62b5584f8e1dd1ed2e24b041217531e75\": container with ID starting with 9f4e2955d58bb4c0dea1133bcd1fd1d62b5584f8e1dd1ed2e24b041217531e75 not found: ID does not exist" containerID="9f4e2955d58bb4c0dea1133bcd1fd1d62b5584f8e1dd1ed2e24b041217531e75"
Jul 06 14:11:14.509455 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.509407    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f4e2955d58bb4c0dea1133bcd1fd1d62b5584f8e1dd1ed2e24b041217531e75"} err="failed to get container status \"9f4e2955d58bb4c0dea1133bcd1fd1d62b5584f8e1dd1ed2e24b041217531e75\": rpc error: code = NotFound desc = could not find container \"9f4e2955d58bb4c0dea1133bcd1fd1d62b5584f8e1dd1ed2e24b041217531e75\": container with ID starting with 9f4e2955d58bb4c0dea1133bcd1fd1d62b5584f8e1dd1ed2e24b041217531e75 not found: ID does not exist"
Jul 06 14:11:14.518520 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.518488    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"]
Jul 06 14:11:14.523537 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:14.523509    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-7e06f0-openshift-default-8579b8f79f-vmrz2"]
Jul 06 14:11:15.314746 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:15.314711    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cfe9306-e5e8-4e8b-b559-764b85596e91" path="/var/lib/kubelet/pods/6cfe9306-e5e8-4e8b-b559-764b85596e91/volumes"
Jul 06 14:11:17.793927 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.793844    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"]
Jul 06 14:11:17.794643 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.794617    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" containerName="istio-proxy"
Jul 06 14:11:17.794777 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.794644    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9c4374-4f01-43dd-a711-c9bca63fd94a" containerName="istio-proxy"
Jul 06 14:11:17.794841 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.794798    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cfe9306-e5e8-4e8b-b559-764b85596e91" containerName="istio-proxy"
Jul 06 14:11:17.794841 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.794810    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cfe9306-e5e8-4e8b-b559-764b85596e91" containerName="istio-proxy"
Jul 06 14:11:17.794841 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.794832    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cfe9306-e5e8-4e8b-b559-764b85596e91" containerName="istio-proxy"
Jul 06 14:11:17.794841 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.794840    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cfe9306-e5e8-4e8b-b559-764b85596e91" containerName="istio-proxy"
Jul 06 14:11:17.795004 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.794947    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cfe9306-e5e8-4e8b-b559-764b85596e91" containerName="istio-proxy"
Jul 06 14:11:17.795004 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.794959    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cfe9306-e5e8-4e8b-b559-764b85596e91" containerName="istio-proxy"
Jul 06 14:11:17.798138 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.798118    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.800979 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.800960    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-d5c8cc-openshift-default-dockercfg-hht6x\""
Jul 06 14:11:17.810447 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.810418    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"]
Jul 06 14:11:17.882176 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.882132    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-credential-socket\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.882176 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.882175    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46bc69ab-8dde-4b68-a011-ace53b5986ba-istiod-ca-cert\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.882412 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.882203    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-data\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.882412 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.882256    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-workload-socket\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.882412 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.882310    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-workload-certs\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.882412 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.882338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-token\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.882412 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.882369    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-envoy\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.882609 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.882481    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-podinfo\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.882609 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.882527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-457qs\" (UniqueName: \"kubernetes.io/projected/46bc69ab-8dde-4b68-a011-ace53b5986ba-kube-api-access-457qs\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.984037 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.983992    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-podinfo\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.984037 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.984042    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-457qs\" (UniqueName: \"kubernetes.io/projected/46bc69ab-8dde-4b68-a011-ace53b5986ba-kube-api-access-457qs\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.984372 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.984337    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-credential-socket\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.984419 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.984392    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46bc69ab-8dde-4b68-a011-ace53b5986ba-istiod-ca-cert\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.984456 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.984440    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-data\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.984500 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.984481    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-workload-socket\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.984557 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.984543    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-workload-certs\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.984596 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.984581    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-token\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.984728 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.984618    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-envoy\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.984798 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.984770    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-credential-socket\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.984858 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.984840    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-data\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.984950 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.984927    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-workload-certs\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.985015 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.984968    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-workload-socket\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.985154 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.985134    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46bc69ab-8dde-4b68-a011-ace53b5986ba-istiod-ca-cert\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.986920 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.986893    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-podinfo\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.987098 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.987047    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-envoy\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.994922 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.994892    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-token\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:17.995046 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:17.995026    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-457qs\" (UniqueName: \"kubernetes.io/projected/46bc69ab-8dde-4b68-a011-ace53b5986ba-kube-api-access-457qs\") pod \"e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") " pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:18.110406 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:18.110376    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:18.263989 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:18.263950    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"]
Jul 06 14:11:18.265562 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:11:18.265521    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46bc69ab_8dde_4b68_a011_ace53b5986ba.slice/crio-6494eb89d0c07b1f34b2e765e501037586cd17c37c8bef3d97f636a1ceabbe89 WatchSource:0}: Error finding container 6494eb89d0c07b1f34b2e765e501037586cd17c37c8bef3d97f636a1ceabbe89: Status 404 returned error can't find the container with id 6494eb89d0c07b1f34b2e765e501037586cd17c37c8bef3d97f636a1ceabbe89
Jul 06 14:11:18.268549 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:18.268502    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:18.268650 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:18.268598    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:18.268708 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:18.268647    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:18.514141 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:18.514019    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b" event={"ID":"46bc69ab-8dde-4b68-a011-ace53b5986ba","Type":"ContainerStarted","Data":"a39239128165c0736762d4f31dcd57e3cc884785800ceb05053ee2e9b1f9d233"}
Jul 06 14:11:18.514141 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:18.514110    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b" event={"ID":"46bc69ab-8dde-4b68-a011-ace53b5986ba","Type":"ContainerStarted","Data":"6494eb89d0c07b1f34b2e765e501037586cd17c37c8bef3d97f636a1ceabbe89"}
Jul 06 14:11:18.534311 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:18.534262    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b" podStartSLOduration=1.5342456150000001 podStartE2EDuration="1.534245615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:11:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:11:18.5333203 +0000 UTC m=+1893.844883971" watchObservedRunningTime="2026-07-06 14:11:18.534245615 +0000 UTC m=+1893.845809282"
Jul 06 14:11:19.111265 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:19.111231    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:19.116624 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:19.116598    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:19.519634 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:19.519550    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:19.520462 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:19.520445    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:26.474869 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:26.474831    2573 patch_prober.go:28] interesting pod/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 06 14:11:26.475339 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:26.474891    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj" podUID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 06 14:11:26.564975 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:26.564939    2573 generic.go:356] "Generic (PLEG): container finished" podID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" containerID="f93f87fc39818bc027ea86e61b203ec51ec8e9ae4def2b14b4070b6865409fe7" exitCode=0
Jul 06 14:11:26.565174 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:26.565014    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj" event={"ID":"d6a5c1db-0778-4f65-ad73-0b8d2383e498","Type":"ContainerDied","Data":"f93f87fc39818bc027ea86e61b203ec51ec8e9ae4def2b14b4070b6865409fe7"}
Jul 06 14:11:26.565466 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:26.565452    2573 scope.go:117] "RemoveContainer" containerID="f93f87fc39818bc027ea86e61b203ec51ec8e9ae4def2b14b4070b6865409fe7"
Jul 06 14:11:26.566557 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:26.566525    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:26.566662 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:26.566614    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:26.566726 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:26.566665    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:27.573223 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:27.573186    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj" event={"ID":"d6a5c1db-0778-4f65-ad73-0b8d2383e498","Type":"ContainerStarted","Data":"d8576e3c6ef88278a9ba88025edcfd967e3be96ac792fd6d73cc8b4aeb475542"}
Jul 06 14:11:28.013472 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:28.013433    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:28.013672 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:28.013646    2573 patch_prober.go:28] interesting pod/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 06 14:11:28.013718 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:28.013695    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj" podUID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 06 14:11:29.013695 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:29.013647    2573 patch_prober.go:28] interesting pod/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 06 14:11:29.014160 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:29.013706    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj" podUID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 06 14:11:30.014041 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:30.013988    2573 patch_prober.go:28] interesting pod/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 06 14:11:30.014476 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:30.014074    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj" podUID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 06 14:11:31.014541 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:31.014500    2573 patch_prober.go:28] interesting pod/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 06 14:11:31.014951 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:31.014573    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj" podUID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 06 14:11:32.017939 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:32.017907    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:32.018480 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:32.018305    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:32.018902 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:32.018883    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:35.561295 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:35.561245    2573 patch_prober.go:28] interesting pod/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 14:11:35.561885 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:35.561317    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b" podUID="46bc69ab-8dde-4b68-a011-ace53b5986ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 14:11:36.634091 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:36.634036    2573 generic.go:356] "Generic (PLEG): container finished" podID="46bc69ab-8dde-4b68-a011-ace53b5986ba" containerID="a39239128165c0736762d4f31dcd57e3cc884785800ceb05053ee2e9b1f9d233" exitCode=0
Jul 06 14:11:36.634541 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:36.634120    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b" event={"ID":"46bc69ab-8dde-4b68-a011-ace53b5986ba","Type":"ContainerDied","Data":"a39239128165c0736762d4f31dcd57e3cc884785800ceb05053ee2e9b1f9d233"}
Jul 06 14:11:36.634615 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:36.634600    2573 scope.go:117] "RemoveContainer" containerID="a39239128165c0736762d4f31dcd57e3cc884785800ceb05053ee2e9b1f9d233"
Jul 06 14:11:36.635585 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:36.635559    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:36.635633 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:36.635625    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:36.635671 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:36.635656    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:37.644436 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:37.644399    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b" event={"ID":"46bc69ab-8dde-4b68-a011-ace53b5986ba","Type":"ContainerStarted","Data":"d34b2bbd4e12e1f20466d069bac8dd23bbb5f5c25d3a31e2103eb4cd27ded933"}
Jul 06 14:11:38.111012 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:38.110973    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:38.111266 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:38.111245    2573 patch_prober.go:28] interesting pod/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 06 14:11:38.111321 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:38.111302    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b" podUID="46bc69ab-8dde-4b68-a011-ace53b5986ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 06 14:11:39.111446 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:39.111406    2573 patch_prober.go:28] interesting pod/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 06 14:11:39.111891 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:39.111472    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b" podUID="46bc69ab-8dde-4b68-a011-ace53b5986ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 06 14:11:40.111478 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:40.111436    2573 patch_prober.go:28] interesting pod/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 06 14:11:40.111896 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:40.111496    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b" podUID="46bc69ab-8dde-4b68-a011-ace53b5986ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 06 14:11:40.377191 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:40.377086    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"]
Jul 06 14:11:40.377414 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:40.377384    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj" podUID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" containerName="istio-proxy" containerID="cri-o://d8576e3c6ef88278a9ba88025edcfd967e3be96ac792fd6d73cc8b4aeb475542" gracePeriod=30
Jul 06 14:11:41.111747 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:41.111705    2573 patch_prober.go:28] interesting pod/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 06 14:11:41.112208 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:41.111794    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b" podUID="46bc69ab-8dde-4b68-a011-ace53b5986ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 06 14:11:42.115032 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:42.115001    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:42.115447 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:42.115311    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:42.115998 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:42.115978    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:45.651111 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.651035    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:45.703652 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.703615    2573 generic.go:356] "Generic (PLEG): container finished" podID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" containerID="d8576e3c6ef88278a9ba88025edcfd967e3be96ac792fd6d73cc8b4aeb475542" exitCode=0
Jul 06 14:11:45.703861 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.703692    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"
Jul 06 14:11:45.703861 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.703698    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj" event={"ID":"d6a5c1db-0778-4f65-ad73-0b8d2383e498","Type":"ContainerDied","Data":"d8576e3c6ef88278a9ba88025edcfd967e3be96ac792fd6d73cc8b4aeb475542"}
Jul 06 14:11:45.703861 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.703771    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj" event={"ID":"d6a5c1db-0778-4f65-ad73-0b8d2383e498","Type":"ContainerDied","Data":"ac30694b03b516611dbae8e13f30b404bcab0391b5d82d7c2802171a7c3ec332"}
Jul 06 14:11:45.703861 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.703804    2573 scope.go:117] "RemoveContainer" containerID="d8576e3c6ef88278a9ba88025edcfd967e3be96ac792fd6d73cc8b4aeb475542"
Jul 06 14:11:45.715421 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.715400    2573 scope.go:117] "RemoveContainer" containerID="f93f87fc39818bc027ea86e61b203ec51ec8e9ae4def2b14b4070b6865409fe7"
Jul 06 14:11:45.725197 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.725172    2573 scope.go:117] "RemoveContainer" containerID="d8576e3c6ef88278a9ba88025edcfd967e3be96ac792fd6d73cc8b4aeb475542"
Jul 06 14:11:45.725530 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:11:45.725510    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8576e3c6ef88278a9ba88025edcfd967e3be96ac792fd6d73cc8b4aeb475542\": container with ID starting with d8576e3c6ef88278a9ba88025edcfd967e3be96ac792fd6d73cc8b4aeb475542 not found: ID does not exist" containerID="d8576e3c6ef88278a9ba88025edcfd967e3be96ac792fd6d73cc8b4aeb475542"
Jul 06 14:11:45.725582 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.725541    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8576e3c6ef88278a9ba88025edcfd967e3be96ac792fd6d73cc8b4aeb475542"} err="failed to get container status \"d8576e3c6ef88278a9ba88025edcfd967e3be96ac792fd6d73cc8b4aeb475542\": rpc error: code = NotFound desc = could not find container \"d8576e3c6ef88278a9ba88025edcfd967e3be96ac792fd6d73cc8b4aeb475542\": container with ID starting with d8576e3c6ef88278a9ba88025edcfd967e3be96ac792fd6d73cc8b4aeb475542 not found: ID does not exist"
Jul 06 14:11:45.725582 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.725576    2573 scope.go:117] "RemoveContainer" containerID="f93f87fc39818bc027ea86e61b203ec51ec8e9ae4def2b14b4070b6865409fe7"
Jul 06 14:11:45.725840 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:11:45.725824    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f93f87fc39818bc027ea86e61b203ec51ec8e9ae4def2b14b4070b6865409fe7\": container with ID starting with f93f87fc39818bc027ea86e61b203ec51ec8e9ae4def2b14b4070b6865409fe7 not found: ID does not exist" containerID="f93f87fc39818bc027ea86e61b203ec51ec8e9ae4def2b14b4070b6865409fe7"
Jul 06 14:11:45.725888 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.725846    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f93f87fc39818bc027ea86e61b203ec51ec8e9ae4def2b14b4070b6865409fe7"} err="failed to get container status \"f93f87fc39818bc027ea86e61b203ec51ec8e9ae4def2b14b4070b6865409fe7\": rpc error: code = NotFound desc = could not find container \"f93f87fc39818bc027ea86e61b203ec51ec8e9ae4def2b14b4070b6865409fe7\": container with ID starting with f93f87fc39818bc027ea86e61b203ec51ec8e9ae4def2b14b4070b6865409fe7 not found: ID does not exist"
Jul 06 14:11:45.769815 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.769787    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-token\") pod \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") "
Jul 06 14:11:45.770012 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.769838    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istiod-ca-cert\") pod \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") "
Jul 06 14:11:45.770012 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.769872    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-podinfo\") pod \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") "
Jul 06 14:11:45.770012 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.769902    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-workload-certs\") pod \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") "
Jul 06 14:11:45.770012 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.769937    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-data\") pod \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") "
Jul 06 14:11:45.770274 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.770016    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-credential-socket\") pod \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") "
Jul 06 14:11:45.770274 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.770075    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-workload-socket\") pod \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") "
Jul 06 14:11:45.770274 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.770114    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgcf9\" (UniqueName: \"kubernetes.io/projected/d6a5c1db-0778-4f65-ad73-0b8d2383e498-kube-api-access-fgcf9\") pod \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") "
Jul 06 14:11:45.770274 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.770141    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-envoy\") pod \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\" (UID: \"d6a5c1db-0778-4f65-ad73-0b8d2383e498\") "
Jul 06 14:11:45.770431 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.770283    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d6a5c1db-0778-4f65-ad73-0b8d2383e498" (UID: "d6a5c1db-0778-4f65-ad73-0b8d2383e498"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:11:45.770504 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.770425    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d6a5c1db-0778-4f65-ad73-0b8d2383e498" (UID: "d6a5c1db-0778-4f65-ad73-0b8d2383e498"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:45.770557 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.770514    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-workload-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:45.770557 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.770520    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d6a5c1db-0778-4f65-ad73-0b8d2383e498" (UID: "d6a5c1db-0778-4f65-ad73-0b8d2383e498"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:45.770557 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.770534    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istiod-ca-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:45.771014 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.770990    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d6a5c1db-0778-4f65-ad73-0b8d2383e498" (UID: "d6a5c1db-0778-4f65-ad73-0b8d2383e498"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:45.771295 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.771271    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-data" (OuterVolumeSpecName: "istio-data") pod "d6a5c1db-0778-4f65-ad73-0b8d2383e498" (UID: "d6a5c1db-0778-4f65-ad73-0b8d2383e498"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:45.772486 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.772460    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-token" (OuterVolumeSpecName: "istio-token") pod "d6a5c1db-0778-4f65-ad73-0b8d2383e498" (UID: "d6a5c1db-0778-4f65-ad73-0b8d2383e498"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:11:45.772654 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.772632    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d6a5c1db-0778-4f65-ad73-0b8d2383e498" (UID: "d6a5c1db-0778-4f65-ad73-0b8d2383e498"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:11:45.772829 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.772804    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a5c1db-0778-4f65-ad73-0b8d2383e498-kube-api-access-fgcf9" (OuterVolumeSpecName: "kube-api-access-fgcf9") pod "d6a5c1db-0778-4f65-ad73-0b8d2383e498" (UID: "d6a5c1db-0778-4f65-ad73-0b8d2383e498"). InnerVolumeSpecName "kube-api-access-fgcf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:11:45.772938 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.772889    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d6a5c1db-0778-4f65-ad73-0b8d2383e498" (UID: "d6a5c1db-0778-4f65-ad73-0b8d2383e498"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:45.871948 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.871914    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-workload-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:45.871948 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.871943    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-data\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:45.871948 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.871952    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-credential-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:45.872219 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.871962    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgcf9\" (UniqueName: \"kubernetes.io/projected/d6a5c1db-0778-4f65-ad73-0b8d2383e498-kube-api-access-fgcf9\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:45.872219 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.871971    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-envoy\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:45.872219 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.871979    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-token\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:45.872219 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:45.871988    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6a5c1db-0778-4f65-ad73-0b8d2383e498-istio-podinfo\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:46.028198 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:46.028142    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"]
Jul 06 14:11:46.032386 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:46.032343    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c711a5-openshift-default-69847b984c-2wnqj"]
Jul 06 14:11:47.314150 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:47.314114    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" path="/var/lib/kubelet/pods/d6a5c1db-0778-4f65-ad73-0b8d2383e498/volumes"
Jul 06 14:11:47.986504 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:47.986466    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"]
Jul 06 14:11:47.986726 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:47.986674    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b" podUID="46bc69ab-8dde-4b68-a011-ace53b5986ba" containerName="istio-proxy" containerID="cri-o://d34b2bbd4e12e1f20466d069bac8dd23bbb5f5c25d3a31e2103eb4cd27ded933" gracePeriod=30
Jul 06 14:11:48.937945 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:48.937902    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"]
Jul 06 14:11:48.938581 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:48.938553    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" containerName="istio-proxy"
Jul 06 14:11:48.938581 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:48.938582    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" containerName="istio-proxy"
Jul 06 14:11:48.938743 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:48.938614    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" containerName="istio-proxy"
Jul 06 14:11:48.938743 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:48.938623    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" containerName="istio-proxy"
Jul 06 14:11:48.938743 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:48.938735    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" containerName="istio-proxy"
Jul 06 14:11:48.938854 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:48.938747    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a5c1db-0778-4f65-ad73-0b8d2383e498" containerName="istio-proxy"
Jul 06 14:11:48.941190 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:48.941167    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:48.943865 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:48.943839    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-973328-openshift-default-dockercfg-257bz\""
Jul 06 14:11:48.953487 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:48.953459    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"]
Jul 06 14:11:49.002008 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.001964    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-workload-certs\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.002221 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.002021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96a05619-099f-4851-b439-26039b18cf31-istio-podinfo\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.002221 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.002155    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-istio-envoy\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.002221 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.002212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96a05619-099f-4851-b439-26039b18cf31-istio-token\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.002329 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.002260    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-workload-socket\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.002329 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.002279    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96a05619-099f-4851-b439-26039b18cf31-istiod-ca-cert\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.002401 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.002345    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-istio-data\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.002401 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.002391    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-credential-socket\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.002467 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.002415    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg42j\" (UniqueName: \"kubernetes.io/projected/96a05619-099f-4851-b439-26039b18cf31-kube-api-access-zg42j\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.103760 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.103709    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-credential-socket\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.103973 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.103765    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg42j\" (UniqueName: \"kubernetes.io/projected/96a05619-099f-4851-b439-26039b18cf31-kube-api-access-zg42j\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.103973 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.103822    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-workload-certs\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.103973 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.103855    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96a05619-099f-4851-b439-26039b18cf31-istio-podinfo\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.103973 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.103894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-istio-envoy\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.103973 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.103929    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96a05619-099f-4851-b439-26039b18cf31-istio-token\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.103973 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.103958    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-workload-socket\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.104321 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.103982    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96a05619-099f-4851-b439-26039b18cf31-istiod-ca-cert\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.104321 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.104033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-istio-data\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.104321 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.104264    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-workload-certs\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.104495 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.104434    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-istio-data\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.104495 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.104463    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-workload-socket\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.104581 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.104525    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-credential-socket\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.104970 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.104951    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96a05619-099f-4851-b439-26039b18cf31-istiod-ca-cert\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.106833 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.106805    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-istio-envoy\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.107092 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.107037    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96a05619-099f-4851-b439-26039b18cf31-istio-podinfo\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.112444 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.112410    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96a05619-099f-4851-b439-26039b18cf31-istio-token\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.112593 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.112516    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg42j\" (UniqueName: \"kubernetes.io/projected/96a05619-099f-4851-b439-26039b18cf31-kube-api-access-zg42j\") pod \"e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") " pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.252936 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.252824    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:49.431545 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.431517    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"]
Jul 06 14:11:49.434376 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:11:49.434344    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a05619_099f_4851_b439_26039b18cf31.slice/crio-91f34b7eb72bc49cdd640624f7efb125c24538557d3a47fe977fb597c86e68bb WatchSource:0}: Error finding container 91f34b7eb72bc49cdd640624f7efb125c24538557d3a47fe977fb597c86e68bb: Status 404 returned error can't find the container with id 91f34b7eb72bc49cdd640624f7efb125c24538557d3a47fe977fb597c86e68bb
Jul 06 14:11:49.436715 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.436667    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:49.436807 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.436772    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:49.436855 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.436819    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:49.730520 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.730480    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp" event={"ID":"96a05619-099f-4851-b439-26039b18cf31","Type":"ContainerStarted","Data":"90d8f3048e903480ea307a1d6c57dc4088abdddbaff52395de5bf23fe026acf8"}
Jul 06 14:11:49.730724 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.730589    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp" event={"ID":"96a05619-099f-4851-b439-26039b18cf31","Type":"ContainerStarted","Data":"91f34b7eb72bc49cdd640624f7efb125c24538557d3a47fe977fb597c86e68bb"}
Jul 06 14:11:49.760132 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:49.760045    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp" podStartSLOduration=1.760020894 podStartE2EDuration="1.760020894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:11:49.756922756 +0000 UTC m=+1925.068486422" watchObservedRunningTime="2026-07-06 14:11:49.760020894 +0000 UTC m=+1925.071584564"
Jul 06 14:11:50.253915 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:50.253850    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:50.259603 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:50.259571    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:50.736012 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:50.735977    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:50.736970 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:50.736948    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:11:53.266486 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.266458    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:53.347765 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.347727    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-workload-certs\") pod \"46bc69ab-8dde-4b68-a011-ace53b5986ba\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") "
Jul 06 14:11:53.347765 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.347766    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-457qs\" (UniqueName: \"kubernetes.io/projected/46bc69ab-8dde-4b68-a011-ace53b5986ba-kube-api-access-457qs\") pod \"46bc69ab-8dde-4b68-a011-ace53b5986ba\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") "
Jul 06 14:11:53.348034 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.347801    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-data\") pod \"46bc69ab-8dde-4b68-a011-ace53b5986ba\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") "
Jul 06 14:11:53.348034 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.347832    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-workload-socket\") pod \"46bc69ab-8dde-4b68-a011-ace53b5986ba\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") "
Jul 06 14:11:53.348034 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.347885    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-token\") pod \"46bc69ab-8dde-4b68-a011-ace53b5986ba\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") "
Jul 06 14:11:53.348034 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.347908    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-credential-socket\") pod \"46bc69ab-8dde-4b68-a011-ace53b5986ba\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") "
Jul 06 14:11:53.348034 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.347934    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46bc69ab-8dde-4b68-a011-ace53b5986ba-istiod-ca-cert\") pod \"46bc69ab-8dde-4b68-a011-ace53b5986ba\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") "
Jul 06 14:11:53.348034 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.347961    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-envoy\") pod \"46bc69ab-8dde-4b68-a011-ace53b5986ba\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") "
Jul 06 14:11:53.348411 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.348097    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-podinfo\") pod \"46bc69ab-8dde-4b68-a011-ace53b5986ba\" (UID: \"46bc69ab-8dde-4b68-a011-ace53b5986ba\") "
Jul 06 14:11:53.348411 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.348102    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "46bc69ab-8dde-4b68-a011-ace53b5986ba" (UID: "46bc69ab-8dde-4b68-a011-ace53b5986ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:53.348411 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.348384    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46bc69ab-8dde-4b68-a011-ace53b5986ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "46bc69ab-8dde-4b68-a011-ace53b5986ba" (UID: "46bc69ab-8dde-4b68-a011-ace53b5986ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:11:53.348564 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.348508    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-workload-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:53.348564 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.348526    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46bc69ab-8dde-4b68-a011-ace53b5986ba-istiod-ca-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:53.348756 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.348731    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "46bc69ab-8dde-4b68-a011-ace53b5986ba" (UID: "46bc69ab-8dde-4b68-a011-ace53b5986ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:53.348923 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.348904    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "46bc69ab-8dde-4b68-a011-ace53b5986ba" (UID: "46bc69ab-8dde-4b68-a011-ace53b5986ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:53.349012 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.348938    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "46bc69ab-8dde-4b68-a011-ace53b5986ba" (UID: "46bc69ab-8dde-4b68-a011-ace53b5986ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:53.350266 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.350235    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "46bc69ab-8dde-4b68-a011-ace53b5986ba" (UID: "46bc69ab-8dde-4b68-a011-ace53b5986ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:11:53.350379 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.350322    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46bc69ab-8dde-4b68-a011-ace53b5986ba-kube-api-access-457qs" (OuterVolumeSpecName: "kube-api-access-457qs") pod "46bc69ab-8dde-4b68-a011-ace53b5986ba" (UID: "46bc69ab-8dde-4b68-a011-ace53b5986ba"). InnerVolumeSpecName "kube-api-access-457qs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:11:53.350496 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.350475    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "46bc69ab-8dde-4b68-a011-ace53b5986ba" (UID: "46bc69ab-8dde-4b68-a011-ace53b5986ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:11:53.350622 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.350606    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "46bc69ab-8dde-4b68-a011-ace53b5986ba" (UID: "46bc69ab-8dde-4b68-a011-ace53b5986ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:11:53.449372 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.449331    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-token\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:53.449372 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.449363    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-credential-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:53.449372 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.449373    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-envoy\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:53.449372 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.449382    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-podinfo\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:53.449639 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.449392    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-457qs\" (UniqueName: \"kubernetes.io/projected/46bc69ab-8dde-4b68-a011-ace53b5986ba-kube-api-access-457qs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:53.449639 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.449401    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-istio-data\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:53.449639 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.449409    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46bc69ab-8dde-4b68-a011-ace53b5986ba-workload-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:11:53.752494 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.752457    2573 generic.go:356] "Generic (PLEG): container finished" podID="46bc69ab-8dde-4b68-a011-ace53b5986ba" containerID="d34b2bbd4e12e1f20466d069bac8dd23bbb5f5c25d3a31e2103eb4cd27ded933" exitCode=0
Jul 06 14:11:53.752699 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.752510    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"
Jul 06 14:11:53.752699 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.752537    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b" event={"ID":"46bc69ab-8dde-4b68-a011-ace53b5986ba","Type":"ContainerDied","Data":"d34b2bbd4e12e1f20466d069bac8dd23bbb5f5c25d3a31e2103eb4cd27ded933"}
Jul 06 14:11:53.752699 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.752589    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b" event={"ID":"46bc69ab-8dde-4b68-a011-ace53b5986ba","Type":"ContainerDied","Data":"6494eb89d0c07b1f34b2e765e501037586cd17c37c8bef3d97f636a1ceabbe89"}
Jul 06 14:11:53.752699 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.752611    2573 scope.go:117] "RemoveContainer" containerID="d34b2bbd4e12e1f20466d069bac8dd23bbb5f5c25d3a31e2103eb4cd27ded933"
Jul 06 14:11:53.763004 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.762983    2573 scope.go:117] "RemoveContainer" containerID="a39239128165c0736762d4f31dcd57e3cc884785800ceb05053ee2e9b1f9d233"
Jul 06 14:11:53.772109 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.772084    2573 scope.go:117] "RemoveContainer" containerID="d34b2bbd4e12e1f20466d069bac8dd23bbb5f5c25d3a31e2103eb4cd27ded933"
Jul 06 14:11:53.772426 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:11:53.772406    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d34b2bbd4e12e1f20466d069bac8dd23bbb5f5c25d3a31e2103eb4cd27ded933\": container with ID starting with d34b2bbd4e12e1f20466d069bac8dd23bbb5f5c25d3a31e2103eb4cd27ded933 not found: ID does not exist" containerID="d34b2bbd4e12e1f20466d069bac8dd23bbb5f5c25d3a31e2103eb4cd27ded933"
Jul 06 14:11:53.772494 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.772436    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d34b2bbd4e12e1f20466d069bac8dd23bbb5f5c25d3a31e2103eb4cd27ded933"} err="failed to get container status \"d34b2bbd4e12e1f20466d069bac8dd23bbb5f5c25d3a31e2103eb4cd27ded933\": rpc error: code = NotFound desc = could not find container \"d34b2bbd4e12e1f20466d069bac8dd23bbb5f5c25d3a31e2103eb4cd27ded933\": container with ID starting with d34b2bbd4e12e1f20466d069bac8dd23bbb5f5c25d3a31e2103eb4cd27ded933 not found: ID does not exist"
Jul 06 14:11:53.772494 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.772454    2573 scope.go:117] "RemoveContainer" containerID="a39239128165c0736762d4f31dcd57e3cc884785800ceb05053ee2e9b1f9d233"
Jul 06 14:11:53.772704 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:11:53.772684    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a39239128165c0736762d4f31dcd57e3cc884785800ceb05053ee2e9b1f9d233\": container with ID starting with a39239128165c0736762d4f31dcd57e3cc884785800ceb05053ee2e9b1f9d233 not found: ID does not exist" containerID="a39239128165c0736762d4f31dcd57e3cc884785800ceb05053ee2e9b1f9d233"
Jul 06 14:11:53.772757 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.772716    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a39239128165c0736762d4f31dcd57e3cc884785800ceb05053ee2e9b1f9d233"} err="failed to get container status \"a39239128165c0736762d4f31dcd57e3cc884785800ceb05053ee2e9b1f9d233\": rpc error: code = NotFound desc = could not find container \"a39239128165c0736762d4f31dcd57e3cc884785800ceb05053ee2e9b1f9d233\": container with ID starting with a39239128165c0736762d4f31dcd57e3cc884785800ceb05053ee2e9b1f9d233 not found: ID does not exist"
Jul 06 14:11:53.776618 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.776587    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"]
Jul 06 14:11:53.783425 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:53.783388    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-d5c8cc-openshift-default-77964f5c69-r795b"]
Jul 06 14:11:55.315506 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:55.315460    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46bc69ab-8dde-4b68-a011-ace53b5986ba" path="/var/lib/kubelet/pods/46bc69ab-8dde-4b68-a011-ace53b5986ba/volumes"
Jul 06 14:11:57.058899 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.058863    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"]
Jul 06 14:11:57.059508 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.059489    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46bc69ab-8dde-4b68-a011-ace53b5986ba" containerName="istio-proxy"
Jul 06 14:11:57.059608 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.059509    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="46bc69ab-8dde-4b68-a011-ace53b5986ba" containerName="istio-proxy"
Jul 06 14:11:57.059608 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.059542    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46bc69ab-8dde-4b68-a011-ace53b5986ba" containerName="istio-proxy"
Jul 06 14:11:57.059608 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.059551    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="46bc69ab-8dde-4b68-a011-ace53b5986ba" containerName="istio-proxy"
Jul 06 14:11:57.059770 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.059715    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="46bc69ab-8dde-4b68-a011-ace53b5986ba" containerName="istio-proxy"
Jul 06 14:11:57.059770 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.059731    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="46bc69ab-8dde-4b68-a011-ace53b5986ba" containerName="istio-proxy"
Jul 06 14:11:57.062790 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.062768    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.065383 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.065360    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-35c041-openshift-default-dockercfg-9cgkg\""
Jul 06 14:11:57.074902 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.074877    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"]
Jul 06 14:11:57.185485 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.185443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-workload-certs\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.185681 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.185510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-workload-socket\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.185681 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.185546    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-data\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.185681 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.185581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-credential-socket\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.185681 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.185607    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istiod-ca-cert\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.185853 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.185699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-podinfo\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.185853 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.185727    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-envoy\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.185853 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.185758    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khfwk\" (UniqueName: \"kubernetes.io/projected/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-kube-api-access-khfwk\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.185853 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.185823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-token\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.286990 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.286948    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-workload-socket\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.286990 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.286994    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-data\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.287297 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.287025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-credential-socket\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.287297 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.287084    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istiod-ca-cert\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.287297 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.287159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-podinfo\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.287462 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.287297    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-envoy\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.287462 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.287359    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khfwk\" (UniqueName: \"kubernetes.io/projected/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-kube-api-access-khfwk\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.287462 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.287401    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-token\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.287621 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.287465    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-workload-certs\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.287621 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.287505    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-workload-socket\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.287621 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.287526    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-credential-socket\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.288031 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.288007    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-workload-certs\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.288151 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.288045    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-data\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.288219 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.288148    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istiod-ca-cert\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.289700 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.289676    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-envoy\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.289844 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.289826    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-podinfo\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.295837 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.295813    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-token\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.295942 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.295882    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khfwk\" (UniqueName: \"kubernetes.io/projected/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-kube-api-access-khfwk\") pod \"e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") " pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.375140 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.375089    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:57.540618 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.540584    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"]
Jul 06 14:11:57.551884 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.551843    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:57.552003 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.551934    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:57.552003 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.551971    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:11:57.554189 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:11:57.554155    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f8ce10_1b6c_47f5_b248_db862cef4c2a.slice/crio-b38c0d6120e5417a46ae8e881244169462dc75979cbf0260604a81877e4299b9 WatchSource:0}: Error finding container b38c0d6120e5417a46ae8e881244169462dc75979cbf0260604a81877e4299b9: Status 404 returned error can't find the container with id b38c0d6120e5417a46ae8e881244169462dc75979cbf0260604a81877e4299b9
Jul 06 14:11:57.782044 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.782007    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c" event={"ID":"e6f8ce10-1b6c-47f5-b248-db862cef4c2a","Type":"ContainerStarted","Data":"7efad2c9fb325206e60fc2f5ad9902e9f124557ba213ae1ff6b6fdd1368e2725"}
Jul 06 14:11:57.782232 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.782087    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c" event={"ID":"e6f8ce10-1b6c-47f5-b248-db862cef4c2a","Type":"ContainerStarted","Data":"b38c0d6120e5417a46ae8e881244169462dc75979cbf0260604a81877e4299b9"}
Jul 06 14:11:57.803543 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:57.803485    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c" podStartSLOduration=0.803466643 podStartE2EDuration="803.466643ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:11:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:11:57.802678302 +0000 UTC m=+1933.114241994" watchObservedRunningTime="2026-07-06 14:11:57.803466643 +0000 UTC m=+1933.115030310"
Jul 06 14:11:58.375450 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:58.375410    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:58.380713 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:58.380682    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:58.794142 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:58.792123    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:11:58.796766 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:11:58.796734    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:12:04.826935 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:04.826831    2573 generic.go:356] "Generic (PLEG): container finished" podID="96a05619-099f-4851-b439-26039b18cf31" containerID="90d8f3048e903480ea307a1d6c57dc4088abdddbaff52395de5bf23fe026acf8" exitCode=0
Jul 06 14:12:04.826935 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:04.826913    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp" event={"ID":"96a05619-099f-4851-b439-26039b18cf31","Type":"ContainerDied","Data":"90d8f3048e903480ea307a1d6c57dc4088abdddbaff52395de5bf23fe026acf8"}
Jul 06 14:12:04.827422 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:04.827408    2573 scope.go:117] "RemoveContainer" containerID="90d8f3048e903480ea307a1d6c57dc4088abdddbaff52395de5bf23fe026acf8"
Jul 06 14:12:04.828449 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:04.828420    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:12:04.828546 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:04.828494    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:12:04.828597 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:04.828552    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:12:05.736766 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:05.736725    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:12:05.834643 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:05.834602    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp" event={"ID":"96a05619-099f-4851-b439-26039b18cf31","Type":"ContainerStarted","Data":"897f746eb2689a27f04e25ddb3b5c1d0376d78471473fa33088a3109b1c6eadb"}
Jul 06 14:12:06.253250 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:06.253210    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:12:06.254944 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:06.254908    2573 patch_prober.go:28] interesting pod/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 06 14:12:06.255140 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:06.254985    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp" podUID="96a05619-099f-4851-b439-26039b18cf31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 06 14:12:07.254093 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:07.254030    2573 patch_prober.go:28] interesting pod/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 06 14:12:07.254713 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:07.254678    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp" podUID="96a05619-099f-4851-b439-26039b18cf31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 06 14:12:08.253748 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:08.253700    2573 patch_prober.go:28] interesting pod/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 06 14:12:08.254109 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:08.253774    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp" podUID="96a05619-099f-4851-b439-26039b18cf31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 06 14:12:09.254134 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:09.254090    2573 patch_prober.go:28] interesting pod/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 06 14:12:09.254673 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:09.254163    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp" podUID="96a05619-099f-4851-b439-26039b18cf31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 06 14:12:10.271935 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:10.271892    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:12:10.272470 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:10.272187    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:12:10.272979 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:10.272957    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:12:13.794256 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:13.794163    2573 patch_prober.go:28] interesting pod/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 06 14:12:13.794256 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:13.794234    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c" podUID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 06 14:12:13.896391 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:13.896347    2573 generic.go:356] "Generic (PLEG): container finished" podID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" containerID="7efad2c9fb325206e60fc2f5ad9902e9f124557ba213ae1ff6b6fdd1368e2725" exitCode=0
Jul 06 14:12:13.896572 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:13.896425    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c" event={"ID":"e6f8ce10-1b6c-47f5-b248-db862cef4c2a","Type":"ContainerDied","Data":"7efad2c9fb325206e60fc2f5ad9902e9f124557ba213ae1ff6b6fdd1368e2725"}
Jul 06 14:12:13.896986 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:13.896967    2573 scope.go:117] "RemoveContainer" containerID="7efad2c9fb325206e60fc2f5ad9902e9f124557ba213ae1ff6b6fdd1368e2725"
Jul 06 14:12:13.898175 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:13.898146    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:12:13.898241 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:13.898226    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:12:13.898283 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:13.898273    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:12:14.904025 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:14.903990    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c" event={"ID":"e6f8ce10-1b6c-47f5-b248-db862cef4c2a","Type":"ContainerStarted","Data":"bfb43ac452256e589f217264d80653284263e909c3613fa7405d24c748d5e33b"}
Jul 06 14:12:15.375647 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:15.375614    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:12:15.375839 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:15.375816    2573 patch_prober.go:28] interesting pod/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 06 14:12:15.375892 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:15.375875    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c" podUID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 06 14:12:16.376595 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:16.376555    2573 patch_prober.go:28] interesting pod/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 06 14:12:16.377004 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:16.376620    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c" podUID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 06 14:12:17.375586 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:17.375547    2573 patch_prober.go:28] interesting pod/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 06 14:12:17.375778 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:17.375607    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c" podUID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 06 14:12:18.375985 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:18.375942    2573 patch_prober.go:28] interesting pod/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 06 14:12:18.376449 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:18.376012    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c" podUID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 06 14:12:19.380157 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:19.380122    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:12:19.380546 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:19.380477    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:12:19.381143 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:19.381128    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:12:40.106901 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.106857    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"]
Jul 06 14:12:40.109873 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.109853    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.112413 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.112385    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-35c041\"/\"kube-root-ca.crt\""
Jul 06 14:12:40.113552 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.113533    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-35c041\"/\"openshift-service-ca.crt\""
Jul 06 14:12:40.113965 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.113779    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-35c041\"/\"default-dockercfg-cx4hb\""
Jul 06 14:12:40.113965 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.113800    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-35c041\"/\"auth-test-model-35c041-kserve-self-signed-certs\""
Jul 06 14:12:40.117153 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.117128    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"]
Jul 06 14:12:40.214526 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.214485    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlr2j\" (UniqueName: \"kubernetes.io/projected/39b15e20-b43f-4ea5-bba6-597cab58c681-kube-api-access-tlr2j\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.214526 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.214532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-model-cache\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.214757 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.214572    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-tmp-dir\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.214757 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.214644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-dshm\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.214757 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.214726    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-home\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.214757 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.214750    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b15e20-b43f-4ea5-bba6-597cab58c681-tls-certs\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.315710 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.315662    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlr2j\" (UniqueName: \"kubernetes.io/projected/39b15e20-b43f-4ea5-bba6-597cab58c681-kube-api-access-tlr2j\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.315710 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.315716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-model-cache\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.315993 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.315748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-tmp-dir\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.315993 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.315792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-dshm\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.315993 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.315855    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-home\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.315993 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.315882    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b15e20-b43f-4ea5-bba6-597cab58c681-tls-certs\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.316231 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.316196    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-model-cache\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.316297 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.316228    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-tmp-dir\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.316297 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.316272    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-home\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.318209 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.318186    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-dshm\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.318565 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.318547    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b15e20-b43f-4ea5-bba6-597cab58c681-tls-certs\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.335991 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.335952    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlr2j\" (UniqueName: \"kubernetes.io/projected/39b15e20-b43f-4ea5-bba6-597cab58c681-kube-api-access-tlr2j\") pod \"auth-test-model-35c041-kserve-846bfd9947-cp8rb\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") " pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.421384 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.421289    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:40.574713 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:40.574684    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"]
Jul 06 14:12:40.577425 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:12:40.577392    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39b15e20_b43f_4ea5_bba6_597cab58c681.slice/crio-93922af947c057b661c3a8638567470d9045e5cfb524e9c63f5b0596530b2195 WatchSource:0}: Error finding container 93922af947c057b661c3a8638567470d9045e5cfb524e9c63f5b0596530b2195: Status 404 returned error can't find the container with id 93922af947c057b661c3a8638567470d9045e5cfb524e9c63f5b0596530b2195
Jul 06 14:12:41.046716 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:41.046679    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb" event={"ID":"39b15e20-b43f-4ea5-bba6-597cab58c681","Type":"ContainerStarted","Data":"e09e87b673a4492f849c1a041b6c24bab4f435e6bd54966b0154759321e8d3d0"}
Jul 06 14:12:41.046899 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:41.046725    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb" event={"ID":"39b15e20-b43f-4ea5-bba6-597cab58c681","Type":"ContainerStarted","Data":"93922af947c057b661c3a8638567470d9045e5cfb524e9c63f5b0596530b2195"}
Jul 06 14:12:41.125579 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:41.125516    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb" podStartSLOduration=1.1254982550000001 podStartE2EDuration="1.125498255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:12:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:12:41.123577446 +0000 UTC m=+1976.435141113" watchObservedRunningTime="2026-07-06 14:12:41.125498255 +0000 UTC m=+1976.437061922"
Jul 06 14:12:50.421657 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:50.421620    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:50.422186 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:50.421799    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:50.434932 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:50.434901    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:12:51.113804 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:12:51.113774    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:14:34.322377 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:34.322290    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"]
Jul 06 14:14:45.337591 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:45.337563    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 14:14:45.351172 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:45.351146    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gnwx_669b823f-324a-4575-9949-eeab012ffeb2/ovn-acl-logging/0.log"
Jul 06 14:14:49.344336 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.344272    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb" podUID="39b15e20-b43f-4ea5-bba6-597cab58c681" containerName="main" containerID="cri-o://e09e87b673a4492f849c1a041b6c24bab4f435e6bd54966b0154759321e8d3d0" gracePeriod=45
Jul 06 14:14:49.615746 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.615710    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:14:49.745892 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.745859    2573 generic.go:356] "Generic (PLEG): container finished" podID="39b15e20-b43f-4ea5-bba6-597cab58c681" containerID="e09e87b673a4492f849c1a041b6c24bab4f435e6bd54966b0154759321e8d3d0" exitCode=0
Jul 06 14:14:49.746154 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.745908    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"
Jul 06 14:14:49.746154 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.745917    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb" event={"ID":"39b15e20-b43f-4ea5-bba6-597cab58c681","Type":"ContainerDied","Data":"e09e87b673a4492f849c1a041b6c24bab4f435e6bd54966b0154759321e8d3d0"}
Jul 06 14:14:49.746154 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.745965    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb" event={"ID":"39b15e20-b43f-4ea5-bba6-597cab58c681","Type":"ContainerDied","Data":"93922af947c057b661c3a8638567470d9045e5cfb524e9c63f5b0596530b2195"}
Jul 06 14:14:49.746775 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.745988    2573 scope.go:117] "RemoveContainer" containerID="e09e87b673a4492f849c1a041b6c24bab4f435e6bd54966b0154759321e8d3d0"
Jul 06 14:14:49.756207 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.756182    2573 scope.go:117] "RemoveContainer" containerID="e09e87b673a4492f849c1a041b6c24bab4f435e6bd54966b0154759321e8d3d0"
Jul 06 14:14:49.756570 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:14:49.756552    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e09e87b673a4492f849c1a041b6c24bab4f435e6bd54966b0154759321e8d3d0\": container with ID starting with e09e87b673a4492f849c1a041b6c24bab4f435e6bd54966b0154759321e8d3d0 not found: ID does not exist" containerID="e09e87b673a4492f849c1a041b6c24bab4f435e6bd54966b0154759321e8d3d0"
Jul 06 14:14:49.756624 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.756581    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e09e87b673a4492f849c1a041b6c24bab4f435e6bd54966b0154759321e8d3d0"} err="failed to get container status \"e09e87b673a4492f849c1a041b6c24bab4f435e6bd54966b0154759321e8d3d0\": rpc error: code = NotFound desc = could not find container \"e09e87b673a4492f849c1a041b6c24bab4f435e6bd54966b0154759321e8d3d0\": container with ID starting with e09e87b673a4492f849c1a041b6c24bab4f435e6bd54966b0154759321e8d3d0 not found: ID does not exist"
Jul 06 14:14:49.767957 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.767925    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-tmp-dir\") pod \"39b15e20-b43f-4ea5-bba6-597cab58c681\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") "
Jul 06 14:14:49.768214 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.767964    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-model-cache\") pod \"39b15e20-b43f-4ea5-bba6-597cab58c681\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") "
Jul 06 14:14:49.768214 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.767988    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-dshm\") pod \"39b15e20-b43f-4ea5-bba6-597cab58c681\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") "
Jul 06 14:14:49.768214 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.768009    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b15e20-b43f-4ea5-bba6-597cab58c681-tls-certs\") pod \"39b15e20-b43f-4ea5-bba6-597cab58c681\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") "
Jul 06 14:14:49.768214 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.768125    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlr2j\" (UniqueName: \"kubernetes.io/projected/39b15e20-b43f-4ea5-bba6-597cab58c681-kube-api-access-tlr2j\") pod \"39b15e20-b43f-4ea5-bba6-597cab58c681\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") "
Jul 06 14:14:49.768214 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.768191    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-home\") pod \"39b15e20-b43f-4ea5-bba6-597cab58c681\" (UID: \"39b15e20-b43f-4ea5-bba6-597cab58c681\") "
Jul 06 14:14:49.768496 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.768241    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-model-cache" (OuterVolumeSpecName: "model-cache") pod "39b15e20-b43f-4ea5-bba6-597cab58c681" (UID: "39b15e20-b43f-4ea5-bba6-597cab58c681"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:14:49.768496 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.768284    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "39b15e20-b43f-4ea5-bba6-597cab58c681" (UID: "39b15e20-b43f-4ea5-bba6-597cab58c681"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:14:49.768496 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.768483    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-home" (OuterVolumeSpecName: "home") pod "39b15e20-b43f-4ea5-bba6-597cab58c681" (UID: "39b15e20-b43f-4ea5-bba6-597cab58c681"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:14:49.768649 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.768577    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-home\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:14:49.768649 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.768592    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-tmp-dir\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:14:49.768649 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.768606    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-model-cache\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:14:49.770463 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.770430    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39b15e20-b43f-4ea5-bba6-597cab58c681-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "39b15e20-b43f-4ea5-bba6-597cab58c681" (UID: "39b15e20-b43f-4ea5-bba6-597cab58c681"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:14:49.770579 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.770490    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-dshm" (OuterVolumeSpecName: "dshm") pod "39b15e20-b43f-4ea5-bba6-597cab58c681" (UID: "39b15e20-b43f-4ea5-bba6-597cab58c681"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:14:49.770579 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.770511    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b15e20-b43f-4ea5-bba6-597cab58c681-kube-api-access-tlr2j" (OuterVolumeSpecName: "kube-api-access-tlr2j") pod "39b15e20-b43f-4ea5-bba6-597cab58c681" (UID: "39b15e20-b43f-4ea5-bba6-597cab58c681"). InnerVolumeSpecName "kube-api-access-tlr2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:14:49.869460 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.869364    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlr2j\" (UniqueName: \"kubernetes.io/projected/39b15e20-b43f-4ea5-bba6-597cab58c681-kube-api-access-tlr2j\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:14:49.869460 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.869401    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b15e20-b43f-4ea5-bba6-597cab58c681-dshm\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:14:49.869460 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:49.869413    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b15e20-b43f-4ea5-bba6-597cab58c681-tls-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:14:50.070291 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:50.070250    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"]
Jul 06 14:14:50.075279 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:50.075246    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-35c041/auth-test-model-35c041-kserve-846bfd9947-cp8rb"]
Jul 06 14:14:51.314546 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:14:51.314511    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39b15e20-b43f-4ea5-bba6-597cab58c681" path="/var/lib/kubelet/pods/39b15e20-b43f-4ea5-bba6-597cab58c681/volumes"
Jul 06 14:15:00.136111 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:00.136069    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf"]
Jul 06 14:15:00.136580 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:00.136563    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39b15e20-b43f-4ea5-bba6-597cab58c681" containerName="main"
Jul 06 14:15:00.136625 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:00.136583    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="39b15e20-b43f-4ea5-bba6-597cab58c681" containerName="main"
Jul 06 14:15:00.136671 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:00.136662    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="39b15e20-b43f-4ea5-bba6-597cab58c681" containerName="main"
Jul 06 14:15:00.141278 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:00.141256    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf"
Jul 06 14:15:00.151785 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:00.151744    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf"]
Jul 06 14:15:00.272527 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:00.272488    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7wkl\" (UniqueName: \"kubernetes.io/projected/a034af2c-166d-45a1-9de7-7ffd75265a7d-kube-api-access-p7wkl\") pod \"maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf\" (UID: \"a034af2c-166d-45a1-9de7-7ffd75265a7d\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf"
Jul 06 14:15:00.373625 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:00.373585    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7wkl\" (UniqueName: \"kubernetes.io/projected/a034af2c-166d-45a1-9de7-7ffd75265a7d-kube-api-access-p7wkl\") pod \"maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf\" (UID: \"a034af2c-166d-45a1-9de7-7ffd75265a7d\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf"
Jul 06 14:15:00.382856 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:00.382829    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7wkl\" (UniqueName: \"kubernetes.io/projected/a034af2c-166d-45a1-9de7-7ffd75265a7d-kube-api-access-p7wkl\") pod \"maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf\" (UID: \"a034af2c-166d-45a1-9de7-7ffd75265a7d\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf"
Jul 06 14:15:00.454115 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:00.454030    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf"
Jul 06 14:15:00.803562 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:00.803540    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf"]
Jul 06 14:15:00.806492 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:15:00.806462    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda034af2c_166d_45a1_9de7_7ffd75265a7d.slice/crio-d0ebc8a47a81a364376ff5031d160e998641fc80d0edf79321443c1affabf5c8 WatchSource:0}: Error finding container d0ebc8a47a81a364376ff5031d160e998641fc80d0edf79321443c1affabf5c8: Status 404 returned error can't find the container with id d0ebc8a47a81a364376ff5031d160e998641fc80d0edf79321443c1affabf5c8
Jul 06 14:15:01.813269 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:01.813229    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf" event={"ID":"a034af2c-166d-45a1-9de7-7ffd75265a7d","Type":"ContainerStarted","Data":"354f3af594efe66c2b9cc8cab90a60c4f3a8ada426cb29075bb802443d94afbb"}
Jul 06 14:15:01.813679 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:01.813295    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf" event={"ID":"a034af2c-166d-45a1-9de7-7ffd75265a7d","Type":"ContainerStarted","Data":"d0ebc8a47a81a364376ff5031d160e998641fc80d0edf79321443c1affabf5c8"}
Jul 06 14:15:01.828538 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:01.828487    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf" podStartSLOduration=1.828470115 podStartE2EDuration="1.828470115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:01.827862011 +0000 UTC m=+2117.139425674" watchObservedRunningTime="2026-07-06 14:15:01.828470115 +0000 UTC m=+2117.140033783"
Jul 06 14:15:02.820465 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:02.820419    2573 generic.go:356] "Generic (PLEG): container finished" podID="a034af2c-166d-45a1-9de7-7ffd75265a7d" containerID="354f3af594efe66c2b9cc8cab90a60c4f3a8ada426cb29075bb802443d94afbb" exitCode=0
Jul 06 14:15:02.820884 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:02.820472    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf" event={"ID":"a034af2c-166d-45a1-9de7-7ffd75265a7d","Type":"ContainerDied","Data":"354f3af594efe66c2b9cc8cab90a60c4f3a8ada426cb29075bb802443d94afbb"}
Jul 06 14:15:03.976535 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:03.976501    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf"
Jul 06 14:15:04.003634 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:04.003583    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7wkl\" (UniqueName: \"kubernetes.io/projected/a034af2c-166d-45a1-9de7-7ffd75265a7d-kube-api-access-p7wkl\") pod \"a034af2c-166d-45a1-9de7-7ffd75265a7d\" (UID: \"a034af2c-166d-45a1-9de7-7ffd75265a7d\") "
Jul 06 14:15:04.005827 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:04.005792    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a034af2c-166d-45a1-9de7-7ffd75265a7d-kube-api-access-p7wkl" (OuterVolumeSpecName: "kube-api-access-p7wkl") pod "a034af2c-166d-45a1-9de7-7ffd75265a7d" (UID: "a034af2c-166d-45a1-9de7-7ffd75265a7d"). InnerVolumeSpecName "kube-api-access-p7wkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:15:04.105258 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:04.105216    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7wkl\" (UniqueName: \"kubernetes.io/projected/a034af2c-166d-45a1-9de7-7ffd75265a7d-kube-api-access-p7wkl\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:15:04.832584 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:04.832556    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf"
Jul 06 14:15:04.832584 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:04.832582    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf" event={"ID":"a034af2c-166d-45a1-9de7-7ffd75265a7d","Type":"ContainerDied","Data":"d0ebc8a47a81a364376ff5031d160e998641fc80d0edf79321443c1affabf5c8"}
Jul 06 14:15:04.832835 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:04.832624    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0ebc8a47a81a364376ff5031d160e998641fc80d0edf79321443c1affabf5c8"
Jul 06 14:15:07.286216 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.286183    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"]
Jul 06 14:15:07.286630 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.286617    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a034af2c-166d-45a1-9de7-7ffd75265a7d" containerName="cleanup"
Jul 06 14:15:07.286671 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.286631    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a034af2c-166d-45a1-9de7-7ffd75265a7d" containerName="cleanup"
Jul 06 14:15:07.286715 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.286706    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a034af2c-166d-45a1-9de7-7ffd75265a7d" containerName="cleanup"
Jul 06 14:15:07.289978 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.289956    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.294234 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.294210    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-35c041\"/\"kube-root-ca.crt\""
Jul 06 14:15:07.294391 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.294242    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-35c041\"/\"default-dockercfg-cx4hb\""
Jul 06 14:15:07.294391 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.294257    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-35c041\"/\"openshift-service-ca.crt\""
Jul 06 14:15:07.294391 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.294241    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-35c041\"/\"sub-test-model-35c041-kserve-self-signed-certs\""
Jul 06 14:15:07.298855 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.298827    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"]
Jul 06 14:15:07.336154 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.336111    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-home\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.336363 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.336192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csj4m\" (UniqueName: \"kubernetes.io/projected/2805ad5d-b276-4bd7-ae74-f17d457ad5af-kube-api-access-csj4m\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.336363 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.336240    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-tmp-dir\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.336363 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.336314    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-model-cache\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.336363 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.336350    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2805ad5d-b276-4bd7-ae74-f17d457ad5af-tls-certs\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.336552 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.336391    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-dshm\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.437702 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.437665    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2805ad5d-b276-4bd7-ae74-f17d457ad5af-tls-certs\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.437882 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.437716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-dshm\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.437882 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.437740    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-home\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.437882 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.437785    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csj4m\" (UniqueName: \"kubernetes.io/projected/2805ad5d-b276-4bd7-ae74-f17d457ad5af-kube-api-access-csj4m\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.437882 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.437818    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-tmp-dir\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.437882 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.437846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-model-cache\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.438257 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.438232    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-model-cache\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.438328 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.438261    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-tmp-dir\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.438385 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.438323    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-home\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.440449 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.440422    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-dshm\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.440583 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.440463    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2805ad5d-b276-4bd7-ae74-f17d457ad5af-tls-certs\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.447757 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.447719    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csj4m\" (UniqueName: \"kubernetes.io/projected/2805ad5d-b276-4bd7-ae74-f17d457ad5af-kube-api-access-csj4m\") pod \"sub-test-model-35c041-kserve-5985f949b7-9rvqt\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") " pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.602110 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.602026    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:07.752770 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.752558    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"]
Jul 06 14:15:07.755173 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:15:07.755145    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2805ad5d_b276_4bd7_ae74_f17d457ad5af.slice/crio-604eb6e946c6f07c35c1113061bbced4369943e858b0ed4042e3d860559f3e5a WatchSource:0}: Error finding container 604eb6e946c6f07c35c1113061bbced4369943e858b0ed4042e3d860559f3e5a: Status 404 returned error can't find the container with id 604eb6e946c6f07c35c1113061bbced4369943e858b0ed4042e3d860559f3e5a
Jul 06 14:15:07.850891 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.850852    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt" event={"ID":"2805ad5d-b276-4bd7-ae74-f17d457ad5af","Type":"ContainerStarted","Data":"750c669d783898944b9448ccdcd1ed3a49b7b9c7d85a5be05f493d2efa327745"}
Jul 06 14:15:07.851124 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.851096    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt" event={"ID":"2805ad5d-b276-4bd7-ae74-f17d457ad5af","Type":"ContainerStarted","Data":"604eb6e946c6f07c35c1113061bbced4369943e858b0ed4042e3d860559f3e5a"}
Jul 06 14:15:07.869928 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:07.869817    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt" podStartSLOduration=0.869798089 podStartE2EDuration="869.798089ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:07.868762824 +0000 UTC m=+2123.180326493" watchObservedRunningTime="2026-07-06 14:15:07.869798089 +0000 UTC m=+2123.181361757"
Jul 06 14:15:17.602992 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:17.602953    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:17.603521 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:17.603020    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:17.616011 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:17.615974    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:17.919166 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:17.919085    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:15:45.526216 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:45.526176    2573 scope.go:117] "RemoveContainer" containerID="4872f5e940fe90674e45da4e915ccaedbf78d39fdf9424621c0629ac8660de13"
Jul 06 14:15:52.504647 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:15:52.504610    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"]
Jul 06 14:16:07.526301 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.526250    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt" podUID="2805ad5d-b276-4bd7-ae74-f17d457ad5af" containerName="main" containerID="cri-o://750c669d783898944b9448ccdcd1ed3a49b7b9c7d85a5be05f493d2efa327745" gracePeriod=45
Jul 06 14:16:07.795329 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.795301    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:16:07.930370 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.930332    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2805ad5d-b276-4bd7-ae74-f17d457ad5af-tls-certs\") pod \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") "
Jul 06 14:16:07.930370 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.930371    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-model-cache\") pod \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") "
Jul 06 14:16:07.930638 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.930441    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csj4m\" (UniqueName: \"kubernetes.io/projected/2805ad5d-b276-4bd7-ae74-f17d457ad5af-kube-api-access-csj4m\") pod \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") "
Jul 06 14:16:07.930638 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.930466    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-home\") pod \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") "
Jul 06 14:16:07.930638 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.930490    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-tmp-dir\") pod \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") "
Jul 06 14:16:07.930638 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.930596    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-dshm\") pod \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\" (UID: \"2805ad5d-b276-4bd7-ae74-f17d457ad5af\") "
Jul 06 14:16:07.930847 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.930730    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-model-cache" (OuterVolumeSpecName: "model-cache") pod "2805ad5d-b276-4bd7-ae74-f17d457ad5af" (UID: "2805ad5d-b276-4bd7-ae74-f17d457ad5af"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:16:07.930847 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.930743    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-home" (OuterVolumeSpecName: "home") pod "2805ad5d-b276-4bd7-ae74-f17d457ad5af" (UID: "2805ad5d-b276-4bd7-ae74-f17d457ad5af"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:16:07.930847 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.930776    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2805ad5d-b276-4bd7-ae74-f17d457ad5af" (UID: "2805ad5d-b276-4bd7-ae74-f17d457ad5af"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:16:07.931004 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.930951    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-model-cache\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:16:07.931004 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.930966    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-home\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:16:07.931004 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.930976    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-tmp-dir\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:16:07.932594 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.932559    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-dshm" (OuterVolumeSpecName: "dshm") pod "2805ad5d-b276-4bd7-ae74-f17d457ad5af" (UID: "2805ad5d-b276-4bd7-ae74-f17d457ad5af"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:16:07.932696 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.932630    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2805ad5d-b276-4bd7-ae74-f17d457ad5af-kube-api-access-csj4m" (OuterVolumeSpecName: "kube-api-access-csj4m") pod "2805ad5d-b276-4bd7-ae74-f17d457ad5af" (UID: "2805ad5d-b276-4bd7-ae74-f17d457ad5af"). InnerVolumeSpecName "kube-api-access-csj4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:16:07.932696 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:07.932641    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2805ad5d-b276-4bd7-ae74-f17d457ad5af-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2805ad5d-b276-4bd7-ae74-f17d457ad5af" (UID: "2805ad5d-b276-4bd7-ae74-f17d457ad5af"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:16:08.032423 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:08.032323    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2805ad5d-b276-4bd7-ae74-f17d457ad5af-dshm\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:16:08.032423 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:08.032354    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2805ad5d-b276-4bd7-ae74-f17d457ad5af-tls-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:16:08.032423 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:08.032367    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csj4m\" (UniqueName: \"kubernetes.io/projected/2805ad5d-b276-4bd7-ae74-f17d457ad5af-kube-api-access-csj4m\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:16:08.181818 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:08.181785    2573 generic.go:356] "Generic (PLEG): container finished" podID="2805ad5d-b276-4bd7-ae74-f17d457ad5af" containerID="750c669d783898944b9448ccdcd1ed3a49b7b9c7d85a5be05f493d2efa327745" exitCode=0
Jul 06 14:16:08.182000 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:08.181824    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"
Jul 06 14:16:08.182000 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:08.181859    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt" event={"ID":"2805ad5d-b276-4bd7-ae74-f17d457ad5af","Type":"ContainerDied","Data":"750c669d783898944b9448ccdcd1ed3a49b7b9c7d85a5be05f493d2efa327745"}
Jul 06 14:16:08.182000 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:08.181901    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt" event={"ID":"2805ad5d-b276-4bd7-ae74-f17d457ad5af","Type":"ContainerDied","Data":"604eb6e946c6f07c35c1113061bbced4369943e858b0ed4042e3d860559f3e5a"}
Jul 06 14:16:08.182000 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:08.181919    2573 scope.go:117] "RemoveContainer" containerID="750c669d783898944b9448ccdcd1ed3a49b7b9c7d85a5be05f493d2efa327745"
Jul 06 14:16:08.191575 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:08.191558    2573 scope.go:117] "RemoveContainer" containerID="750c669d783898944b9448ccdcd1ed3a49b7b9c7d85a5be05f493d2efa327745"
Jul 06 14:16:08.191873 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:16:08.191855    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"750c669d783898944b9448ccdcd1ed3a49b7b9c7d85a5be05f493d2efa327745\": container with ID starting with 750c669d783898944b9448ccdcd1ed3a49b7b9c7d85a5be05f493d2efa327745 not found: ID does not exist" containerID="750c669d783898944b9448ccdcd1ed3a49b7b9c7d85a5be05f493d2efa327745"
Jul 06 14:16:08.191913 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:08.191883    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750c669d783898944b9448ccdcd1ed3a49b7b9c7d85a5be05f493d2efa327745"} err="failed to get container status \"750c669d783898944b9448ccdcd1ed3a49b7b9c7d85a5be05f493d2efa327745\": rpc error: code = NotFound desc = could not find container \"750c669d783898944b9448ccdcd1ed3a49b7b9c7d85a5be05f493d2efa327745\": container with ID starting with 750c669d783898944b9448ccdcd1ed3a49b7b9c7d85a5be05f493d2efa327745 not found: ID does not exist"
Jul 06 14:16:08.204947 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:08.204917    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"]
Jul 06 14:16:08.210786 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:08.210752    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-35c041/sub-test-model-35c041-kserve-5985f949b7-9rvqt"]
Jul 06 14:16:09.315106 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:16:09.315072    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2805ad5d-b276-4bd7-ae74-f17d457ad5af" path="/var/lib/kubelet/pods/2805ad5d-b276-4bd7-ae74-f17d457ad5af/volumes"
Jul 06 14:18:05.815244 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:05.815204    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf"]
Jul 06 14:18:05.817673 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:05.817645    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-973328-29722455-qc9wf"]
Jul 06 14:18:07.314617 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:07.314579    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a034af2c-166d-45a1-9de7-7ffd75265a7d" path="/var/lib/kubelet/pods/a034af2c-166d-45a1-9de7-7ffd75265a7d/volumes"
Jul 06 14:18:48.484892 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:48.484855    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"]
Jul 06 14:18:48.485355 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:48.485129    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp" podUID="96a05619-099f-4851-b439-26039b18cf31" containerName="istio-proxy" containerID="cri-o://897f746eb2689a27f04e25ddb3b5c1d0376d78471473fa33088a3109b1c6eadb" gracePeriod=30
Jul 06 14:18:53.755908 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.755826    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:18:53.890833 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.890785    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zg42j\" (UniqueName: \"kubernetes.io/projected/96a05619-099f-4851-b439-26039b18cf31-kube-api-access-zg42j\") pod \"96a05619-099f-4851-b439-26039b18cf31\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") "
Jul 06 14:18:53.891024 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.890853    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-istio-data\") pod \"96a05619-099f-4851-b439-26039b18cf31\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") "
Jul 06 14:18:53.891024 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.890907    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-workload-certs\") pod \"96a05619-099f-4851-b439-26039b18cf31\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") "
Jul 06 14:18:53.891024 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.890926    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96a05619-099f-4851-b439-26039b18cf31-istio-token\") pod \"96a05619-099f-4851-b439-26039b18cf31\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") "
Jul 06 14:18:53.891024 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.890944    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-credential-socket\") pod \"96a05619-099f-4851-b439-26039b18cf31\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") "
Jul 06 14:18:53.891277 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.891025    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96a05619-099f-4851-b439-26039b18cf31-istio-podinfo\") pod \"96a05619-099f-4851-b439-26039b18cf31\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") "
Jul 06 14:18:53.891277 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.891065    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-istio-envoy\") pod \"96a05619-099f-4851-b439-26039b18cf31\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") "
Jul 06 14:18:53.891277 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.891106    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96a05619-099f-4851-b439-26039b18cf31-istiod-ca-cert\") pod \"96a05619-099f-4851-b439-26039b18cf31\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") "
Jul 06 14:18:53.891277 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.891155    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-workload-socket\") pod \"96a05619-099f-4851-b439-26039b18cf31\" (UID: \"96a05619-099f-4851-b439-26039b18cf31\") "
Jul 06 14:18:53.891487 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.891296    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "96a05619-099f-4851-b439-26039b18cf31" (UID: "96a05619-099f-4851-b439-26039b18cf31"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:18:53.891487 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.891315    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "96a05619-099f-4851-b439-26039b18cf31" (UID: "96a05619-099f-4851-b439-26039b18cf31"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:18:53.891605 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.891501    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "96a05619-099f-4851-b439-26039b18cf31" (UID: "96a05619-099f-4851-b439-26039b18cf31"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:18:53.891605 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.891559    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-workload-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:18:53.891605 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.891573    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-credential-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:18:53.891805 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.891771    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96a05619-099f-4851-b439-26039b18cf31-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "96a05619-099f-4851-b439-26039b18cf31" (UID: "96a05619-099f-4851-b439-26039b18cf31"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:18:53.891947 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.891864    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-istio-data" (OuterVolumeSpecName: "istio-data") pod "96a05619-099f-4851-b439-26039b18cf31" (UID: "96a05619-099f-4851-b439-26039b18cf31"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:18:53.893190 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.893166    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96a05619-099f-4851-b439-26039b18cf31-kube-api-access-zg42j" (OuterVolumeSpecName: "kube-api-access-zg42j") pod "96a05619-099f-4851-b439-26039b18cf31" (UID: "96a05619-099f-4851-b439-26039b18cf31"). InnerVolumeSpecName "kube-api-access-zg42j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:18:53.893538 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.893517    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "96a05619-099f-4851-b439-26039b18cf31" (UID: "96a05619-099f-4851-b439-26039b18cf31"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:18:53.893621 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.893522    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/96a05619-099f-4851-b439-26039b18cf31-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "96a05619-099f-4851-b439-26039b18cf31" (UID: "96a05619-099f-4851-b439-26039b18cf31"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:18:53.893945 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.893920    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96a05619-099f-4851-b439-26039b18cf31-istio-token" (OuterVolumeSpecName: "istio-token") pod "96a05619-099f-4851-b439-26039b18cf31" (UID: "96a05619-099f-4851-b439-26039b18cf31"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:18:53.992930 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.992887    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96a05619-099f-4851-b439-26039b18cf31-istiod-ca-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:18:53.992930 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.992920    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-workload-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:18:53.992930 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.992933    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg42j\" (UniqueName: \"kubernetes.io/projected/96a05619-099f-4851-b439-26039b18cf31-kube-api-access-zg42j\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:18:53.993215 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.992946    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-istio-data\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:18:53.993215 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.992959    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96a05619-099f-4851-b439-26039b18cf31-istio-token\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:18:53.993215 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.992972    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96a05619-099f-4851-b439-26039b18cf31-istio-podinfo\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:18:53.993215 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:53.992982    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96a05619-099f-4851-b439-26039b18cf31-istio-envoy\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:18:54.102113 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:54.102039    2573 generic.go:356] "Generic (PLEG): container finished" podID="96a05619-099f-4851-b439-26039b18cf31" containerID="897f746eb2689a27f04e25ddb3b5c1d0376d78471473fa33088a3109b1c6eadb" exitCode=0
Jul 06 14:18:54.102113 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:54.102105    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"
Jul 06 14:18:54.102329 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:54.102128    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp" event={"ID":"96a05619-099f-4851-b439-26039b18cf31","Type":"ContainerDied","Data":"897f746eb2689a27f04e25ddb3b5c1d0376d78471473fa33088a3109b1c6eadb"}
Jul 06 14:18:54.102329 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:54.102194    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp" event={"ID":"96a05619-099f-4851-b439-26039b18cf31","Type":"ContainerDied","Data":"91f34b7eb72bc49cdd640624f7efb125c24538557d3a47fe977fb597c86e68bb"}
Jul 06 14:18:54.102329 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:54.102224    2573 scope.go:117] "RemoveContainer" containerID="897f746eb2689a27f04e25ddb3b5c1d0376d78471473fa33088a3109b1c6eadb"
Jul 06 14:18:54.112561 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:54.112543    2573 scope.go:117] "RemoveContainer" containerID="90d8f3048e903480ea307a1d6c57dc4088abdddbaff52395de5bf23fe026acf8"
Jul 06 14:18:54.122712 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:54.122683    2573 scope.go:117] "RemoveContainer" containerID="897f746eb2689a27f04e25ddb3b5c1d0376d78471473fa33088a3109b1c6eadb"
Jul 06 14:18:54.123031 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:18:54.123011    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"897f746eb2689a27f04e25ddb3b5c1d0376d78471473fa33088a3109b1c6eadb\": container with ID starting with 897f746eb2689a27f04e25ddb3b5c1d0376d78471473fa33088a3109b1c6eadb not found: ID does not exist" containerID="897f746eb2689a27f04e25ddb3b5c1d0376d78471473fa33088a3109b1c6eadb"
Jul 06 14:18:54.123126 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:54.123041    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897f746eb2689a27f04e25ddb3b5c1d0376d78471473fa33088a3109b1c6eadb"} err="failed to get container status \"897f746eb2689a27f04e25ddb3b5c1d0376d78471473fa33088a3109b1c6eadb\": rpc error: code = NotFound desc = could not find container \"897f746eb2689a27f04e25ddb3b5c1d0376d78471473fa33088a3109b1c6eadb\": container with ID starting with 897f746eb2689a27f04e25ddb3b5c1d0376d78471473fa33088a3109b1c6eadb not found: ID does not exist"
Jul 06 14:18:54.123126 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:54.123088    2573 scope.go:117] "RemoveContainer" containerID="90d8f3048e903480ea307a1d6c57dc4088abdddbaff52395de5bf23fe026acf8"
Jul 06 14:18:54.123354 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:18:54.123333    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90d8f3048e903480ea307a1d6c57dc4088abdddbaff52395de5bf23fe026acf8\": container with ID starting with 90d8f3048e903480ea307a1d6c57dc4088abdddbaff52395de5bf23fe026acf8 not found: ID does not exist" containerID="90d8f3048e903480ea307a1d6c57dc4088abdddbaff52395de5bf23fe026acf8"
Jul 06 14:18:54.123412 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:54.123364    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d8f3048e903480ea307a1d6c57dc4088abdddbaff52395de5bf23fe026acf8"} err="failed to get container status \"90d8f3048e903480ea307a1d6c57dc4088abdddbaff52395de5bf23fe026acf8\": rpc error: code = NotFound desc = could not find container \"90d8f3048e903480ea307a1d6c57dc4088abdddbaff52395de5bf23fe026acf8\": container with ID starting with 90d8f3048e903480ea307a1d6c57dc4088abdddbaff52395de5bf23fe026acf8 not found: ID does not exist"
Jul 06 14:18:54.126544 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:54.126513    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"]
Jul 06 14:18:54.130761 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:54.130730    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-973328-openshift-default-7f4dc4b6dc-jg7sp"]
Jul 06 14:18:55.316605 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:55.316574    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96a05619-099f-4851-b439-26039b18cf31" path="/var/lib/kubelet/pods/96a05619-099f-4851-b439-26039b18cf31/volumes"
Jul 06 14:18:55.611965 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:55.611934    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"]
Jul 06 14:18:55.612200 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:55.612156    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c" podUID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" containerName="istio-proxy" containerID="cri-o://bfb43ac452256e589f217264d80653284263e909c3613fa7405d24c748d5e33b" gracePeriod=30
Jul 06 14:18:56.309639 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:18:56.309596    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67f8bb647c-v9h7z_c539b2f2-f3c5-465c-830c-e9a18851b530/authorino/0.log"
Jul 06 14:19:00.882541 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.882459    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:19:00.963813 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.963776    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-workload-socket\") pod \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") "
Jul 06 14:19:00.963813 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.963823    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-token\") pod \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") "
Jul 06 14:19:00.964116 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.963843    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-credential-socket\") pod \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") "
Jul 06 14:19:00.964116 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.963860    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-podinfo\") pod \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") "
Jul 06 14:19:00.964116 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.963885    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-workload-certs\") pod \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") "
Jul 06 14:19:00.964116 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.963922    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-data\") pod \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") "
Jul 06 14:19:00.964116 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.963988    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khfwk\" (UniqueName: \"kubernetes.io/projected/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-kube-api-access-khfwk\") pod \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") "
Jul 06 14:19:00.964116 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.964037    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istiod-ca-cert\") pod \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") "
Jul 06 14:19:00.964116 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.964098    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-envoy\") pod \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\" (UID: \"e6f8ce10-1b6c-47f5-b248-db862cef4c2a\") "
Jul 06 14:19:00.964563 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.964176    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6f8ce10-1b6c-47f5-b248-db862cef4c2a" (UID: "e6f8ce10-1b6c-47f5-b248-db862cef4c2a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:19:00.964563 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.964205    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6f8ce10-1b6c-47f5-b248-db862cef4c2a" (UID: "e6f8ce10-1b6c-47f5-b248-db862cef4c2a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:19:00.964563 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.964457    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-workload-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:19:00.964563 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.964479    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-credential-socket\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:19:00.964563 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.964547    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6f8ce10-1b6c-47f5-b248-db862cef4c2a" (UID: "e6f8ce10-1b6c-47f5-b248-db862cef4c2a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:19:00.964563 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.964549    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6f8ce10-1b6c-47f5-b248-db862cef4c2a" (UID: "e6f8ce10-1b6c-47f5-b248-db862cef4c2a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:19:00.964960 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.964939    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6f8ce10-1b6c-47f5-b248-db862cef4c2a" (UID: "e6f8ce10-1b6c-47f5-b248-db862cef4c2a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:19:00.966656 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.966629    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6f8ce10-1b6c-47f5-b248-db862cef4c2a" (UID: "e6f8ce10-1b6c-47f5-b248-db862cef4c2a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:19:00.966656 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.966630    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6f8ce10-1b6c-47f5-b248-db862cef4c2a" (UID: "e6f8ce10-1b6c-47f5-b248-db862cef4c2a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:19:00.966800 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.966695    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6f8ce10-1b6c-47f5-b248-db862cef4c2a" (UID: "e6f8ce10-1b6c-47f5-b248-db862cef4c2a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:19:00.966800 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:00.966719    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-kube-api-access-khfwk" (OuterVolumeSpecName: "kube-api-access-khfwk") pod "e6f8ce10-1b6c-47f5-b248-db862cef4c2a" (UID: "e6f8ce10-1b6c-47f5-b248-db862cef4c2a"). InnerVolumeSpecName "kube-api-access-khfwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:19:01.019024 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.018992    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nbxmz_43628a7d-a32c-4565-85cd-7f6a77e53be0/manager/0.log"
Jul 06 14:19:01.064950 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.064912    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-token\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:19:01.064950 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.064944    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-podinfo\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:19:01.064950 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.064952    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-workload-certs\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:19:01.064950 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.064962    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-data\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:19:01.065268 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.064971    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khfwk\" (UniqueName: \"kubernetes.io/projected/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-kube-api-access-khfwk\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:19:01.065268 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.064980    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istiod-ca-cert\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:19:01.065268 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.064989    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6f8ce10-1b6c-47f5-b248-db862cef4c2a-istio-envoy\") on node \"ip-10-0-134-86.ec2.internal\" DevicePath \"\""
Jul 06 14:19:01.138261 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.138177    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kgqbb_03d756e5-e2ec-4aa0-adb5-3279504dca39/manager/0.log"
Jul 06 14:19:01.149244 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.149203    2573 generic.go:356] "Generic (PLEG): container finished" podID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" containerID="bfb43ac452256e589f217264d80653284263e909c3613fa7405d24c748d5e33b" exitCode=0
Jul 06 14:19:01.149451 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.149261    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"
Jul 06 14:19:01.149451 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.149292    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c" event={"ID":"e6f8ce10-1b6c-47f5-b248-db862cef4c2a","Type":"ContainerDied","Data":"bfb43ac452256e589f217264d80653284263e909c3613fa7405d24c748d5e33b"}
Jul 06 14:19:01.149451 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.149362    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c" event={"ID":"e6f8ce10-1b6c-47f5-b248-db862cef4c2a","Type":"ContainerDied","Data":"b38c0d6120e5417a46ae8e881244169462dc75979cbf0260604a81877e4299b9"}
Jul 06 14:19:01.149451 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.149379    2573 scope.go:117] "RemoveContainer" containerID="bfb43ac452256e589f217264d80653284263e909c3613fa7405d24c748d5e33b"
Jul 06 14:19:01.159245 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.159225    2573 scope.go:117] "RemoveContainer" containerID="7efad2c9fb325206e60fc2f5ad9902e9f124557ba213ae1ff6b6fdd1368e2725"
Jul 06 14:19:01.168356 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.168333    2573 scope.go:117] "RemoveContainer" containerID="bfb43ac452256e589f217264d80653284263e909c3613fa7405d24c748d5e33b"
Jul 06 14:19:01.168669 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:19:01.168650    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfb43ac452256e589f217264d80653284263e909c3613fa7405d24c748d5e33b\": container with ID starting with bfb43ac452256e589f217264d80653284263e909c3613fa7405d24c748d5e33b not found: ID does not exist" containerID="bfb43ac452256e589f217264d80653284263e909c3613fa7405d24c748d5e33b"
Jul 06 14:19:01.168706 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.168681    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfb43ac452256e589f217264d80653284263e909c3613fa7405d24c748d5e33b"} err="failed to get container status \"bfb43ac452256e589f217264d80653284263e909c3613fa7405d24c748d5e33b\": rpc error: code = NotFound desc = could not find container \"bfb43ac452256e589f217264d80653284263e909c3613fa7405d24c748d5e33b\": container with ID starting with bfb43ac452256e589f217264d80653284263e909c3613fa7405d24c748d5e33b not found: ID does not exist"
Jul 06 14:19:01.168706 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.168700    2573 scope.go:117] "RemoveContainer" containerID="7efad2c9fb325206e60fc2f5ad9902e9f124557ba213ae1ff6b6fdd1368e2725"
Jul 06 14:19:01.168971 ip-10-0-134-86 kubenswrapper[2573]: E0706 14:19:01.168950    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7efad2c9fb325206e60fc2f5ad9902e9f124557ba213ae1ff6b6fdd1368e2725\": container with ID starting with 7efad2c9fb325206e60fc2f5ad9902e9f124557ba213ae1ff6b6fdd1368e2725 not found: ID does not exist" containerID="7efad2c9fb325206e60fc2f5ad9902e9f124557ba213ae1ff6b6fdd1368e2725"
Jul 06 14:19:01.169010 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.168979    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7efad2c9fb325206e60fc2f5ad9902e9f124557ba213ae1ff6b6fdd1368e2725"} err="failed to get container status \"7efad2c9fb325206e60fc2f5ad9902e9f124557ba213ae1ff6b6fdd1368e2725\": rpc error: code = NotFound desc = could not find container \"7efad2c9fb325206e60fc2f5ad9902e9f124557ba213ae1ff6b6fdd1368e2725\": container with ID starting with 7efad2c9fb325206e60fc2f5ad9902e9f124557ba213ae1ff6b6fdd1368e2725 not found: ID does not exist"
Jul 06 14:19:01.173828 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.173802    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"]
Jul 06 14:19:01.177736 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.177709    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-35c041-openshift-default-844bdc95b7-ptf2c"]
Jul 06 14:19:01.265272 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.265240    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6d756dd5d6-w8whm_cd6d6793-78e9-4cea-b4b2-3783a6feb5c9/maas-api/0.log"
Jul 06 14:19:01.314365 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.314328    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" path="/var/lib/kubelet/pods/e6f8ce10-1b6c-47f5-b248-db862cef4c2a/volumes"
Jul 06 14:19:01.378062 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.378022    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722440-tqf6j_c1d92a78-c244-4812-86c3-1f24729e65b4/cleanup/0.log"
Jul 06 14:19:01.614386 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.614343    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6875d9b67d-q5b6p_91212030-f4a6-4ed7-b376-e77bebfa9d08/manager/0.log"
Jul 06 14:19:01.725295 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.725269    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-czzwh_c65276a5-d955-4f8a-ba22-b613beaee814/server/0.log"
Jul 06 14:19:01.852579 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:01.852542    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2qndn_a65f52a7-99e9-41e2-aaf4-389a6ec47909/manager/0.log"
Jul 06 14:19:02.133727 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:02.133701    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b559b5dcd-hjl7c_3632a88f-a1dd-4674-a5ba-9673630b9825/copy-manifests/0.log"
Jul 06 14:19:02.143564 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:02.143535    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b559b5dcd-hjl7c_3632a88f-a1dd-4674-a5ba-9673630b9825/manager/0.log"
Jul 06 14:19:02.395246 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:02.395160    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-cpsvn_78a93b21-8da2-4a12-b765-32a78ce65c52/postgres/0.log"
Jul 06 14:19:03.704298 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:03.704264    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67f8bb647c-v9h7z_c539b2f2-f3c5-465c-830c-e9a18851b530/authorino/0.log"
Jul 06 14:19:03.835626 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:03.835596    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xrv2r_847d8d1d-6bb1-42f9-be75-ca7ff339705c/manager/0.log"
Jul 06 14:19:04.178863 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:04.178826    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7vghs_a0fb2ab3-e7a8-462a-a365-d61fe8e35307/registry-server/0.log"
Jul 06 14:19:04.540063 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:04.539962    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qgz4h_b909490c-bff1-49a5-a8f4-1bb878c48223/manager/0.log"
Jul 06 14:19:04.896453 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:04.896417    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4v8qkn_9719f926-ff1f-4e1d-8674-cd03f9ce7e70/istio-proxy/0.log"
Jul 06 14:19:05.127797 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:05.127740    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85bfc8ccc9-6v29g_535fd6b9-00c9-433d-ac21-4649061cfd9c/kube-auth-proxy/0.log"
Jul 06 14:19:05.357084 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:05.357040    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lw78z_30405940-ed0a-4e35-844f-e8aa9ba80f3b/istio-proxy/1.log"
Jul 06 14:19:05.471261 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:05.471206    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x29pb_9fd49e00-3560-41fb-9e9b-528710a4ace6/payload-pre-processing/0.log"
Jul 06 14:19:05.592710 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:05.592669    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-88zsj_029f1e78-7647-4513-931f-4567da2e4558/payload-processing/0.log"
Jul 06 14:19:05.708652 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:05.708563    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f94c6895c-tdclc_fef07690-0fb5-4d47-81c8-8e4b6bdb23cf/router/0.log"
Jul 06 14:19:06.180404 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:06.180358    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-sm9pc_c732cade-9d1f-4696-8ec6-bc0660915f5d/main/0.log"
Jul 06 14:19:10.468257 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468220    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8kwcr/must-gather-f8tpb"]
Jul 06 14:19:10.468673 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468656    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2805ad5d-b276-4bd7-ae74-f17d457ad5af" containerName="main"
Jul 06 14:19:10.468673 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468668    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2805ad5d-b276-4bd7-ae74-f17d457ad5af" containerName="main"
Jul 06 14:19:10.468752 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468678    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a05619-099f-4851-b439-26039b18cf31" containerName="istio-proxy"
Jul 06 14:19:10.468752 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468683    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a05619-099f-4851-b439-26039b18cf31" containerName="istio-proxy"
Jul 06 14:19:10.468752 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468691    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a05619-099f-4851-b439-26039b18cf31" containerName="istio-proxy"
Jul 06 14:19:10.468752 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468698    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a05619-099f-4851-b439-26039b18cf31" containerName="istio-proxy"
Jul 06 14:19:10.468752 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468705    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" containerName="istio-proxy"
Jul 06 14:19:10.468752 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468710    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" containerName="istio-proxy"
Jul 06 14:19:10.468938 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468779    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="96a05619-099f-4851-b439-26039b18cf31" containerName="istio-proxy"
Jul 06 14:19:10.468938 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468785    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" containerName="istio-proxy"
Jul 06 14:19:10.468938 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468791    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2805ad5d-b276-4bd7-ae74-f17d457ad5af" containerName="main"
Jul 06 14:19:10.468938 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468798    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" containerName="istio-proxy"
Jul 06 14:19:10.468938 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468804    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="96a05619-099f-4851-b439-26039b18cf31" containerName="istio-proxy"
Jul 06 14:19:10.468938 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468864    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" containerName="istio-proxy"
Jul 06 14:19:10.468938 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.468869    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f8ce10-1b6c-47f5-b248-db862cef4c2a" containerName="istio-proxy"
Jul 06 14:19:10.473626 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.473594    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8kwcr/must-gather-f8tpb"
Jul 06 14:19:10.476298 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.476271    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8kwcr\"/\"default-dockercfg-tv44x\""
Jul 06 14:19:10.477175 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.477158    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8kwcr\"/\"kube-root-ca.crt\""
Jul 06 14:19:10.477243 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.477176    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8kwcr\"/\"openshift-service-ca.crt\""
Jul 06 14:19:10.481899 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.481868    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8kwcr/must-gather-f8tpb"]
Jul 06 14:19:10.554776 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.554729    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/00d0174c-a087-4b20-a094-0266b15cbf1f-must-gather-output\") pod \"must-gather-f8tpb\" (UID: \"00d0174c-a087-4b20-a094-0266b15cbf1f\") " pod="openshift-must-gather-8kwcr/must-gather-f8tpb"
Jul 06 14:19:10.555001 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.554775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9zpg\" (UniqueName: \"kubernetes.io/projected/00d0174c-a087-4b20-a094-0266b15cbf1f-kube-api-access-b9zpg\") pod \"must-gather-f8tpb\" (UID: \"00d0174c-a087-4b20-a094-0266b15cbf1f\") " pod="openshift-must-gather-8kwcr/must-gather-f8tpb"
Jul 06 14:19:10.655995 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.655949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9zpg\" (UniqueName: \"kubernetes.io/projected/00d0174c-a087-4b20-a094-0266b15cbf1f-kube-api-access-b9zpg\") pod \"must-gather-f8tpb\" (UID: \"00d0174c-a087-4b20-a094-0266b15cbf1f\") " pod="openshift-must-gather-8kwcr/must-gather-f8tpb"
Jul 06 14:19:10.656196 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.656116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/00d0174c-a087-4b20-a094-0266b15cbf1f-must-gather-output\") pod \"must-gather-f8tpb\" (UID: \"00d0174c-a087-4b20-a094-0266b15cbf1f\") " pod="openshift-must-gather-8kwcr/must-gather-f8tpb"
Jul 06 14:19:10.656468 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.656446    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/00d0174c-a087-4b20-a094-0266b15cbf1f-must-gather-output\") pod \"must-gather-f8tpb\" (UID: \"00d0174c-a087-4b20-a094-0266b15cbf1f\") " pod="openshift-must-gather-8kwcr/must-gather-f8tpb"
Jul 06 14:19:10.664122 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.664095    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9zpg\" (UniqueName: \"kubernetes.io/projected/00d0174c-a087-4b20-a094-0266b15cbf1f-kube-api-access-b9zpg\") pod \"must-gather-f8tpb\" (UID: \"00d0174c-a087-4b20-a094-0266b15cbf1f\") " pod="openshift-must-gather-8kwcr/must-gather-f8tpb"
Jul 06 14:19:10.785022 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.784929    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8kwcr/must-gather-f8tpb"
Jul 06 14:19:10.943510 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.943479    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8kwcr/must-gather-f8tpb"]
Jul 06 14:19:10.944700 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:19:10.944674    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00d0174c_a087_4b20_a094_0266b15cbf1f.slice/crio-8e36067b91767d23f7b7474fd8a27b60d575ce204cd0c4e1e9badd65cd0407de WatchSource:0}: Error finding container 8e36067b91767d23f7b7474fd8a27b60d575ce204cd0c4e1e9badd65cd0407de: Status 404 returned error can't find the container with id 8e36067b91767d23f7b7474fd8a27b60d575ce204cd0c4e1e9badd65cd0407de
Jul 06 14:19:10.946548 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:10.946530    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:19:11.212702 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:11.212667    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kwcr/must-gather-f8tpb" event={"ID":"00d0174c-a087-4b20-a094-0266b15cbf1f","Type":"ContainerStarted","Data":"8e36067b91767d23f7b7474fd8a27b60d575ce204cd0c4e1e9badd65cd0407de"}
Jul 06 14:19:12.223947 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:12.223907    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kwcr/must-gather-f8tpb" event={"ID":"00d0174c-a087-4b20-a094-0266b15cbf1f","Type":"ContainerStarted","Data":"c0a2c74b1036aab90f1256d0ac16904a753e45b6a28518e1ae3b6d78ec827afe"}
Jul 06 14:19:13.235213 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:13.234287    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kwcr/must-gather-f8tpb" event={"ID":"00d0174c-a087-4b20-a094-0266b15cbf1f","Type":"ContainerStarted","Data":"8f14b74652b2f76723c2a1d010010624885689484a095f7e0f0376cd0e789a3f"}
Jul 06 14:19:13.252818 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:13.252744    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8kwcr/must-gather-f8tpb" podStartSLOduration=2.188710911 podStartE2EDuration="3.252717621s" totalImagesPullingTime="1.06400671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:19:13.252076988 +0000 UTC m=+2368.563640654" watchObservedRunningTime="2026-07-06 14:19:13.252717621 +0000 UTC m=+2368.564281424"
Jul 06 14:19:13.857857 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:13.857827    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v7pkm_4c146d14-3752-4d60-892c-39f682820d0f/global-pull-secret-syncer/0.log"
Jul 06 14:19:13.974608 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:13.974575    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g2x7s_724a5d6d-ae9b-40ad-a340-75f587e5f95c/konnectivity-agent/0.log"
Jul 06 14:19:14.021884 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:14.021851    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-86.ec2.internal_e4917cbac70d3a854e4ffc76b7293bab/haproxy/0.log"
Jul 06 14:19:19.146075 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:19.145784    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67f8bb647c-v9h7z_c539b2f2-f3c5-465c-830c-e9a18851b530/authorino/0.log"
Jul 06 14:19:19.191079 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:19.191003    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xrv2r_847d8d1d-6bb1-42f9-be75-ca7ff339705c/manager/0.log"
Jul 06 14:19:19.296900 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:19.296867    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7vghs_a0fb2ab3-e7a8-462a-a365-d61fe8e35307/registry-server/0.log"
Jul 06 14:19:19.549901 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:19.549808    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qgz4h_b909490c-bff1-49a5-a8f4-1bb878c48223/manager/0.log"
Jul 06 14:19:21.797993 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:21.797955    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-f6zxm_4f3d9f5a-17f9-4d9b-b7dc-3561fe5bcaa5/monitoring-plugin/0.log"
Jul 06 14:19:21.904646 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:21.904611    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sjhp5_a804ac2e-1e8e-4547-8a7a-1f35efb070ff/node-exporter/0.log"
Jul 06 14:19:21.926752 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:21.926703    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sjhp5_a804ac2e-1e8e-4547-8a7a-1f35efb070ff/kube-rbac-proxy/0.log"
Jul 06 14:19:21.949851 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:21.949827    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sjhp5_a804ac2e-1e8e-4547-8a7a-1f35efb070ff/init-textfile/0.log"
Jul 06 14:19:22.349279 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:22.349235    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-zs4vh_f95f6a67-b086-4048-a107-b48cb77f36b1/prometheus-operator/0.log"
Jul 06 14:19:22.369987 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:22.369957    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-zs4vh_f95f6a67-b086-4048-a107-b48cb77f36b1/kube-rbac-proxy/0.log"
Jul 06 14:19:22.508209 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:22.508171    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b7c49c69b-4k54l_1a8eb93c-6fac-477f-9719-ffc8696e11b7/thanos-query/0.log"
Jul 06 14:19:22.539701 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:22.539662    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b7c49c69b-4k54l_1a8eb93c-6fac-477f-9719-ffc8696e11b7/kube-rbac-proxy-web/0.log"
Jul 06 14:19:22.563423 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:22.563387    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b7c49c69b-4k54l_1a8eb93c-6fac-477f-9719-ffc8696e11b7/kube-rbac-proxy/0.log"
Jul 06 14:19:22.586627 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:22.586592    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b7c49c69b-4k54l_1a8eb93c-6fac-477f-9719-ffc8696e11b7/prom-label-proxy/0.log"
Jul 06 14:19:22.611078 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:22.610967    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b7c49c69b-4k54l_1a8eb93c-6fac-477f-9719-ffc8696e11b7/kube-rbac-proxy-rules/0.log"
Jul 06 14:19:22.638551 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:22.638478    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b7c49c69b-4k54l_1a8eb93c-6fac-477f-9719-ffc8696e11b7/kube-rbac-proxy-metrics/0.log"
Jul 06 14:19:23.906608 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:23.906582    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-sc4fj_ba91a8b0-ac4a-4dfe-9463-d55b27379677/networking-console-plugin/0.log"
Jul 06 14:19:24.355666 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.355620    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"]
Jul 06 14:19:24.364261 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.364228    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.368823 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.368789    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"]
Jul 06 14:19:24.526087 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.525742    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d354cb85-8c8e-4b8f-9329-22279919662c-lib-modules\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.526087 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.525841    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d354cb85-8c8e-4b8f-9329-22279919662c-sys\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.526087 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.525885    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d354cb85-8c8e-4b8f-9329-22279919662c-proc\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.526087 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.525932    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d354cb85-8c8e-4b8f-9329-22279919662c-podres\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.526087 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.525980    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzjsr\" (UniqueName: \"kubernetes.io/projected/d354cb85-8c8e-4b8f-9329-22279919662c-kube-api-access-xzjsr\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.627576 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.627484    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d354cb85-8c8e-4b8f-9329-22279919662c-podres\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.627576 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.627549    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzjsr\" (UniqueName: \"kubernetes.io/projected/d354cb85-8c8e-4b8f-9329-22279919662c-kube-api-access-xzjsr\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.627819 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.627587    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d354cb85-8c8e-4b8f-9329-22279919662c-lib-modules\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.627819 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.627651    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d354cb85-8c8e-4b8f-9329-22279919662c-podres\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.627819 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.627656    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d354cb85-8c8e-4b8f-9329-22279919662c-sys\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.627819 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.627709    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d354cb85-8c8e-4b8f-9329-22279919662c-sys\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.627819 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.627741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d354cb85-8c8e-4b8f-9329-22279919662c-proc\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.628034 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.627823    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d354cb85-8c8e-4b8f-9329-22279919662c-lib-modules\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.636598 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.631091    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d354cb85-8c8e-4b8f-9329-22279919662c-proc\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.647349 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.647316    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzjsr\" (UniqueName: \"kubernetes.io/projected/d354cb85-8c8e-4b8f-9329-22279919662c-kube-api-access-xzjsr\") pod \"perf-node-gather-daemonset-nkbnf\" (UID: \"d354cb85-8c8e-4b8f-9329-22279919662c\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.680672 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.680617    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:24.881375 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:24.881344    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"]
Jul 06 14:19:24.883103 ip-10-0-134-86 kubenswrapper[2573]: W0706 14:19:24.883038    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd354cb85_8c8e_4b8f_9329_22279919662c.slice/crio-bc1e0eae45e53b94cb835efb578874735c2ced7ba1c7ddb35efeec430c8af633 WatchSource:0}: Error finding container bc1e0eae45e53b94cb835efb578874735c2ced7ba1c7ddb35efeec430c8af633: Status 404 returned error can't find the container with id bc1e0eae45e53b94cb835efb578874735c2ced7ba1c7ddb35efeec430c8af633
Jul 06 14:19:25.224133 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:25.224024    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-n66zm_f0ab51b9-d5f8-4eea-974c-06f0f963d248/download-server/0.log"
Jul 06 14:19:25.335596 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:25.335561    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf" event={"ID":"d354cb85-8c8e-4b8f-9329-22279919662c","Type":"ContainerStarted","Data":"a8bcd30b283e254a88ee39624819435db2acc02fb39fd2beb1e0034ce8c3e374"}
Jul 06 14:19:25.335809 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:25.335618    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:25.335809 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:25.335636    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf" event={"ID":"d354cb85-8c8e-4b8f-9329-22279919662c","Type":"ContainerStarted","Data":"bc1e0eae45e53b94cb835efb578874735c2ced7ba1c7ddb35efeec430c8af633"}
Jul 06 14:19:25.353083 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:25.353006    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf" podStartSLOduration=1.35298739 podStartE2EDuration="1.35298739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:19:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:19:25.351783885 +0000 UTC m=+2380.663347574" watchObservedRunningTime="2026-07-06 14:19:25.35298739 +0000 UTC m=+2380.664551058"
Jul 06 14:19:27.074731 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:27.074703    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jhwrh_891e0a85-e345-47ee-930d-8361eab9b666/dns/0.log"
Jul 06 14:19:27.096067 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:27.096027    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jhwrh_891e0a85-e345-47ee-930d-8361eab9b666/kube-rbac-proxy/0.log"
Jul 06 14:19:27.122500 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:27.122426    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-24pv7_94fa57f3-07ff-41ed-ba5b-1afa96644e70/dns-node-resolver/0.log"
Jul 06 14:19:27.735838 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:27.735807    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d84559797-5zg8t_e119faea-a52c-4da5-b226-ed4dc01f7f6c/registry/0.log"
Jul 06 14:19:27.812496 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:27.812466    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jvw66_9ef2141c-12a4-456c-aaa6-2562ad662e9e/node-ca/0.log"
Jul 06 14:19:28.900720 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:28.900667    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4v8qkn_9719f926-ff1f-4e1d-8674-cd03f9ce7e70/istio-proxy/0.log"
Jul 06 14:19:29.037235 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:29.037202    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85bfc8ccc9-6v29g_535fd6b9-00c9-433d-ac21-4649061cfd9c/kube-auth-proxy/0.log"
Jul 06 14:19:29.110696 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:29.110663    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lw78z_30405940-ed0a-4e35-844f-e8aa9ba80f3b/istio-proxy/0.log"
Jul 06 14:19:29.149783 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:29.149748    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lw78z_30405940-ed0a-4e35-844f-e8aa9ba80f3b/istio-proxy/1.log"
Jul 06 14:19:29.188371 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:29.188272    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x29pb_9fd49e00-3560-41fb-9e9b-528710a4ace6/payload-pre-processing/0.log"
Jul 06 14:19:29.247598 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:29.247552    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-88zsj_029f1e78-7647-4513-931f-4567da2e4558/payload-processing/0.log"
Jul 06 14:19:29.287561 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:29.287523    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f94c6895c-tdclc_fef07690-0fb5-4d47-81c8-8e4b6bdb23cf/router/0.log"
Jul 06 14:19:30.087839 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:30.087786    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9vc98_c5bcfdc8-ccc4-41cf-a986-7ee07d32cf24/serve-healthcheck-canary/0.log"
Jul 06 14:19:30.640907 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:30.640874    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-khpj2_e4b8d094-6812-404e-8b6e-4da897d37c31/insights-operator/0.log"
Jul 06 14:19:30.641422 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:30.641403    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-khpj2_e4b8d094-6812-404e-8b6e-4da897d37c31/insights-operator/1.log"
Jul 06 14:19:30.805588 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:30.805561    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s2xzt_e8a6cfca-bad3-403f-a852-df71d8bd891c/kube-rbac-proxy/0.log"
Jul 06 14:19:30.827765 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:30.827734    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s2xzt_e8a6cfca-bad3-403f-a852-df71d8bd891c/exporter/0.log"
Jul 06 14:19:30.851950 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:30.851919    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s2xzt_e8a6cfca-bad3-403f-a852-df71d8bd891c/extractor/0.log"
Jul 06 14:19:31.358148 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:31.358121    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-nkbnf"
Jul 06 14:19:33.387575 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:33.387540    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nbxmz_43628a7d-a32c-4565-85cd-7f6a77e53be0/manager/0.log"
Jul 06 14:19:33.549032 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:33.548995    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kgqbb_03d756e5-e2ec-4aa0-adb5-3279504dca39/manager/0.log"
Jul 06 14:19:33.608378 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:33.608341    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6d756dd5d6-w8whm_cd6d6793-78e9-4cea-b4b2-3783a6feb5c9/maas-api/0.log"
Jul 06 14:19:33.649252 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:33.649224    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722440-tqf6j_c1d92a78-c244-4812-86c3-1f24729e65b4/cleanup/0.log"
Jul 06 14:19:33.805270 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:33.805236    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6875d9b67d-q5b6p_91212030-f4a6-4ed7-b376-e77bebfa9d08/manager/0.log"
Jul 06 14:19:33.826970 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:33.826942    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-czzwh_c65276a5-d955-4f8a-ba22-b613beaee814/server/0.log"
Jul 06 14:19:33.912405 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:33.912306    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2qndn_a65f52a7-99e9-41e2-aaf4-389a6ec47909/manager/0.log"
Jul 06 14:19:33.990520 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:33.990482    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b559b5dcd-hjl7c_3632a88f-a1dd-4674-a5ba-9673630b9825/manager/0.log"
Jul 06 14:19:34.015867 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:34.015841    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b559b5dcd-hjl7c_3632a88f-a1dd-4674-a5ba-9673630b9825/copy-manifests/0.log"
Jul 06 14:19:34.144707 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:34.144677    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-cpsvn_78a93b21-8da2-4a12-b765-32a78ce65c52/postgres/0.log"
Jul 06 14:19:35.424817 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:35.424786    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4v8qkn_9719f926-ff1f-4e1d-8674-cd03f9ce7e70/istio-proxy/0.log"
Jul 06 14:19:35.533834 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:35.533762    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85bfc8ccc9-6v29g_535fd6b9-00c9-433d-ac21-4649061cfd9c/kube-auth-proxy/0.log"
Jul 06 14:19:35.578737 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:35.578708    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lw78z_30405940-ed0a-4e35-844f-e8aa9ba80f3b/istio-proxy/0.log"
Jul 06 14:19:35.612298 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:35.612266    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lw78z_30405940-ed0a-4e35-844f-e8aa9ba80f3b/istio-proxy/1.log"
Jul 06 14:19:35.632746 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:35.632715    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x29pb_9fd49e00-3560-41fb-9e9b-528710a4ace6/payload-pre-processing/0.log"
Jul 06 14:19:35.682621 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:35.682572    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-88zsj_029f1e78-7647-4513-931f-4567da2e4558/payload-processing/0.log"
Jul 06 14:19:35.696159 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:35.696129    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f94c6895c-tdclc_fef07690-0fb5-4d47-81c8-8e4b6bdb23cf/router/0.log"
Jul 06 14:19:36.950364 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:36.950334    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4v8qkn_9719f926-ff1f-4e1d-8674-cd03f9ce7e70/istio-proxy/0.log"
Jul 06 14:19:37.063269 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:37.063240    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85bfc8ccc9-6v29g_535fd6b9-00c9-433d-ac21-4649061cfd9c/kube-auth-proxy/0.log"
Jul 06 14:19:37.101892 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:37.101857    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lw78z_30405940-ed0a-4e35-844f-e8aa9ba80f3b/istio-proxy/0.log"
Jul 06 14:19:37.139311 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:37.139170    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lw78z_30405940-ed0a-4e35-844f-e8aa9ba80f3b/istio-proxy/1.log"
Jul 06 14:19:37.166347 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:37.166314    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x29pb_9fd49e00-3560-41fb-9e9b-528710a4ace6/payload-pre-processing/0.log"
Jul 06 14:19:37.210887 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:37.210783    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-88zsj_029f1e78-7647-4513-931f-4567da2e4558/payload-processing/0.log"
Jul 06 14:19:37.226725 ip-10-0-134-86 kubenswrapper[2573]: I0706 14:19:37.226700    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f94c6895c-tdclc_fef07690-0fb5-4d47-81c8-8e4b6bdb23cf/router/0.log"